###### < Front View of the 3D volumetric image projected on a large-scale water screen at Busan's Asiad Main Stadium >
Scientific innovation is often born in laboratodsries, but sometimes it evolves in unexpected places. Concert venues, usually considered distant from scientific research, can be spaces where technological breakthroughs have profound impacts. While conducting research on an immersive smart performance captioning system, supported by the Ministry of Culture, Sports and Tourism and the Korea Creative Content Agency, the Min-Chul Park Research Team had the opportunity to test this technology in a real-world environment. This led to the unexpected discovery of a new 3D imaging technology, expanding the research beyond captioning systems to a new dimension of concert experiences.
When attending PSY’s _Summer Swag_ concert, the primary goal was to analyze the concert environment and explore the potential applications of the captioning system for audience engagement. However, as we observed the dynamic stage effects and audience reactions, we began considering ways to extend the visual experience into three-dimensional space without requiring physical equipment. Specifically, we sought to implement volumetric 3D imaging without the use of drones. This concept evolved into an integral imaging-based 3D display system inspired by the compound eyes of insects.
To bring this idea to reality, we incorporated novel electrode materials to enhance optoelectronic performance. This innovation allowed us to produce more refined 3D images, enabling audiences to experience volumetric imagery without special glasses. At the core of the technology is an array of micro-lenses that capture and project light in a specific manner, creating a true three-dimensional visual effect. Unlike conventional stage projection techniques, this method opened new possibilities for concert experiences and beyond.
###### 
######
To validate our technology in a real-world performance setting, we collaborated with the Summer Swag production team. While the concert primarily utilized displaying technology for visual effects, our research expanded beyond this application to include both imaging and displaying aspects. Laboratory experiments often take place under controlled conditions, making it difficult to predict real-world performance variables. However, at large-scale rehearsals held at Incheon and Busan’s Asiad Main Stadiums, we had the opportunity to apply our technology to an enormous 40m x 30m water screen. This allowed us to evaluate elements that could not be assessed in a small laboratory setting and to verify the system’s effectiveness in live performances.
During the experiment, we encountered real-world challenges unique to concert environments, including stage lighting, water effects, and audience movement. The water screen, unlike traditional LED screens, exhibited stability challenges due to water splashes and inconsistent surface formation, requiring meticulous adjustments to maintain clear and stable 3D imagery. Additionally, the intense stage lighting demanded precise optical calibrations to minimize interference. Through this iterative process, we confirmed the feasibility of our technology in large-scale performances.
The initial research conducted during _Summer Swag_ focused on horizontal 3D imaging, providing a sense of depth for the audience within the stage space. However, subsequent research built upon these findings and expanded the technology to incorporate vertical dimensions, resulting in a full-screen 3D imaging system. This advancement involved designing a more intricate lens array and implementing optical adjustments to maintain a seamless 3D effect in all directions. This development significantly increased the potential for practical applications of volumetric 3D displays across various industries.
As our research progressed, we explored how large-scale volumetric 3D imaging could bridge real and virtual spaces, enabling a new level of immersive telepresence. In discussions on potential applications, Hyun Woo Ko, who is particularly interested in quantum teleportation and real-time spatial communication, suggested that our 3D display system could function similarly to a ‘Stargate’—creating the visual illusion of a portal that connects two distant locations in real time. This concept envisions a massive 3D gateway for large venues, such as an NFL halftime show, where audiences could experience real-time telepresence effects, as if they were looking through a window into another space.
This ‘3D Stargate’-like system would leverage volumetric live capture, high-speed 3D data transmission, and integral imaging-based spatial display technology to create a seamless remote presence effect. While initially developed for live performances, this technology has the potential to transform various industries by enabling real-time 3D projections without the need for special glasses or headsets. Museums and galleries could use it to create interactive exhibitions, sports venues could enhance audience engagement with real-time 3D replays, and educational institutions could provide immersive learning experiences in science and engineering. In the medical field, it could assist in surgical planning and remote procedures, while architects and designers could utilize it for virtual modeling. By expanding the use of volumetric 3D displays, this research paves the way for new forms of digital interaction across multiple domains.
This research was made possible thanks to the _Summer Swag_ production team, particularly artist Park Jaisang (PSY) and CEO Minho Roh from P NATION, who were instrumental in facilitating an environment for experimentation. It is rare for large-scale concerts to allow experimental technology to be integrated, but their open-minded approach enabled us to conduct trials that would have been impossible in a conventional lab setting. This collaboration exemplifies the transformative potential of partnerships between science and the creative industries.
This study is not merely about enhancing concert technology—it is a preview into the future of 3D imaging and its vast potential applications. Moving forward, our team aims to refine this technology further, ensuring its integration into interactive media, exhibitions, education, sports, medical fields, and architectural applications. What began as a concert-based experiment has the potential to reshape digital media experiences across multiple domains.