Projection mapping

Projection mapping, also known as video mapping and spatial augmented reality, is a projection technology used to turn objects, often irregularly shaped, into a display surface for video projection. These objects may be complex industrial landscapes, such as buildings. By using specialized software, a two or three dimensional object is spatially mapped on the virtual program which mimics the real environment it is to be projected on. The software can interact with a projector to fit any desired image onto the surface of that object.^[1] This technique is used by artists and advertisers alike who can add extra dimensions, optical illusions, and notions of movement onto previously static objects. The video is commonly combined with, or triggered by, audio to create an audio-visual narrative.

History

Although projection mapping is relatively new, its history goes further back than one may expect. (The history is detailed at The Illustrated History of Projection Mapping^[2]). Until about 3 years ago, projection mapping was referred to as Spatial Augmented Reality and Shader Lamps Shader lamps, and invented at University of North Carolina at Chapel Hill by Ramesh Raskar, Greg Welch and Henry Fuchs. The first known record^{[citation needed]} of projections onto 3D objects was in 1969, when Disneyland opened their Haunted Mansion ride. They used fake disembodied heads as objects which had 16mm film projected onto them to make them look real through optical illusions. The next record of projection mapping is from 1980 when installation artist Michael Naimark filmed people interacting with objects in a living room, then projected it in the room, creating illusions as if the people interacting with the objects were really there.^[3][4] The first time the concept of projection mapping was investigated academically^{[citation needed]} was at the University of North Carolina at Chapel Hill, in the late 1990s, where scholars worked on a project, Office of the Future Shader lamps. In this project, they wanted to connect offices from different locations to feel as if they are together in a shared office space by projecting people into the office space as if they were really there.^[5] By 2001, more artists began using projection mapping in artwork and groups such as Microsoft began experimenting with it as a means of technological advancement.^{[citation needed]}

Methods

After the object which will be projected on is chosen or created, a virtual replica of the entire physical set up needs to be created. First, one must choose the images or video they wish to project. Then, the virtual model of the projection surface is created within the computer using special programs. The next step is defined as "masking," which means using opacity templates to actually "mask" the exact shapes and positions of the different elements of the building or space of projection. Coordinates need to be defined for where the object is placed in relation to the projector. Finally, the xyz orientation, position and lens specification of the projector add to the virtual scene.^[6] Adjustments are commonly needed by manually tweaking either the physical or virtual scene for best results. Large projectors with 20,000 lumens or larger will be needed for large-scale projections such as on city skyscrapers. Otherwise, for smaller productions, a projector with a basic lower lumens will work. Video mapping software such as MadMapper and VPT 6.0 are all downloadable for use in projects like these. Also, extensible open-source software frameworks such as MPM (Multi-Projector-Mapper)^[7] are available.

Productions, advertisement and art

Projection mapping first came to prominence through guerilla advertising campaigns and video jockeys for electronic musicians.^[8] Large companies such as Nokia, Samsung and BMW have since used video projections to create campaigns for their products in major cities across the world. These advertising campaigns commonly use mapping techniques to project scenes onto the sides of buildings. Projection mapping can also be interactive, as Nokia Ovi Maps did a project in which the projections would mimic people's movements.^[9] The festival Fête des Lumières in Lyon, a festival to honour the Virgin Mary, has recently also started incorporating 3D mapping into their productions, creating the illusion of a giant pinball machine on the side of a building. Common techniques for these performances included both 3-D mapping techniques and 3D projection to create the illusion of depth, as well as motion such as crumbling buildings.

In the electronic dance music (EDM) community, it is becoming increasingly common for DJ's to accompany their music with synced visuals. Though normal projection screens are commonly used, some visual artists are beginning to create custom made, 3D installations to project onto.^[10] Many EDM artists employ projection mapping techniques at many of their shows. Artists who are solely visual also use projection mapping as a means of creative expression, believing that it can enhance existing creative mediums such as painting and drawing.

Artists may use it as an avant garde form of expression as it is new technology that can turn their creative ideas into 3D projections, connecting with audiences in a new way.^[11] Video projections have appeared in urban centres such as New York City and London, where artists have used guerilla projections in public without any necessary approval. This way, artists can show their work in any location as anything and anywhere can be a canvas. Often people also use it as a means of activism; the group Occupy Wall Street has used it to project onto the Verizon Wireless building in New York City as a means to visually spread the word that Occupy Wall Street is still alive.^[12]

See also

• Son et lumière (show)

References