Sunday, 12 December 2010

Final Project

The final design will be an immersive gallery piece, the design will be interactive and simple.

The audience/participants will have a few options to work/play with the 3D projections/holograms. The 3D projections will be displayed as life size projections on the same level as the audience allowing complete interaction.

1. The participant will enter a booth and will be scanned from all angles from both cameras and a tracking system. The computer will take a composite shot and based on the tracking will create a life sized 3D Projection/Hologram to be displayed on the interactive platform.

2. For a smaller option participants will sit in a chair shaped much like a salon hair dryer chair. This will allow for a dome to be placed over the head to scan the head from all angles and using a tracking system create a 3D composite and display an interactive 3D projection/Hologram on a raised platform.

3. No composites will be created, however the participant will just interact with 3D projected characters or other people's composites.

After the participant has had their composite taken it will be stored in the computer and the participant will approach the interactive panel and select their 3D avatar (whether it is a full body or just a head avatar). The avatar will be displayed as life size in front of them via a series of projectors and can be seen from all angles.
The participants movements will be tracked through the tracking system much like the XBox Kinect system. This will function in a few different ways depending on how it the participant has set their avatar on the interactive panel.

The avatar can mirror the movements of the participant either in real time or it can be set on a delay. The program will also have a series of movements for both the body and the face. ie gurning, applause and football celebrations.

The solo head projection will be placed on a plinth that can be raised or lowered to match the participants height so their interaction can be made easier.

A nice side line that will run along with the human projections is a 3D Projection and interactive game of of table tennis. The game will allow 1-4 players and each player will hold a small paddle containing sensors the react to a 3D projection of a ping pong ball which in turn will react to speed, thrust and pressure expelled towards it allowing the game to seem as realistic as possible.

Wednesday, 24 November 2010

Placing Holograms in Real Video

So the idea is to use Cinema 4D to create 3D objects and insert them into real video.

I will also use footage to use for hologram projection to, I will do this by recording real objects or people in front of a green/blue screen and then super impose them into the final video.

To make this a total immersive environment the actual display will be done live in front of an audience where the scientist will conduct a demonstration in front of the audience and show them the 3D holographic projection that he and his lab assistants have been working on. Then near the end an error will occur showing that the scientist was in fact a 3D holographic projection himself. This will demonstrate how believable the holographic projections actually are.

For the actual project I will create this in a video format as I do not have the projection technology nor can I afford it. I will show a mock video of how the 3D projection mapping would work, it will show a scientist working in a lab attempting to create a working 3D holographic projection within a controlled environment by the end of the short video it will be revealed that the scientist working on the 3D hologram was in fact a 3D light projection himself working live from another room to which he will walk into the room at the end.

I am currently building 3D models in Cinema 4D and I will test them in After Effects.

Cinema 4D to After Effects

Cinema 4D to after effects tutorial from rob redman on Vimeo.

Thursday, 4 November 2010

How this will work

Projected Light;

How to actually create 3D projections from multiple angles, the main problem with 3D projections is the fact they are actually only 2D however they appear to be 3D because of the direction that they are being viewed or the viewer will have to use 3D glasses.

For total immersion to occur 3D glasses will hinder the illusion, so how do you change that.

Using a series of projectors from different areas of the room to create a 3D object. The problem here is that beams of light don't just stop.

The way to get around this problem is to use strength of power, a change of origin point, silicon dummy vessels or a combination of 2 or more of them.

Using changes in the strength of beams from various projections could create the illusion of a 3D hologram from all directions. This can be used by building the the hologram initially within a 3D program like Cinema 4D or Maya and allowing the projector to take commands from the program on how much strength to use to power to the beams of light thus controlling the distance of how far the light will be projected.

Alternatively by changing the origin source you could project a base image from below the 3D object via a dome projector and use external projectors to help to project movements within the object.

Or using a silicon object to project the image directly onto and use electrodes with the silicon object to create movement. Obviously the movements must flow with elegance to help maintain the total immersion any signs of delay or jerking could destroy the illusion. The would have to controlled via the same program as the projectors so they can work in unison.

Finally as an alternate with the silicon object, you can fit an internal spherical projector to project the 3D image from the inside.

Holographic Projection for Live Events | About Musion Systems

Holographic Projection for Live Events | About Musion Systems

Eyeliner™ is unique worldwide and protected by patents granted in countries all over the world. Musion® is principally an Intellectual Property licensing company. The business is based around exploiting a number of patents that have been issued on producing Pepper's Ghost using a purpose designed foil rather than glass. For reference the patent has been granted as a "process patent".

4m and 8m Eyeliner™ foil is carefully prepared during manufacture and rolling so as to retain maximum transparency and strength when subject to extreme tension. The resulting smooth, blemish free surface betters that of a huge plate glass mirror, allowing the true reproduction of high definition video at such high quality that audiences viewing Eyeliner™ video images imagine them to be real.

Using sets starting from just 2m² cubes, projected images range in size from 50cm², up to a massive 20m x 100m. Live or virtual stage presenters appear alongside and interact with virtual images, humans or animated. Even existing ‘made for TV’ 2D video material is transformed into compelling footage running in giant floating 3D virtual screens created by the Eyeliner™ system.

3D Holographic Projection

Neurosonics Live from Chris Cairns on Vimeo.


http://www.musion.co.uk/

Beardyman, to time UK beat boxing champion headlined the MAMAs 2009

Musion Eyeliner is a high definition 3D holographic video projection system allowing a spectacular 3-dimensional moving life-size hologram to appear within a live stage setting using Peppers Ghost technology. Eyeliner brings dramatic, previously unseen 21st century video film effects to live events, including audiovisual artistic performances, conference or trade show presentations, retail displays and large-scale digital signage.

Friday, 29 October 2010

Outlined Idea for Personal Project

I have decided to go down the route of total immersion as I feel that this has the strongest potential.

This was my original idea for total immersion;

Using sensory and tracking technology to create total immersion;

The technology could be used in say a live performance of Dr Who to virtually teleport the TARDIS into a room with a live audience and project a set. The actors, set and TARDIS would be in another location or studio filming the live performance but creating the illusion that they are live in the room. This would also allow for CGI projections of any CGI characters. This could also be implemented within theme parks for their immersive rides.


To create an environment of total immersion, I will not only have to think about the technology used, but the actual room to which the audience would be in. This is something that I will be working on over the coming week along with an expansion of the original idea.

Monday, 18 October 2010

Using sensory and tracking technology for an installation

Using sensory and tracking technology for an installation;

This technology could be used for an installation to create and immersive installation to which the viewer would see either a live or recordered 3D performance where people, objects, sets, images, animations ...etc. This will allow the viewer/audience to become completely immersed in the installation. The idea would be for the performance/installation to be either recorded earlier in and then adapted and projected as the installation to which they can then add scenery, CGI characters, objects. Or create a live environment to allow the audience to interact with the projections, for instance the installation could run via a program to which the tracking and sensory technology would allow the audience member's movements to be tracked allowing them to interact with the 3D projected objects or CGI characters.

Using sensory and tracking technology to create total immersion

Using sensory and tracking technology to create total immersion;

The technology could be used in say a live performance of Dr Who to virtually teleport the TARDIS into a room with a live audience and project a set. The actors, set and TARDIS would be in another location or studio filming the live performance but creating the illusion that they are live in the room. This would also allow for CGI projections of any CGI characters. This could also be implemented within theme parks for their immersive rides.

Using sensory and tracking technology in the field of entertainment

Using sensory and tracking technology in the field of entertainment;

There are multiple uses for this technology within entertainment the first are live concerts using the tracking and sensory technology scan a band playing live at Wembley Arena and project them in real time project the band to other arenas nationally or internationally.
The second would be used for plays or stage performances and would be used to project sets, people or objects on the stage live and like the live bands the technology could also be used to project the play live at another play house.

Using sensory and tracking technology in the workplace

Using sensory and tracking technology in the workplace;

If an international company want to have a corporate meeting rather than flying people all over the world they can use the tracking technology to scan the conference room in each of the offices of the meeting's attendees to show the inanimate objects in the room, then rescan each room with the attendees in their individually markered seats.
There would also be 6 projectors and 6 cameras in each room, they would use sensory technology to project a 3D image of each attendee in their individually markered seats, this will virtually create simulated environment to which each conference room would be virtually projecting all of the attendees in real time.
This would enable a higher level of interaction, a much smoother conference and allow people to use their laptops for more than just looking at a web-cam video of their colleagues.

Sensory and Tracking Technology

I have decided to adapt my 2nd idea of a 3D game environment and take the tracking and sensory technology from that and take it down a new path. I plan to use tracking technology to virtually place people, places or objects from one area to another in a live environment and create total immersion.

I came up with this idea after seeing this video;

http://stevepaulmyers.co.uk/blog/?p=498


Superbien - Envision: Step into the sensory box, Audiovisual Environment 2010


Amazing lighting displays via scans and projection, these French dudes are clever fellas!

Monday, 11 October 2010

Personal Project

1. An app that reads from your tags and gives you updates for things that you like in the area and runs via GPS. Basically you can scan items with your smart phone or be in a bluetooth area and your phone will receive these and tell you things for example;
You could scan a packet of pasta and your phone will tell you the location of the nearest Zizzi's or give you recipes taken from the internet on how to cook pasta meals and what with. Or you could be a big coffee fan and it will alert you when ever you're near a Starbucks.

2. A 3D game environment, based on the technology used in the Wii remotes however at this stage these will have to be held in controlled environments such as arcades. You will play in a large room with other people either actually with you or in another 3D room and you can interact online with their environment. Using projectors, sensors, goggles and surround sound the 3D environment will be created, this will be the closest thing to a Holodeck from Star Trek as we can get at this point in time.

3. The last is an interactive panel for the home that will allow you to control multiple items from one screen ie, lights, TV, stereo, internet ...etc

A combination of 1 & 3 may be the best possible outcome. Plan to complete The Statement of Intent for week 6.