Augmented Reality and Mixed Reality Applications for Transparent Displays

Our award winning team was assigned to design creative and useful applications for Samsung’s transparent display technology. Working with vendors, developer teams and collaborating with scientists we came up with most valuable scenarios and product line up of devices using transparent displays. We held multiple workshops and seminars to work with various subject matter experts and  executives. Our transparent human interface framework is now used by other designers as a guideline to develop products. 

transparent.jpg

Design principles for transparent and augmented reality technology

Reality became our biggest challenge. Anything behind the transparent display directly impacted the content on the transparent screen. This could be a benefit in many scenarios or noise in others. We had to carefully study, research and test applications and technology for a user experience to be effective. In the end we set out to answer a few key themes that we boiled down from a graveyard of questions and ideas. 

  • What happens when there is only 1 person viewing it from one side?

  • What happens when there are multiple people on one side? Optics and cone of visions gave people different angles.

  • What happens one there people on both sides of the display trying to consume the same content?

  • What happens if the display is in motion?

  • What happens if there are objects in question behind the screen in motion?

As a result we were able to create key intellectual property around creating user experiences using transparent technology. Sketches below illustrate some of those explorations and explanations. We worked with text based content, image based content, moving image based content, optics, occlusion/inclusion, motion, proximity, illumination, environmental sensing, dynamic display calibration etc.