Archives For Ambient Intelligence

Great Wave Data

October 16, 2016


With augmented reality (AR) and virtual reality (VR) becoming the next computing platforms, app developers have been increasingly focused on building AR and VR apps.

One of the companies that aim to be on the cutting edge of Analytics VR and AR app development is GREAT WAVE. By helping people understand and analyze data more quickly, such a tool could provide richer, more insightful experiences than the ones derived from paper and screens. Studies conducted by researchers at Stanford and by the neuroscience and analytics team of the AR developers META (in conjunction with Accenture) demonstrate how the use of 3D information could amplify people’s efficiency and ability to focus on tasks.

Have a look at the video of GREAT WAVE:


2D vs 3D

September 8, 2016

Given the lack of studies that have systematically examined the perceptual cues that our brains use to rapidly process procedural tasks – META decided to partner with Accenture Labs on a pilot study examining the use of perceptual cues in AR. More specifically, they wanted to measure the effect an additional perceptual cue (motion) would have on the time it takes to complete a procedural task. The team operated under the hypothesis that integrating both stereo and motion perceptual cues could further reduce the limitations of 2D instructions – ultimately enabling people to more quickly complete a procedural task.

At this year’s Bay to Breakers pre-race expo, the colorful annual footrace in San Francisco (California), the team of Meta and Accenture researchers set up the procedural task of assembling a physical lighthouse Lego set.

They defined three conditions based on the different types of instructions participants were to receive:2D Paper, Holographic Static 3D (Stereo Cue), and Holographic Dynamic 3D (Stereo & Motion Cues).

Comparing the three instruction conditions, they found that Dynamic 3D Instructions enabled participants to more quickly complete each step. Participants using Static 3D Instructions and 2D Paper Instructions were much slower in comparison. This confirmed their hypothesis that the use of both the stereo and motion perceptual cues in AR instructions speeds up assembly time. Interestingly enough, the researchers found that participants using Static 3D Instructions were the slowest of the three instruction conditions. This was especially surprising to them because based on past studies conducted in 2003 and 2013 , they expected people using any kind of 3D instructions to perform the Lego building task more quickly than those using paper 2D Paper Instructions.

Check out this video:


Models of Diversity

March 11, 2016


Gave a talk on New Narratives at the conference Models of Diversity at the ETH and ZHDK Zurich.

The main aim of this conference was to create 3-way discourses to search for correlations and models that can foster deeper creative levels of discourses across the disciplines of art, science, sociology and philosophy. A round table conference with paired presentations of art researcher, scientists and theorists in diverse fields of inquiry-alongside dynamic moderators who tried to stimulate discourse.

Tango project

December 4, 2015

I had the chance to explore Google’s Tango with a team of developers. Great software and it is to hope that it can live up to its potential. The first consumer implementation will be in a package with Lenovo’s PHAB PRO later next year.
The essential aim is to give your mobile device full spatial awareness, or the ability to understand your environment and your relation to it, to get your smartphone to understand the world around it, enabling it to provide augmented reality experiences. A Project Tango device ‘sees’ the environment around it through a combination of three core functions.

First up is motion tracking, which allows the device to understand its position and orientation using a range of sensors (including accelerometer and gyroscope). Further, it involves depth perception, it is able to examine the shape of the world around you. Here it relies on Intel’s RealSense 3D camera. it helps the device to gain accurate gesture control and snappy 3D object rendering among a number of other features.

Additionally, Project Tango incorporates area learning, which means that it maps out and remembers the area around it.


Magic Leap

October 26, 2015


Magic Leap, Inc., a developer of novel human computing interfaces and software, announced in a newsletter the recent closing of its A round of venture capital. Magic Leap has now raised more than $50 million in its series seed and A rounds to develop its proprietary technology platform. Magic Leap will use the funds to advance the product development and commercialization of its proprietary human computing interface technology, known as “Cinematic RealityTM”.

At engagdet – Mariella Moon states that she can’t decipher what Magic Leap exactly is – but she argues that Magic Leap is:

a headset that superimposes digital images onto the real world. In that respect, it’s similar to Microsoft’s HoloLens, which is just slightly less mysterious (since we’ve actually seen it). But based on the things Abovitz said in his AMA at reddit, like “Our vision for AR and VR is a true replication of visual reality,” there’s a chance that it can also block the outside world entirely with virtual reality. (Update: Rachel Metz confirmed to engagdet on Twitter that it’s capable of doing full VR.)

This points out  that there’s a reason why the company is calling its technology “cinematic reality” rather than AR or VR: it works a bit differently than either of them. Standard AR and VR use stereoscopic 3D, a technique that tricks you into thinking an object is three-dimensional by showing each eye a different image and a different angle of the same object. The Oculus Rift and Samsung’s Gear VR headset are two well-known examples of this technique.


In his AMA Abovitz revealed that he’s not a fan of stereoscopic 3D and believes it can cause “temporary and/or permanent neurologic deficits.” So, Magic Leap uses a Lilliputian projector to shine light and images into the user’s eyes instead, the startup told Metz from MIT’s Technology Review. Your brain apparently won’t be able to detect the difference between light from the projector and light from the real world: The result is life-like digital images that show reflections like real physical objects would.


Magic Leap




July 22, 2015

4 hololens

Microsoft HoloLens puts you at the center of a world that blends holograms with reality. With the ability to design and shape holograms, you’ll have a new medium to express your creativity, a more efficient way to teach and learn, and a more effective way to visualize your work and share ideas. Your digital content and creations will be more relevant when they come to life in the world around you.


by Dieter Schmalstieg (Author), Tobias Hollerer (Author)

Augmented Reality (AR) is one of today’s most fascinating and future-oriented areas of computer science and technology. By overlaying computer-generated information on views of the real world, AR amplifies human perception and cognition in remarkable new ways. Do you like the virtual first-down line in football games on TV? That’s AR — and AR apps are rapidly coming to billions of smartphones, too. Working in AR requires knowledge from diverse disciplines, including computer vision, computer graphics, and human-computer interaction (HCI).


Augmented Reality: Principles and Practice integrates all this knowledge into one single-source reference, presenting the most significant AR work with scrupulous accuracy. Dieter Schmalstieg, a pioneer of both AR foundation and application, is drawing from his two decades of AR experience to clearly present the field. Together with mobile AR pioneer and research colleague Tobias Höllerer he addresses all aspects of the field, illuminating AR from both technical and HCI perspectives. The authors review AR’s technical foundations, including display and tracking technologies, show how AR emerges from the symbiosis of computer vision and computer graphics, introduce AR-specific visualization and 3D interaction techniques, and showcase applications from diverse industries. They conclude with an outlook on trends and emerging technologies, including practical pointers for beginning practitioners.