All posts

19 posts since 2018

— 2025

EmoDrink - Handing Your Body's Data Back to You

Your watch reports heart rate variability as a number at the end of the day, when you can do nothing with it. EmoDrink turns it into one suggestion.

Zenflow - MR Transitions for Sleep and Relaxation

An MR system that gradually turns your room into a starry night sky, co-designed with pranayama practitioners.

So It Knows You Are Struggling. Now What?

Three papers in one year on the question this series kept running into: once a system knows you are struggling, what should it actually do about it?

— 2024

The Sensor Was Already in the Headset

Three years of strapping sensors to people, and the signal was in the hand tracking the whole time. How you reach says something about your cognitive load.

165 Hours of Feeling Sick

Every model for VR motion sickness was trained on under two hours of video. The fix was not a better model, it was patching 100 commercial games.

— 2023

A Camera That Watches You Back

A VR photo walk where the sky tints red when you get stressed and the companion beside you changes its voice. The world responds instead of reporting.

— 2022

Three Hypotheses, and Nobody Looked

In 2022 I argued that VR should share heart rate, cognitive load and attention. Two years later we tested it on 28 people, and nobody looked.

Pinning a Biomechanical Model to a Lump of Silicone

Getting a breast tissue model out of the solver and onto a silicone phantom on a desk, seen through a HoloLens 2, and making it stay there.

— 2021

Bringing 3D to Zoom

Four years of research assumed everyone owns a headset, then came a pandemic in which nobody did. XRTB puts the VR person on the Zoom grid.

Volumetric Training

Four ways to show somebody how to service a motorcycle engine, compared head to head. A recording of the instructor beat all of them.

— 2020

First Contact : XR for Good

An art installation that uses XR to seat strangers from different cultures at the same table, because the medium is a headset but the aim is real encounter.

Pointing With Sound

Every visual cue fails the moment the thing you need is behind you. Putting the remote expert's voice in 3D solved what the visual work could not.

Which Cue Is Actually Doing the Work?

Eight depth cameras and a study built to separate eye gaze from hand gesture instead of shipping them as a bundle. The answer was not the expected one.

NeuralDrum

Leveraging cognitive synchronization to create a collaborative music production experience with immersive visualization in virtual reality.

— 2019

Hyperscanning

Comparisons between Real and Virtual Environments using Hyperscanning

Hybrid Office

What does a home office need to be if remote collaboration is designed into the architecture rather than bolted on afterwards?

Come to the Table

A kitchen table in New Zealand and a question from artist Mairi Gunn: can XR help strangers from different cultures actually meet?

Wearable RemoteFusion

Four depth cameras stitching a live 3D model of a room, so a remote expert can walk around your workspace instead of watching video of it.

— 2018

The Sandbox That Draws Its Own Contours

A projector and a depth camera turn a box of sand into a live topographic map. Built for Te Papa out of timber from my weekend job.