All posts

15 posts since 2016

— 2026

Sidekick: Remote Help That Starts Without a Human

A technician alone on a job with something they have never seen before. Sidekick puts an AI on the glasses they own, and calls a human only when it has to.

— 2025

So It Knows You Are Struggling. Now What?

Three papers in one year on the question this series kept running into: once a system knows you are struggling, what should it actually do about it?

— 2023

Haptic Hongi, Reiterated

Four years on, the project came back to SIGGRAPH Asia on a Magic Leap 2, with a capture pipeline light enough to fit in a suitcase.

— 2022

Haptic Hongi: A Greeting You Can Feel

In a hongi, foreheads press together and breath is shared. You cannot do that with a hologram, unless you bolt an actuator to the headset.

Pinning a Biomechanical Model to a Lump of Silicone

Getting a breast tissue model out of the solver and onto a silicone phantom on a desk, seen through a HoloLens 2, and making it stay there.

— 2021

Meet Biscuit, a Dog That Isn't There

A low-poly golden retriever that lives in your room instead of on a screen, built to find out whether a virtual pet stops feeling like software.

Volumetric Training

Four ways to show somebody how to service a motorcycle engine, compared head to head. A recording of the instructor beat all of them.

— 2020

First Contact : XR for Good

An art installation that uses XR to seat strangers from different cultures at the same table, because the medium is a headset but the aim is real encounter.

Pointing With Sound

Every visual cue fails the moment the thing you need is behind you. Putting the remote expert's voice in 3D solved what the visual work could not.

Which Cue Is Actually Doing the Work?

Eight depth cameras and a study built to separate eye gaze from hand gesture instead of shipping them as a bundle. The answer was not the expected one.

— 2019

Come to the Table

A kitchen table in New Zealand and a question from artist Mairi Gunn: can XR help strangers from different cultures actually meet?

Wearable RemoteFusion

Four depth cameras stitching a live 3D model of a room, so a remote expert can walk around your workspace instead of watching video of it.

— 2018

The Sandbox That Draws Its Own Contours

A projector and a depth camera turn a box of sand into a live topographic map. Built for Te Papa out of timber from my weekend job.

— 2017

Final Touches

The Mirror is finally ready. A satisfying end to one of the most interesting projects to date.

— 2016

Idea and Inspiration

Six months of bed rest after ACL surgery, a Pinterest habit, and a Magic Mirror: the first thing I built that felt like real-world augmented reality.