Series · 5 posts · 2019 to 2021

Remote Collaboration

The PhD thread: depth-camera capture, gaze and gesture cues, and putting a 3D workspace into Zoom.

Start at part 1 → ≈ 33 min total read
  1. 01Wearable RemoteFusionFour depth cameras stitching a live 3D model of a room, so a remote expert can walk around your workspace instead of watching a video of it. The first system of my PhD, and the study that showed the two people in a call want opposite things.2 June 2019 · 6 mins read
  2. 02Which Cue Is Actually Doing the Work?Eight depth cameras, a Magic Leap on one head and a Vive Pro on another, and a study designed to separate eye gaze from hand gesture instead of shipping them as a bundle. The answer was not the one the gaze research predicted.23 April 2020 · 7 mins read
  3. 03Pointing With SoundEvery visual cue fails the moment the thing you need is behind you. Putting the remote expert's voice in 3D, and adding audio beacons, solved a problem the visual work could not.1 July 2020 · 6 mins read
  4. 04Volumetric TrainingFour ways to show somebody how to service a motorcycle engine, compared head to head. A volumetric recording of the instructor beat an avatar, a hand, and an annotation on almost everything that mattered.2 January 2021 · 8 mins read
  5. 05Bringing 3D to ZoomFour years of remote collaboration research that all assumed everyone owns a headset, and then a pandemic in which nobody did. XRTB puts the VR person into an ordinary Zoom call as just another face on the grid.8 May 2021 · 6 mins read