My (his) main research interests are augmented and virtual reality (AR/VR) as well as camera networks. This includes building novel 3D user interfaces (e.g., using projection mapping or VR headsets) that adapt the layout of spatial UI elements based on implicit user input (e.g., gaze data) and building toolkits for room-scale interfaces. More recently, I also investigate different realities afforded by the combination of VR devices and camera networks.
The Verb Collective is a toolkit for creating interactions and experiences in Unity. We employed a strategy of reducing code into very basic commands, such as “to look.” Each verb can be triggered by another verb or can be active on start, and each verb can act as a trigger for an array of other verbs. Our goal was to create a system inspired by the exploration of concrete experiences as a way to open the technology to users less interested in a specific outcome, such as a game, and more interested in exploring the material properties of the worlds they create. In doing so, we hope to bring in a more diverse set of makers that challenge existing notions or expectations of these media.
