Demo Hour


Issue: XX.6 November + December 2013
Page: 8
Digital Citation
Bookmark and Share
Shunichi Kasahara, Ryuma Nilyama, Valentin Heun, and Hiroshi Ishii

back to top 

The exTouch is an embodied, spatially aware interface system that allows users to manipulate actuated objects in space using augmented reality. The system extends users' touchscreen interactions into the real world by enabling spatial control over an actuated object. When users touch a device shown in live video on the screen, they can change its position and orientation through multi-touch gestures or by physically moving the screen in relation to the controlled object. We demonstrated that the system can be used for applications such as an omnidirectional vehicle, a drone, and moving furniture in a reconfigurable room.

Project website:

Publication: Shunic hi, K., Ryuma, N., Valentin H., and Hiroshi I. 2013. exTouch: Spatially-aware embodied manipulation of actuated objects mediated by augmented reality. Proc. of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, New York, 2013, 223–228.

Shunichi Kasahara | MIT Media Lab and Sony Corporation | [email protected]

Ryuma Niiyama | MIT Media Lab | [email protected]

Valentin Heun | MIT Media Lab | [email protected]

Hiroshi Ishii | MIT Media Lab | [email protected]