Shengzhi Wu, Daragh Byrne, Molly Steenson, Robert Fraher, Laurel Fraher
Mergereality is a design exploration that aims to explore multi-device hand-gestural interactions in augmented reality (AR). We present two demos here: dragging sticky notes from an iPad to AR, and pulling 3D models from a computer display. We prototyped the concepts with an Oculus Rift VR headset and Zed Mini camera as a passthrough AR solution and coupled it with Leap Motion for hand tracking. By merging the boundary of digital and physical, we demonstrate an interaction strategy that harnesses physical affordances to assist digital interaction in AR with hand gestures.
Wu, S., Byrne, D., and Steenson, M.W. 'Mergereality': Leveraging physical affordances for multi-device gestural interaction in augmented reality. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, New York, 2020.
Shengzhi Wu, Google
Daragh Byne, Carnegie Mellon University
Molly Steenson, Carnegie Mellon University
|Dragging a sticky note from an iPad into AR.
The global number of people grieving a loved one is enormous. Seeing the Wonder is an app designed to help people process their grief and inspire them to embrace life. The app comprises two components. The first allows users to explore an interactive narrative. This narrative synthesizes traditional humanities media (e.g., literature, visual art, music) into a rich digital experience. The second extends ideas from the narrative into a reflective journaling activity. This activity is based on grief and bereavement theory and borrows from models and case studies in the areas of cognitive-behavioral therapy and creative art therapy.
Robert Fraher, University of Wisconsin-Stout
Laurel Fraher, HappyLove Studios
|An app designed to help the bereaved process their grief and embrace life.
©2020 ACM 1072-5520/20/09 $15.00
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.
The Digital Library is published by the Association for Computing Machinery. Copyright © 2020 ACM, Inc.