Exhibit X

Lumi: Experiencing Energy as a Discrete Element

What if AI could help us build novel mental models around energy consumption? This project explores object-recognition algorithms to enable new interaction modalities with energy, conceptualized as a light orb that lives inside a lantern: Lumi. When a lighting object, such as a lamp, is detected, the device sends a haptic signal to the user, who can decide to transfer light to the object simply by clicking a button. The light orb then flies into the selected object. Before being transferred to another device, the orb must always be recalled to the lantern. The apparently simple mechanism creates a magical interaction while sensitizing the audience to think of energy as a finite resource.

Schematic of the technology in use. The phone runs an object-recognition model in the browser, trained using pictures of the relevant objects in the room. Communication with the Home Assistant smart home server and the Arduino used for I/O in the lantern is done using the MQTT protocol.

The project was developed during the master's course in interactive technology design at Delft University of Technology in the Faculty of Industrial Design Engineering, in collaboration with the Citizen M hotel chain, and showcased during the D-CODE summer school in June 2022.

  Acknowledgments

We would like to thank our coach Maria Luce Lupetti and the course coordinators of ITD for their mentorship and support, as well as Annalise Tyrie and her team from Citizen M for the inspiring brief and feedback on the project.

Lumi can also be sent to other light or multimedia sources. Here it has been sent to a meditative visualization over the hotel room bed.

The lantern in use. The implemented AI + IoT system allows for an immediate and intuitive interaction for transferring energy.

The lantern that contains Lumi. Here, Lumi has been sent to a wall-mounted lamp.

  Authors

Bendik Schrøder is a masters student in interaction design at the Norwegian University of Science and Technology (NTNU) in Trondheim, Norway. He also completed one year of the master's in design for interaction program at TU Delft. He is interested in advanced prototyping, metaphor-driven design, and embodied interaction. [email protected]

Laura Hurenkamp is a master's student in design for interaction at Delft University of Technology in the Faculty of Industrial Design Engineering (IDE). [email protected]

Sampada Jayaram is a master's student in design for interaction at Delft University of Technology in the Faculty of Industrial Design Engineering (IDE). She is interested in designing for healthcare and working at an intersection between UX and strategy. [email protected]

Luisa María Zuluaga is an undergraduate student in design engineering at EAFIT University, Colombia. She is interested in UX and service design, with a focus on human-centered design. [email protected]

Copyright held by authors

The Digital Library is published by the Association for Computing Machinery. Copyright © 2023 ACM, Inc.