Receipt 2.0

categories: AR, coding, interactive installation, physical computing, sound recording, sound design

tools: Unity, Vuforia, Arduino, ultrasonic sensor, Logic Pro

collaborator: Chengchao Zhu


Build upon Receipt 1.0, this Receipt 2.0 is the second installation in this series. Receipt 2.0 collects real stories from real people. We interviewed people from our friends and strangers at Washington Square Park. We asked them: what is an object you bought before that is related to a small life moment you had? The object can be big, small, fancy, ordinary, special, or not special, and the story relevant to the object can be happy, sad, surprised, funny, weird, important, not important, anything. This project is like an augmented reality documentary. Each receipt is quietly hung underneath a very dim light bulb. When user holds the receipt up, the bulb would light up. Then, user can scan the receipts to listen to the audio experience and watched animation. For further development, we imagine this project to be installed on an entire wall.



For the final project, we continued to develop from our last project Receipt 1.0. This time, we wanted to integrate physical computing and sound into our project. I documented voice from few people at Washington Square and ITP. It was an interesting experience asking random strangers outside to record their stories. I recorded about five stories, and we chose three to use. I found that a comfortable and quiet environment help getting higher quality stories, and I also got better in asking the right questions to get the most storytelling component. 


To integrate physical computing, we thought about using light. It reminds me of a film set I saw, designed by Angran Li, as the picture shown below. The film is called The Visitor. This picture inspired us to create a light effect for each receipt. When viewer read the receipt, light is on. It is like the receipt become alive. When they put the receipt down, light fades off. 

Screen Shot 2018-08-15 at 11.42.34 PM.png



This is my first time composing in a project.


With light and audio, this artwork became a very personal experience for audience. I felt very happy to be able to find those intriguing stories and transform them, to create a space for sharing stories. For the next step, we can improve our interaction design, collect more recordings, and install this in a larger scale. For example, we can explore how to connect Unity with Arduino, so we can turn lights on/off when the image target is triggered.