Project Title: Iterative Human-Computer Interaction Design in Expressive, Multimodal, Artistic Experiences
Keywords: human-computer interaction, art installations, multimedia output, multisensory integration, digital visual interface
Student: Chi (Jaclyn) Pham
Software Engineering & Art, Science, and Innovation
Harold M. State Research Fellowship
Supervised by Professor Emily Graber - Department of Computer and Information Science
Overview
The Typewriter Piano is an immersive art piece that blends the tactile experience of typing with the auditory and visual elements of music. By connecting a typewriter to a piano and a digital display, the installation allows users to control both the music and the visuals through simple typing actions. The visual component dynamically responds to the user’s typing, creating unique and ever-changing patterns on a surrounding screen. This fusion of sensory elements aims to captivate and inspire both the user and the observer.
My role in the project involves interpreting the typewriter-encoded digital signals sent from another device and translating them into visual instructions for the display. I am responsible for designing and coding the visual interface, ensuring that the brushstrokes on the screen accurately reflect the user’s typing movements.
Iterative Design
Using TouchDesigner, I have iterated on various design concepts for the visual interface. My aim is to create a balance between user control and visual unpredictability. While users will have some influence over the brushstrokes, I want to ensure that the shapes and patterns remain dynamic and surprising. This will enhance the overall visual experience and keep users engaged.
