Aria

Year — Fall 2024 (4 weeks)

Tools — Arduino, TouchDesigner

Synopsis — Worked in a team to create a wearable, touch-free instrument that generates sound and visuals from head movement.

View Project Deck

aria logo

This project was a tangible example of product design. We created a 3D mockup of a proposed design, and a fully-functioning Arduino-based prototype. As such, I was mainly responsible for putting together the hardware prototype that we could plug into TouchDesigner.

Concept Sketches

This project started off with the overarching prompt of accessibility related to music. We could only use facial gestures—no hands, no arms.

To brainstorm, we came up with a list of ideas in groups, did sketch sprints, and compared concepts. My group decided to go with one of my ideas, a wearable headpiece-instrument.

aria sketch 1 aria sketch 2

Building the Arduino

We wanted a functioning prototype. So we needed a functioning device.

This project was my first time ever working with hardware, so I began by researching various Arduino boards and how they work, as well as what additional pieces we would need and how those work. The New Media Design program at RIT already had a selection of Arduino Unos, so I searched specifically for Uno-compatible parts.

Fuctionality

Our device had to serve two main functions:

  1. tracking jaw movement (open/close)
  2. tracking head movement (nodding/shaking)
Parts

So I figured out two sensors that fit our needs:

  1. rotary/shaft encoder: tracks absolute or incremental angular movement of the axle
  2. inertial measurement unit (IMU): multi-axis accelerometer and gyroscope; tracks translational and rotational movement

We managed to get the parts ordered, assembled, and functioning in less than a week.

arduino picture sensor picture soldering the arduino

I even had the opportunity to learn to solder, as the accelerometer pins came separately from the board. I managed to get it connected and functioning in my first try!

While one of my teammates was mainly responsible for the software side of teh Arduino, I also helped with the mathematical/structural logic behind the C++ code: we kept track of how much position (in the accelerometer) and rotation (in the rotary encoder) deviated from the original neutral position, and scaled those values to work within the corresponding TouchDesigner ranges.

Prototype Video

This is footage of our functional, fully Arduino'd prototype, side by side with the live-reactive sound and art produced in TouchDesigner. Our logo design also came from a frame of the generative art.

Make sure your sound is up!

Reflection

Working with hardware was a delightful challenge! I enjoyed learning about the physicalities of design considerations, as well as some of the physics behind how the sensors we used function.

I also learned the importance of task delegation, time management, and communication. Some aspects of the design were more intense and time-consuming than others. Mine was not one of them, which meant I ended up waiting with nothing to do and no one to help. (I ended up just making the pitch/process deck.)

Overall, this project was a worthwhile endeavor both technically and creatively, allowing me a glimpse into physical product design and engineering.