DuoRhythmo

A collaborative musical experience for people living with ALS, played with eye-tracking

DuoRhythmo's circular sequencer on an eye-tracking tablet mounted to a wheelchair.
Company
Microsoft Research
Role
Leading interaction design
Years
2022
Scope
User research, Interaction design, Visual design

We created DuoRhythmo, a collaborative musical experience for people living with ALS. Focusing on eye-tracking as an input, we designed the interface to be inclusive from the get-go and continuously iterated on it together with members of the ALS community, their caretakers and other stakeholders. My role was leading the interaction design in our team.

The project started as my Bachelor thesis in collaboration with Microsoft Research, and I kept coming back to it, first during my Master’s, then as a side project. It’s available in the Microsoft Store.

usability rating from people with ALS after the final testing
79.5 / 100
paper presented in Hamburg
CHI 2023

Why

As ALS progresses, people gradually lose their skills, and often they don’t have tools for self-expression. Many people living with ALS (PALS) used to be professional musicians and can’t share the joy of musical co-creation anymore. Through interviews with the ALS community we learnt that as their condition progresses, they engage less in social activities.

Our goal was to enable people with ALS to connect online through the power of music, to fight loneliness and depression, without needing any prior musical expertise.

Design

Collaboration metaphor. We took inspiration from the Dato Duo synth and came up with a spatial carousel between the two players. One player places beats on a sequencer, while the other modulates the beats with different effects at the same time. After a certain time the carousel rotates and the roles are swapped.

Diagram of two players facing each other across a ring of sequencer and effect panels.

Radial UI. From the beginning we decided to design a radial UI with a resting position in the middle. This way we could minimise the time and effort to select UI elements with an eye-tracker, in accordance with Fitts’s Law.

Pencil sketches of the carousel and circular interface ideas.
A wireframe of the sequencer as concentric rings of circular steps.
Initial sketches and an early wireframe.

Grid for eye-tracking. We built the interface on squares of 128×128 pixels, as the minimum target size for eye-trackers is 100×100. Eye-trackers tend to work less accurately towards the edges of the screen, so we kept the middle for the most important interactions and the sides for system control.

The sequencer interface with the square layout grid overlaid in red.

Modular input system. Through a lot of interviews with the ALS community we found out that we needed a modular input system which follows the progression of ALS.

Accessible colour palette. The colours were carefully chosen not to fatigue our users’ eyes: a palette of pastel red, green, yellow, orange and light blue with low radiance.

Testing

We evaluated DuoRhythmo in multiple steps and improved it iteratively based on the results, using both qualitative and quantitative methods.

With able-bodied participants it scored 63.8 / 100 on the System Usability Scale, and we A/B tested two slider designs and two input methods. With some adjustments, we improved the usability benchmark to 79.5 in the final testing with PALS.

“Fun, empowering, accessible, easy to use, engaging, stimulating” were the most common words PALS picked from the reaction cards. They also reported high-level empathy towards the other player, no negative feelings and active involvement during the jam sessions.

Two wheelchair users playing DuoRhythmo on eye-tracking screens, with two researchers alongside.

Impact

DuoRhythmo still rocks, and PALS can just jam together whenever they want. Since the soft release we have some constant happy users. We also published articles, got featured on blogs, and I spoke at multiple conferences sharing our journey:

Balázs presenting DuoRhythmo on stage at CHI 2023.