Body as Interface
An interactive art installation developed for InKüLe/Room to Expand, exploring the body as a musical interface through motion tracking and generative audio synthesis. This project combines cutting-edge technology with artistic expression to create accessible interactive experiences for artists from dance and fine arts departments.
Body as Interface transforms human movement into musical expression, allowing participants to become both performers and composers through their physical gestures. The system creates a bridge between traditional artistic disciplines and emerging technologies, democratizing access to interactive art creation.
Project Overview
The project began with the development of an “Airdrum” concept—an interactive drumming interface controlled via Microsoft Kinect motion tracking. The system was built using TouchDesigner and VCV Rack, combining real-time motion tracking with generative audio synthesis to create responsive, immersive experiences.
The goal was to present an accessible example for artists from dance and fine arts departments, demonstrating how technology can enhance rather than replace traditional artistic expression. The system enables users to create music through movement, making the body itself the interface for artistic creation.
Technical Implementation
The core of the system lies in the interconnection between TouchDesigner and VCV Rack for generative sound synthesis over OSC (Open Sound Control) on two computers in real-time. This architecture allows for:
- Real-time motion tracking via Microsoft Kinect
- Generative audio synthesis through VCV Rack’s modular environment
- Visual feedback and projection mapping via TouchDesigner
- Low-latency communication between systems using OSC protocol
The technical setup enables participants to see their movements translated into both visual and auditory responses, creating a complete sensory experience that blurs the line between performer and audience.
Exhibition & Impact
The second iteration of Body as Interface was exhibited during LNDW 2025 at the NewPractice studio, demonstrating the project’s evolution from concept to public presentation. The exhibition showcased:
- Live demonstrations with audience participation
- Workshop sessions introducing the technology to new users
- Interactive performances highlighting the system’s artistic potential
- Documentation of the creative process and technical development
The project successfully bridged the gap between technical innovation and artistic accessibility, providing artists with new tools for creative expression while maintaining the human element at the center of the experience.
Technical Details
Technologies Used:
- Microsoft Kinect (motion tracking)
- TouchDesigner (visual programming)
- VCV Rack (modular synthesis)
- OSC (Open Sound Control) protocol
- Real-time audio processing
Duration: 2024-2025 Team: InKüLe/Room to Expand Role: Technical Development & Artistic Direction
Outcomes & Impact
Body as Interface successfully demonstrated the potential for technology to enhance rather than replace human artistic expression. The project:
- Democratized access to interactive art technology
- Bridged disciplines between dance, fine arts, and technology
- Created new possibilities for audience engagement
- Established a framework for future interactive installations
The system’s success in making complex technology accessible to artists from diverse backgrounds highlights the importance of user-centered design in artistic technology development.
Reflection
This project reinforced the importance of creating technology that serves artistic expression rather than dominating it. The challenge of making complex systems accessible while maintaining their creative potential led to innovative solutions in user interface design and system architecture.
Future iterations could explore:
- Integration with multiple performers simultaneously
- Expanded gesture recognition capabilities
- Connection to other artistic disciplines
- Remote collaboration possibilities
The project continues to influence my approach to interactive art, emphasizing the human element in technological innovation.