Generative Picture-to-Audio Mapping System
Project Overview
DrawTone is an interactive and generative creative coding project by Dave Kronawitter and me. Through this project we explored the intersection of gestural drawing and real-time sound synthesis. By capturing visual trajectories and translating them into spectral data, the system allows users to „play“ an instrument through intuitive graphic input.
The project focuses on the translation of geometric properties—such as line height, curvature, and density—into synthesis parameters like frequency, amplitude, and timbral modulation. It serves as an experimental bridge between visual arts and algorithmic composition.
Technical Features
- Real-time Synthesis: Direct mapping of XY-coordinates to spectral oscillators.
- Algorithmic Translation: Implementation of custom logic to interpret visual speed and pressure.
- Modular Architecture: Designed for easy integration with external MIDI and OSC-controlled environments.
Tech Stack
- Image Recognition: Python with the OpenCV-framework
- Sound Engine: PureData
- Communication: Open Sound Control (OSC)