Obsidian Neural is a novel, open-source VST3 plugin that addresses the technical challenges of integrating generative AI models directly into a low-latency digital audio workstation (DAW) environment. This workshop will provide a deep dive into the architecture designed to use AI as a real-time performance instrument. We will cover the C++/DSP strategies necessary for minimizing latency during the asynchronous generation of audio loops via models like Stable Audio Open. Crucially, we will detail the system's ability to maintain musical coherence during a live mix, achieved through an internal LLM "Brain" that processes contextual session data (BPM, key, existing tracks) to enrich generation prompts. Furthermore, we will explore the technical solutions implemented for seamless integration with the live mixing paradigm: quantized MIDI triggering, multi-output routing, and the novel "Draw-to-Sound" feature, which employs a Vision Language Model (VLM) to translate visual input into musical parameters. This work demonstrates a robust framework for generative AI to function as an instantaneous, adaptable partner within professional audio engineering workflows.
Friday May 29, 2026 11:00am - 12:00pm CEST Building 302, 2nd floorTechnical University of Denmark Asmussens Alle, Building 302 DK-2800 Kgs. Lyngby Denmark