https://audio.dev/ -- @audiodevcon​
---

Reshaping the Voice - Real-Time Neural Audio Effect - Anders Bargum - ADCx Copenhagen 2026
---

In this presentation, Anders Bargum introduces Reshaping the Voice, a real-time neural audio effect designed for voice conversion and speech modification. Voice conversion involves altering a speaker's vocal identity while keeping the underlying words and linguistic content intact. While state-of-the-art voice generation models achieve highly realistic results, they are heavily constrained by high parameter counts, non-causal processing, and high latency, making them unusable for live applications such as digital audio workstations (DAWs) or interactive virtual environments.

To overcome these limitations, the project combines speech representation learning with musical timbre transfer. By utilizing feature disentanglement, the model disassembles input audio into independent streams representing vocal identity (timbre), linguistics (phonetic units), loudness, and pitch. These features can then be individually manipulated, enabling real-time identity swapping, pitch shifting, and even the generation of multi-part vocal choirs from a single monophonic input.

The technical implementation leverages a streamable pipeline trained in PyTorch and exported via TorchScript to run efficiently inside a C++ framework hosted by JUCE. By implementing causal convolutions and state caching rather than relying on future-sample lookaheads, the system achieves incredibly low latency. Anders demonstrates practical deployment of this technology, showcasing a fully functioning VST plugin and an integration within the Unity game engine for designing real-time voices for 3D avatars in virtual reality.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC Team:

Bence Kovacs
Martin Swanholm
Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #sound #music #musictech #soundtech #audiotech #audiotechnology