Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon
DDSP-VST: Neural Synthesis for All - Nikhil Bhanu & Wilson Zhao - ADCx SF
We present DDSP-VST, a cross-platform audio plugin for real-time neural audio synthesis built using TensorFlow Lite and JUCE. DDSP is the underlying ML research behind this project that lets you combine the interpretable structure of classical DSP elements such as filters, oscillators, reverberation etc. with the expressivity of deep learning. This technology enables us to transform a given audio signal into any musical instrument by extracting the pitch and loudness and using those features for synthesis. In this talk we will discuss the technical and UX challenges of building an audio plugin powered by machine learning and making it accessible to musicians and artists.
_
Nikhil Bhanu
Audio software generalist with a passion for real-time systems, signal processing, musical interfaces and machine learning.
Wilson Zhao
Electronic music enthusiast + event organizer. Passionate about combining multimodal generative AI + creativity.
Edited by Digital Medium Ltd - online.digital-medium.co.uk
_
Organized and produced by JUCE: https://juce.com/
_
Special thanks to the ADC Team:
Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
#audiodevcon #audiodev #vst
