Tag: GPU

Symphony of a Thousand – GPU Synthesis With Massively Parallel Oscillators – Cecill Etheredge – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Symphony of a Thousand - GPU Synthesis With Massively Parallel Oscillators - Cecill Etheredge - ADC 2024
---

In the last few years, there has been an increasing interest in GPU DSP research. While the GPU brings highly parallel processing to the mix, the problems in implementing the real-time requirements and data flow of a GPU audio pipeline are well known. There are other challenges that stand out, such as the complexities of running GPU apps on consumer hardware, as well as identifying "killer apps" for GPU audio: desirable use cases where the GPU really shines and outclasses a classical CPU implementation for the everyday musician.

The aim of this talk is to cover the design, implementation, tradeoffs and compromises needed to build and run a basic GPU synthesizer on consumer hardware. This talk will be hands-on and suitable for audio developers that are relatively fresh to GPU applications in particular. We will present an algorithm implemented in NVIDIA CUDA that is based on straightforward wavetable synthesis and leverages the GPU's parallelism to outclass an equivalent CPU implementation. We will show how to integrate this algorithm and its CUDA kernels with JUCE to create a proof-of-concept synthesizer app.

The usual real-time challenges such as CPU-GPU copying, latency and buffering are addressed, and more hands-on issues such as interopability with 3D graphics running on the same GPU as well as real-time scheduling and persistent kernels will be covered as well as needed.

We purposely target lower-end hardware to explore the feasibility of a GPU synthesizer on consumer hardware, and to possibly enable a path towards a more extensive standalone "GPU hardware synthesizer" in the future.
---

Slides: https://data.audio.dev/talks/2024/symphony-of-a-thousand/slides.pdf
---

Cecill Etheredge

In daily life, Cecill serves as the Technical Director of KoalaDSP, a European startup focused on whitelabel DSP, middleware and audio plugin development for major industry players. In the remaining hours, Cecill channels his engineering skills and artistic flair into tackling challenging and complex problems, driven by a classic hacker ethos and curiosity. With a lifelong passion for technology and music, and over 20 years of experience in areas involving hardware, games, graphics, audio and algorithms, Cecill is still on a never-ending journey to learn, to create impactful innovations, and to share the lessons learned with others.

Cecill's experience with GPGPU began in 2008 during the early days of NVIDIA CUDA and Cg with the development of custom graphics rasterization and voxel raytracing algorithms at the University of Twente. This led to a more prominent role in researching and creating mass-spring physics algorithms in CUDA for medical systems with sub-millisecond real-time haptics. The drive to explore new uses for GPGPU has never left ever since. Today, with GPGPU technology more relevant than ever, the integration of GPGPU and audio has become particularly significant and personally relevant.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #gpu #dsp #nvidia #audio #juce #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Workshop: GPU-Powered Neural Audio – High-Performance Inference for Real-Time Sound Processing – Alexander Talashov & Alexander Prokopchuk – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Workshop: GPU-Powered Neural Audio - High-Performance Inference for Real-Time Sound Processing - Alexander Talashov & Alexander Prokopchuk - ADC 2024
---

Join our GPU AUDIO workshop where you'll dive into the exciting world of neural networks applied to real-time audio processing.

In this hands-on workshop, you’ll work with Neural Amp Modeler, an open-source project that uses deep learning techniques to replicate guitar amplifiers and pedals with state-of-the-art accuracy. You will learn how to port and scale the Neural Amp Modeler plugin to the GPU using GPU AUDIO technology stack.

With a focus on low-latency, parallel execution, and flexibility, you'll combine different neural building blocks to create high-performance audio models. Whether you're a neural network enthusiast or a DSP pro, this session will showcase how easily scalable models can be built with our specialized GPU neural building blocks.

Throughout the workshop, you'll work within a Jupyter environment, building and testing various versions of the Neural Amp Modeler.

After the session, you’ll gain access to the workshop’s codebase and environment, allowing you to set it up on your own machine and continue experimenting with real-time, low-latency audio processing.

Whether you're working with NVIDIA, AMD, or Mac (M-Silicon) platforms, this session serves as an exclusive sneak peek into our broader release of GPU-powered neural building blocks, unlocking the potential for real-time, scalable, low-latency audio processing like never before.
---

Slides: https://data.audio.dev/talks/2024/gpu-powered-neural-audio-workshop/slides.pdf
---

Alexander Talashov

Alexander Prokopchuk
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #gpu #audioprocessing #audioproduction #audioprogramming #neuralampmodeler #neuralnetworks #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

GPU Based Audio Processing Platform with AI Audio Effects – Simon Schneider – ADCxGather 2024

https://audio.dev/ -- @audiodevcon​
---

GPU Based Audio Processing Platform with AI Audio Effects - Are GPUs ready for real-time processing in live sound engineering? - Simon Schneider - ADCxGather 2024
---

Parallelising real-time audio effects requires complex task management and synchronisation. GPUs are optimised for parallel processing while still retaining flexible scheduling comparable to a CPU. As a result, it combines the strengths of both DSPs and CPUs in a single device. In addition, recent trends advocate using AI audio processing algorithms, which work best on GPU architectures.

This thesis presents an implementation of an embedded GPU-based audio processing framework on an Nvidia Jetson hardware platform. It can combine neural network inference and other audio effects into signal graphs that process within periods as small as 32 frames (0.667ms).

The signal graph does not restrict the number and combination of parallel and serial audio effects as long as the real-time limit is met. Therefore, the framework has been tested on large numbers of parallel channels, as found in a mixing console, and complex routing options available in high-end audio effect processors, such as the Neural DSP Quad Cortex.

Launching GPU work using the CUDA graph API produces better stability and performance than was observed using the CUDA stream API in a 2017 study. Processing a signal graph that fully utilises the Jetson's resources by mimicking a 64-channel mixing console on a 128-frame (2.67ms) period has a higher than 99% success rate. However, occasional stalling on the GPU can produce worst-case execution times of up to 20ms, regardless of the loaded audio effects. As a result, the framework can not yet be classified as real-time capable.
Further study of the CUDA scheduler and improvements to the operating system and audio driver may be able to achieve real-time capability in the future.
---

Simon Schneider

Simon is a musician based in Winterthur. After completing his Bachelor's Degree in IT he realized that he could combine his passion for music and software engineering in audio development. As a result, he went on to complete a Master's Degree in Electrical Engineering to learn about signal processing and hardware programming. During this time he was working part-time in the ZHAW Institute of Embedded Systems. There he developed an audio effects processing platform on an Nvidia Jetson GPU as part of his Master Thesis.

His bandmates will say, that playing the guitar is just an excuse to justify all the money he spends on music-related gear. While this is not entirely untrue, Simon is the type of programmer who spends days automating or streamlining a repetitive process that takes minutes to complete manually.
As a result, automating guitar effect changes or building a wireless InEar monitoring rack for shorter live show setup and teardown times simply requires a lot of gear.

Furthermore, Simon has a flair for modular and customizable software architecture. Since audio gear often lacks both of these qualities, he endeavours to make them a primary focus in all his audio development projects.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCxGather Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#audioprocessing #gpu #ai #adc #audiodev #dsp #audio #conferenceaudio #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , , ,