Tag: audio

MIDI FX – Node based MIDI Effects Processor – Daniel Fernandes – ADCx India 2025

https://audio.dev/ -- @audiodevcon​
---

MIDI FX - Node based MIDI Effects Processor - Daniel Fernandes - ADCx India 2025
---

MIDI FX is a free and open-source MIDI effects processor which lets users build their own effects by freely connecting effect nodes together. It includes simple nodes for changing properties of a MIDI message, such as the note number or velocity; and also more interesting features like viewing the name of the chord you're playing, visualizing Continuous Controller values as they change, and practice playing randomized chords.

Since MIDI FX runs in the browser, it can use browser APIs to, for example, allow wireless MIDI communication between devices via WebRTC or convert an Arduino’s serial output into MIDI messages, which is very handy for DIY MIDI instruments. This, paired with its flexible design, allows users to create custom MIDI setups that are tailored to meet their needs.
---

Slides: https://data.audio.dev/talks/ADCxIndia/2025/midi-fx-node-based-midi-effects-processor/slides.pptx
---

Daniel Fernandes

Daniel Fernandes picked up music production in his early teen years. His curiosity about the tools and plugins he'd use got him interested in audio development. In 2024, Daniel was accepted into Google Summer of Code with Mixxx DJ, where he contributed to its Harmonic Mixing features. Daniel is excited to keep exploring the intersection of music and technology.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCx India Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#midi #adc #audiodev #dsp #audio #audioprocessing #audioproduction #audioprogramming #sound #music #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

The Curious Case of Subnormals in Audio Code – Attila Haraszti – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

The Curious Case of Subnormals in Audio Code - Attila Haraszti - ADC 2024
---

Floating-point subnormals have long presented an interesting edge case in digital signal processing that can cause severe performance hits, particularly when dealing with decaying infinite impulse response (IIR) filters. Most audio applications therefore opt to set flush-to-zero (FTZ) and denormals-are-zero (DAZ) CPU control register flags in their workflows.

The talk will chart an exploratory journey prompted by failing platform tests for web audio and an ancient ECMAScript forum thread, leading the author to investigate the current situation and impact on common devices.

Are subnormals still a problem for floating-point arithmetic in 2024? Is there a difference between native and web targets? What does the future hold for fast math and cross-platform audio code?
---

Slides: https://data.audio.dev/talks/2024/the-curious-case-of-subnormals-in-audio-code/slides.pdf
---

Attila Haraszti

Attila Haraszti / h̷a̷y̷w̷i̷r̷e̷z̶ is a veteran dance music producer and independent software professional specializing in networked media applications. He is currently developing Songsling, a web-based creation and publishing suite for interactive music and audio.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#digitalsignalprocessing #adc #audiodev #dsp #audio #audioprocessing #audioproduction #audioprogramming #sound #music #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Quality Audio for Low Cost Embedded Products – An Exploration Using Audio Codec ICs – ADCx India 2025

https://audio.dev/ -- @audiodevcon​
---

Quality Audio for Low Cost Embedded Products - An Exploration Using Audio Codec ICs - Shree Kumar, Atharva Upadhye - ADCx India 2025
---

Designing a decent quality audio solution at a low cost is an important challenge in embedded systems. This is made tricky as the bar for audio quality is set pretty high by everyday consumer products, which rely on highly integrated solutions. Consumer solutions achieve low cost, but that comes with the requirement of high volumes production. Embedded products typically do not scale to such volumes, which is what makes this a challenge.

With microcontroller based solutions, narrowing down the proper choice of components is an iterative process, especially for teams that have not dealt with audio at the lowest levels. The last mile cost optimization can be non-obvious, needing to push things down to clocking architecture.

In this talk, we will walk through a few audio solutions we investigated using audio codec ICs, with various cost/quality tradeoffs: Cirrus Logic WM8758, Princeton Tech PT8211, finally settling on Everest Semiconductor ES8388. The base hardware board is based on the Raspberry Pi RP2040 microcontroller, making good use of the PIO peripheral. We will cover essentials such as the I2S interface (master/slave), and codec configuration. We will also explain the clocking architecture (and software implementation) that eliminates the discrete crystal sometimes required for the codec, achieving the lowest cost per board.
---

Slides: https://data.audio.dev/talks/ADCxIndia/2025/quality-audio-for-low-cost-embedded-products/slides.pdf
---

Shree Kumar

Shree is an embedded software engineer, and an independent consultant, with over two decades of experience across many layers of the system software stack. He headed the software team that designed India's first 3G tablet. Some of his early significant work was in High Performance Computing (HPC) visualization, winning awards at SuperComputing 2007 (SC '07) conference. He also created KitePhone, the world's first DIY 3D printable Android smartphone concept. Shree enjoys long walks and longer bicycle tours. Recently, he has been spending time looking at government policies, especially related to semiconductors.
---

Atharva Upadhye

Atharva is an accidental engineer with a background in sports. He has always wanted to work on hardware stuff. He is currently serving time at Samsung Semiconductors, working on SSDs.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCx India Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #embedded #codec #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Elliptic BLEP – High-Quality Zero-Latency Anti-Aliasing – Geraint Luff – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Elliptic BLEP - High-Quality Zero-Latency Anti-Aliasing - Geraint Luff - ADC 2024
---

BLIT/BLEP/BLAMPs are a useful tool to reduce aliasing in basic waveforms, nonlinearities, and hard-sync synthesis. There are many variations, but most of them require some lookahead and bookkeeping to work properly.

We start by looking at where aliasing comes from in these situations, how BLEP and friends can help, and the compromises of some common variations.

We'll then introduce a new IIR-based approach based on Holters-Parker resampling. This approach has a simple zero-latency implementation, and has extremely good aliasing-reduction based on elliptic filters.

An implementation will also be released as a zero-dependency open-source C++ library (single-file header). This can also be used as an arbitrary-rate resampler for modulated delay lines and sample playback.
---

Resources: https://github.com/Signalsmith-Audio/elliptic-blep/
---

Geraint Luff

I run Signalsmith Audio, a small audio/DSP consultancy based in the UK.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #digitalsignalprocessing #audioprocessing #audioprogramming #cpp #cppprogramming #soundtech #audiotech #audiotechnology #antialiasing #zerolatency

Filed under: UncategorizedTagged with: , , ,

Advancing Music Source Separation for Indian Classical and Semi-Classical Cinema Compositions – ADCx India 2025

https://audio.dev/ -- @audiodevcon​
---

Advancing Music Source Separation for Indian Classical and Semi-Classical Cinema Compositions - Dr. Balamurugan Varadarajan, Pawan G & Dhayanithi Arumugam - ADCx India 2025
---

Indian cinema music is a unique fusion of classical and semi-classical elements, featuring intricate melodies, diverse instrumentation, and overlapping tones that often present challenges for source separation. Traditional source separation models, primarily trained on Western music, fail to handle the tonal overlap and instrumental bleed characteristic of Indian cinema. To address this, our team evaluates existing models, including Spleeter and Hybrid Demucs, and identifies Spleeter as the optimal solution due to its efficient U-Net-based spectrogram architecture.

Prior research has shown that retraining Spleeter on Carnatic music significantly enhances its performance, improving the Source-to-Distortion Ratio (SDR) compared to baseline models. Building on this, we propose fine-tuning Spleeter on a specialized dataset of classical and semi-classical multi-tracks, specifically tailored to the nuances of Indian cinema. This method enables the model to better capture the unique characteristics of Indian music, such as tonal overlap between instruments like the violin and vocals, and instrumental bleed from pitched percussion like the Mridangam.

The objective is to develop a specialized source separation tool capable of enhancing workflows for composers, music directors, and analysts in Indian cinema. By integrating this tool into digital audio workstations (DAWs), this project aims to elevate music production and research, offering a more accurate and perceptually refined separation process. This work sets the stage for more precise musicological analysis and creative experimentation in Indian cinema music, marking a significant step forward in the integration of AI with traditional music practices.
---

Slides: https://data.audio.dev/talks/ADCxIndia/2025/advancing-music-source-separation-for-indian-classical-and-semi-classical-cinema-compositions/slides.pptx
---

Dr. Balamurugan Varadarajan

Disrupting industrial problems and humanizing technology with AI, AI engineer with extensive experience in both research and product development. Specialize in cross-domain knowledge to contribute to AI technologies for scientific and industrial data as an essential member of an innovative firm. Having worked on the creation and testing of AI solutions for more than a 8 years. Possess an unbridled passion for Artificial Intelligence with comprehensive knowledge of machine learning concepts and other related technologies. Unmatched abilities to identify, understand, and translate program requirements into sustainable, advanced technical solutions through continuous improvement of Al technologies.

Pawan G
---

Dhayanithi Arumugam
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCx India Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#indianclassicalmusic #indiancinema #adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

PANEL: Auditory and Cognitive Neuroscience and the State of Audio Technology – Rebekah Wilson, Susan Rogers, Micha Heilbron & Ryszard Auksztulewicz – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Auditory and Cognitive Neuroscience and the State of Audio Technology - A Multi-Disciplinary Panel Discussion - Rebekah Wilson, Susan Rogers, Micha Heilbron & Ryszard Auksztulewicz - ADC 2024
---

As Dr Susan Rogers says, auditory science and brain science attract similar kinds of thinkers — those who are ok with imagining the mechanism and process. One of the most fascinating areas of neuroscience is the emerging theoretical framework known as ‘predictive processing’ which describes the brain as essentially a prediction machine which is a combination of ideas from psychology or neuroscience, machine learning and information theory. Fundamentally, every technology we develop in the audio industry is an interface with the brain. In recent years, advances in understanding how the brain works give us opportunities to discover novel approaches to audio interfaces, which should lead to the design of new products. This session will inform us better, as audio technology developers, about what kinds of tools can we develop that harness the brain’s abilities to advance the fields of music technology, audio engineering, live sound, music education and more.

Speaking is Dr Susan Rogers herself, sound engineer for Prince in the 1980s; with a doctorate in pyschology and a focus on music cognition and psychoacoustics, she is currently associate professor in the Music Production and Engineering and Liberal Arts departments at Berklee College of Music. We also welcome Dr Micha Heilbron who works is at the intersection of cognitive science and AI and is assistant professor in cognitive AI and computational cognitive (neuro)science at the University of Amsterdam. We are joined by cognitive computational neuroscientist Dr Ryszard Auksztulewicz whose is interested in prediction, memory, learning, attention, and their disorders. Hosted by Rebekah Wilson whose background as composer, software and networking programmer, and technology researcher saw her merge those passions when co-creating the industry standard in audio remote-recording software: Source-Connect

Indicative themes include:

Prediction
Signal processing
Compression
Generative models
Music preference

The format will be a panel with an in-person moderator with the online experts in their expansive fields including auditory and cognitive neuroscience, psychoacoustics, AI and ML, and music and sensory processing.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #cognitiveneuroscience #audio #neuroscience #neuroscienceinsights #audioprocessing #audioengineering #audioprogramming #audioengineer #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Workshop: Designing & Developing an AVB/Milan-Compliant Audio Network Endpoint – Fabian Braun – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Workshop: Designing and Developing an AVB/Milan-Compliant Audio Network Endpoint - Fabian Braun - ADC 2024
---

In this hands-on workshop, participants will learn how to design and develop an AVB/Milan-compliant audio network endpoint using the Panda-Board reference design. The session is divided into two sections: hardware and software. In the hardware section, participants will explore key components such as the PLL for clock recovery (Cirrus Logic CS2100CP), audio codecs (CS4272), and I/O interfaces (XLR, I2S, SPDIF). The software section will focus on configuring and deploying real-time audio streaming over a network. To demonstrate AVB/Milan protocol implementation practically, participants will work with lib_joyned, a collection of libraries that includes time-sensitive networking, I2S drivers, and an Ethernet stack, alongside the XMOS toolchain, offering insights into AVB/Milan systems.

Learning Outcomes:

- Understanding AVB/Milan and Audio Networking: Learn the fundamental principles behind AVB/Milan protocols and their critical role in achieving synchronized, real-time audio networking.

- Hardware Design for Audio Endpoints: Understand how to design an endpoint using key components like the Cirrus Logic CS2100CP for clock recovery, the CS4272 audio codec, and various I/O interfaces.

- Software Development: Gain practical experience with the XMOS toolchain and lib_joyned libraries to configure and implement AVB/Milan-compliant endpoints.

- Deploying Real-Time Audio Streaming: Develop software that facilitates low-latency, synchronized audio transmission over a network.

- Testing and Debugging: Use professional tools like Wireshark to monitor and validate the performance of AVB/Milan endpoints in real-world applications.

Workshop Requirements:

- Basic C Programming Knowledge: Familiarity with C programming is recommended, as participants will be working with the XMOS toolchain during the workshop.

- Understanding of Embedded Systems: A basic knowledge of embedded systems and microcontrollers will aid in comprehending hardware-related tasks.
---

Slides: http://data.audio.dev/workshops/2024/designing-and-developing-an-avbmilan-compliant-audio-network-endpoint/slides.pdf
---

Fabian Braun

Fabian Braun, CEO and Founder of JOYNED, is an experienced Embedded System Design Engineer with a strong background in developing scalable and interoperable audio network solutions. Formerly with d&b audiotechnik, he has played an active role in the Avnu Alliance, helping define the Milan specification and advocating for open standards like AVB/Milan, AES67, and AES70. Braun founded JOYNED to democratize network technology with accessible and affordable solutions for the audio industry.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#cprogramming #adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #sound #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Mind-Matched Audio – Revolutionizing the Reading Experience through Real-Time Sound Synchronization

https://audio.dev/ -- @audiodevcon​
---

Mind-Matched Audio - Revolutionizing the Reading Experience through Real-Time Sound Synchronization - Luigi Cosi - ADC 2024
---

Step into the future of digital reading, where sound and text intertwine to transform stories into an immersive auditory adventure. This talk explores how synchronizing audio with the cognitive reading process creates a revolutionary experience. We leverage eye-tracking technology, sophisticated algorithms, and real-time audio processing to determine the optimal timing for soundscapes that synchronize with the reader's imagination, enhancing engagement. Learn about our journey of inventing a digital audio workstation (DAW) tailored specifically for the reading experience—something that previously did not exist. This foundational DAW lays the groundwork for how such a tool would look like for this purpose, allowing audio to be triggered dynamically based on the reader's pace and imagination, overcoming challenges in audio production, from creating flexible assets to ensuring continuity for non-linear reading. Our experiments show how well-timed audio cues can reduce gaze duration by 63%, enhancing both speed and comprehension. We’ll also explore future possibilities using machine learning to generate adaptive soundscapes. Join us for a live demonstration and discover how this innovation could transform reading, opening new possibilities for e-books, journalism, and beyond.
---

Luigi Cosi

Luigi Cosi is the founder and CEO of OIKLA, where he focuses on creating innovative audio technology that blends high-quality sound with hearing safety. With a background in sound engineering and a personal experience with tinnitus, Luigi developed a passion for making audio experiences that are both immersive and safe. He led the development of OIKLA's patented audio processing technology, designed to deliver balanced sound at any volume. His practical approach and dedication have helped OIKLA gain recognition in the industry, including a successful showcase at CES 2024 and partnerships with leading audio brands​​​​.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCxGather Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#digitalreading #audiosync #daw #adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

Engineering Success for Audio Software in a Crowded Market – Randy Young – ADC 2024

https://audio.dev/ -- @audiodevcon​
---

Engineering Success for Audio Software in a Crowded Market - What Can McDonald's Teach Us About Selling Audio Plugins - Randy Young - ADC 2024
---

In today's saturated audio technology market, standing out is crucial. This presentation offers developers and entrepreneurs current successful strategies to amplify their market presence, increasing the odds of success. Through examples and industry insights, attendees will gain actionable strategies for positioning audio products effectively, from niche applications to mainstream markets. This talk bridges technical innovation and market success, providing a roadmap for transforming audio technology into must-have products.
---

Slides: https://data.audio.dev/talks/2024/engineering-success-for-audio-software-in-a-crowded-market/slides.pdf
---

Randy Young

With over 20 years of experience and 3,500 live shows as part of the indie band Cherry Suede, Randy Young learned early how to stand out in crowded markets. While many musicians were chasing major record deals, Randy was pioneering live streaming, crowdfunding, and fan communities—well ahead of social media’s rise. Later, he brought these innovative strategies to the pro audio software industry, helping developers bridge the gap between technical excellence and market success. His work with Denmark’s Relab Development has driven 40-50% year-over-year growth, double that in 2024, by tackling the critical marketing challenges of a crowded others often overlook.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#audiosoftware #audioplugins #adc #audiodev #marketingdigital #audio #conferenceaudio #audiomarketing #audioproduction #marketingstrategy #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,

GPU Based Audio Processing Platform with AI Audio Effects – Simon Schneider – ADCxGather 2024

https://audio.dev/ -- @audiodevcon​
---

GPU Based Audio Processing Platform with AI Audio Effects - Are GPUs ready for real-time processing in live sound engineering? - Simon Schneider - ADCxGather 2024
---

Parallelising real-time audio effects requires complex task management and synchronisation. GPUs are optimised for parallel processing while still retaining flexible scheduling comparable to a CPU. As a result, it combines the strengths of both DSPs and CPUs in a single device. In addition, recent trends advocate using AI audio processing algorithms, which work best on GPU architectures.

This thesis presents an implementation of an embedded GPU-based audio processing framework on an Nvidia Jetson hardware platform. It can combine neural network inference and other audio effects into signal graphs that process within periods as small as 32 frames (0.667ms).

The signal graph does not restrict the number and combination of parallel and serial audio effects as long as the real-time limit is met. Therefore, the framework has been tested on large numbers of parallel channels, as found in a mixing console, and complex routing options available in high-end audio effect processors, such as the Neural DSP Quad Cortex.

Launching GPU work using the CUDA graph API produces better stability and performance than was observed using the CUDA stream API in a 2017 study. Processing a signal graph that fully utilises the Jetson's resources by mimicking a 64-channel mixing console on a 128-frame (2.67ms) period has a higher than 99% success rate. However, occasional stalling on the GPU can produce worst-case execution times of up to 20ms, regardless of the loaded audio effects. As a result, the framework can not yet be classified as real-time capable.
Further study of the CUDA scheduler and improvements to the operating system and audio driver may be able to achieve real-time capability in the future.
---

Simon Schneider

Simon is a musician based in Winterthur. After completing his Bachelor's Degree in IT he realized that he could combine his passion for music and software engineering in audio development. As a result, he went on to complete a Master's Degree in Electrical Engineering to learn about signal processing and hardware programming. During this time he was working part-time in the ZHAW Institute of Embedded Systems. There he developed an audio effects processing platform on an Nvidia Jetson GPU as part of his Master Thesis.

His bandmates will say, that playing the guitar is just an excuse to justify all the money he spends on music-related gear. While this is not entirely untrue, Simon is the type of programmer who spends days automating or streamlining a repetitive process that takes minutes to complete manually.
As a result, automating guitar effect changes or building a wireless InEar monitoring rack for shorter live show setup and teardown times simply requires a lot of gear.

Furthermore, Simon has a flair for modular and customizable software architecture. Since audio gear often lacks both of these qualities, he endeavours to make them a primary focus in all his audio development projects.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon

https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCxGather Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#audioprocessing #gpu #ai #adc #audiodev #dsp #audio #conferenceaudio #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , , ,