Tag: programming

Deep Learning for DSP Engineers: Challenges & Tricks for Audio AI – Franco Caspe & Andrea Martelloni

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​

Deep Learning for DSP Engineers: Challenges and Tricks for Audio AI - Franco Caspe & Andrea Martelloni - ADC23

This talk aims to tackle and demystify the process of the development of an AI-based musical instrument, audio tool or effect. We want to view this process not from the point of view of technical frameworks and technical challenges, but from that of the design process, the knowledge required and the learning curve needed to be productive with AI tools; particularly if one approaches AI from an audio DSP background, which was our situation when we started out.

We are going to quickly survey the current applications of AI for real-time music making, and reflect on the challenges that we found, especially with current learning resources. We will then walk through the process of developing a real-time audio model based on deep learning, from dataset to deployment, highlighting the relevant aspects for those with a DSP background. Finally, we will describe how we applied that process to our own PhD projects, the HITar and the Bessel’s Trick.

Link to Slides:
_

Franco Caspe

I’m an electronic engineer, a maker, hobbyist musician and a PhD Student at the Artificial Intelligence and Music CDT at Queen Mary University of London. I have experience in development of real-time systems for applications such as communication, neural network inference, and DSP. I play guitar and I love sound design, so in my PhD I set out to find ways to bridge the gap that separates acoustic instruments and synthesizers, using AI as an analysis tool for capturing performance features present in the instruments’ audio, and as a generation tool for synthetic sound rendering.
_

Andrea Martelloni

Inventor of the HITar. Interested in applications of deep learning for rich real-time musical interaction and expressive digital musical instruments.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #ai #deeplearning

Filed under: UncategorizedTagged with: , , , ,

Exploration of Strongly-Typed Units: A Case-Study From Digital Audio – Roth Michaels – ADC23

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Exploration of Strongly-Typed Units: A Case-Study From Digital Audio - Roth Michaels - ADC 2023

API or math mistakes with units can cause problems ranging from a digital audio processing outputting silence to crashing your Mars rover—we’ll discuss real-life examples of both! The combination of user-defined types, conversion operators/constructors, and operator overloading in C++ give us the tools to use strong-types and avoid unit mistakes; std::chrono is a great example of this that everyone should be using. Unfortunately, when dealing with units beyond time many developers still use primitive types encoding units in variable names or comments because the standard does not offer any tools for user-defined units.

In this talk, we will look at the mp-units library which has been proposed for standardization in P1935 (A C++ Approach to Physical Units). We will look at the implementation of various units used in digital audio / DSP that go beyond “physical” units and what the experience is like to develop your own units with this library/proposal.
To close, we will look at things missing from P1935 that we as audio developers might need.
_

Roth Michaels

Roth Michaels is a Principal Software Engineer at Native Instruments, an industry leader in real-time audio software for music production and broadcast/film post-production. In his current role he is involved with software architecture and bringing together three merged engineering organizations and legacy codebases: Brainworx, iZotope, and Native Instruments. He also supports the Audio Research team to help accelerate moving research to productization and developing fast prototyping tools for product teams. Before merging with Native Instruments, when he joined iZotope, Roth was the lead library designer of a new internal cross-platform "Glass", part of which is now available as open-source. More recently in his former role as Mix/Master Software Architect, Roth helped develop the reference implementation to move iZotope's products to subscription and led the team that launched the company’s first SaaS offering for music producers. Roth studied music composition at Brandeis University and continued his studies in the Dartmouth Digital Musics program. Roth began his career in software development writing software for his own compositions, and the works of other composers and artists, and teaching MaxMSP to composers and musicians; both private instruction and designing university courses. Before joining iZotope, he was working as a consultant for small startups working on mobile applications specializing in location services and Bluetooth.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #cppprogramming #digitalaudio #audio #cpp

Filed under: UncategorizedTagged with: , , , ,

Implementation of an IIR Antiderivative Anti-Aliasing Wavetable Oscillator – Maxime Coutant – ADC23

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​

Implementation of an IIR Antiderivative Anti-Aliasing Wavetable Oscillator - Maxime Coutant - ADC 2023

Anti-aliasing is a crucial consideration for digital audio synthesis. Usually, for an oscillator, techniques like band-limited signals or oversampling are employed to mitigate this problem, but I investigated a method a bit more recent : Antiderivative Anti-Aliasing (ADAA). My search for a practical ADAA application in wavetable synthesis first yielded limited results. However, a paper titled "Antiderivative Antialiasing for Arbitrary Waveform Generation," published in August 2022, caught my attention.

The presentation will focus on three aspects:

• An Introduction to ADAA and the algorithm itself
• Insights into practical implementation and results
• Reflections on engaging with Academic Research

By the end of the talk the listener will know about the pros and cons of this technique and how and when to employ it. Furthermore, we will have illustrated some challenges of working with academic material as a software developer.

Link to Slides: https://docs.google.com/presentation/d/1mx8f7yxXMLxQ-pl3IcoqLkcZtQGd7z6gOidcQMAfxPc/edit
_

Maxime Coutant

I'm an audio software engineer in the ADASP group, part of the LTCI public laboratory. Audio enthusiast, hobbyist musician and software addict, I love to share, learn and meet new people! Here at ADC23 I'll present a project I spent many hours on during this last year, hoping to lower the bridge between research and engineering!
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #softwareengineering #digitalaudio

Filed under: UncategorizedTagged with: , , , ,

Three RADical Concepts in the Art of C++ Coding – Chris Nash – ADC23

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Three RADical Concepts in the Art of C++ Coding - Chris Nash - ADC 2023

What if MIDI was a programming language?
What if C++ had built-in audio semantics?
What if you could develop C++ plugins, live in the DAW?

This talk explores these ideas and the development of new technologies designed to blur the lines between music and code, for both artists and developers, and challenge traditional ways of thinking and working.

Drawing on concepts of flow, liveness, and rapid prototyping, the talk will present live demos, and discuss the development of:

Manhattan - a digital audio workstation and embeddable API built on a procedural music engine that integrates sequencing and programming. Used by artists, game composers, and in teaching computational thinking, example applications include crowd-driven music using machine vision, a Unity mini-game featuring a live (and somewhat mortal) orchestra, plus a growing library of famous works recomposed as code that shows the power of modelling music as both pattern and process.

Klang - an open C++ dialect (language extension) for audio, using modern language features (C++14/17) to extend the semantics of C++ to encapsulate audio, providing DSP primitives and types, and adapting the STL's concept of stream objects and operators to represent signals. Easier to read, more concise, and easily mapped to visual forms (block diagrams, Max), Klang feels like a new language (in the spirit of SOUL) but, as pure C++, retains the performance, portability, compatibility, and interoperability of the industry standard.

rapIDE - a C++ IDE inside a DAW plugin, designed for rapid audio prototyping and development of synthesisers and effects. Built on a full clang/LLVM-based toolchain, the plugin's source code can be live edited, rebuilt, reloaded and auditioned without restarting the DAW (or stopping playback). Compatible with C++ and Klang, rapIDE is designed to improve the accessibility, liveness, and immersion of audio programming, for applications in rapid prototyping and teaching, featuring realtime debugging, auto-complete, code sandboxing, and built-in audio analysis.

These technologies will support the new Music Systems Engineering (MuSE) degree programme, in development by Point Blank Music School in collaboration with industry, for launch in 2024.
_

Chris Nash

Chris Nash is a software developer, composer, educator and researcher in things that go beep in the night. Following a PhD on music software design at Cambridge, he has worked on technology and music projects across academia and industry, including for the BBC, Steinberg/Yamaha, and multiple start-ups, and independently develops and maintains several software projects, specialising in computer music and making music programming more accessible, including Manhattan (a hybrid DAW/programming language), Klang (a C++ dialect for audio), rapIDE (a plug-in based C++ IDE) and reViSiT (an award-winning plug-in based sound tracker). He is currently Senior Lecturer in Software Development for Audio, Sound, and Music at UWE Bristol, and recently founded nash.audio, a non-profit organisation supporting creativity and learning in music technology. Working with London-based Point Blank Music School, Dr Nash is the architect of the forthcoming MuSE (Music Systems Engineering) course, developed in collaboration with industry to be the world's first audio developer degree programme.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #cppprogramming #audio #dsp #digitalaudio

Filed under: UncategorizedTagged with: , , , ,

An Introduction to CLAP, a New Plug-In Standard – Alexandre Bique – ADC23

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

An Introduction to CLAP, a New Plug-In Standard - Alexandre Bique - ADC 2023

Join Bitwig developer Alexandre Bique for an introduction to CLAP (“CLever Audio Plug-in API”), an open and free plug-in standard. CLAP was launched in 2022 by plug-in manufacturer u-he and DAW creators Bitwig with design and implementation contributions by a group of commercial and open-source audio developers from across the industry. In his presentation, Alexandre will give an overview of how CLAP works, its structure and features, and the advantages it offers modern plugin-development.

Link to Slides: https://data.audio.dev/talks/2023/introduction-to-clap/slides.pdf
_

Alexandre Bique

Alexandre Bique is a senior software engineer interested in low-level programming and audio processing. Since 2015, he has been part of the development team at Bitwig. Bique has also worked for u-he and spearheaded the project of porting their plug-ins to Linux. He is the lead developer behind the new plug-in standard CLAP.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #audioplugins

Filed under: UncategorizedTagged with: , , , ,

Bringing Plugins to Live: Fourier Audio Introduces transform.engine – Henry Harrod – ADC23

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Bringing Plugins to Live: Fourier Audio Introduces transform.engine - Henry Harrod - ADC 2023

The Fourier Audio team introduce their new live plugin platform and share details of how third-party plugin manufacturers can take full advantage of the expanding live audio market.

Having recently joined the DiGiCo family and shared the first details of their live plugin platform at AES NYC, join the Fourier Audio team as they share the opportunity for any third-party plugin manufacturer to tap into the exciting live audio market.

Having already been tested on multiple arena/stadium tours around the world, ahead of shipping in Q1 2024, the team wants to give you the inside scoop of how it works, and what the future looks like.

The talk will walk you through the key features of the platform, the baseline requirements of plugin compatibility, how to fine-tune your software to take full advantage of all features, and their vision for the future of plugins (and licensing) in the live environment.

Link to Slides: https://data.audio.dev/talks/2023/fourier-audio-transform-engine/slides.pdf
_

Henry Harrod

Henry is the Co-Founder and CEO of Fourier Audio - a London-based audio start-up, developing a hardware-enabled software platform unlocking the power of reliable plugins and software DSP for live productions. Since graduating from Imperial College London as a Mechanical Engineer, Henry has worked as a sound engineer on some of the largest musical theatre shows in the UK, is a an Enterprise Fellow of the Royal Academy of Engineering, a Fellow of the ERA Foundation and an Acoustical Engineering alumnus of the Institute of Sound and Vibration Research, Southampton.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #plugins #audioplugins

Filed under: UncategorizedTagged with: , , , ,

Building an Accessible Juce App – Harry Morley – ADC23

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Building an accessible JUCE app - Harry Morley - ADC 2023

During this talk we will investigate what goes into making a JUCE app accessible. We'll go over component grouping and hierarchies, keyboard focus, tips for testing accessibility and more, using real-world case studies and concrete examples.

The session will primarily be about screen reader accessibility, since you may be new to using the parts of JUCE that deal with accessibility.

The talk is designed for people who may not know where to begin when building an accessible app with JUCE, or simply for those who would like to hear some perspectives regarding creating accessible audio apps.
_

Harry Morley

Harry has been a software developer at Focusrite for 4 years. He mainly works on C++ software that interacts with audio hardware, such as the Vocaster and Scarlett interfaces. Harry loves talking all things music, creativity and accessibility. Before Focusrite, Harry studied MA Computational Arts at Goldsmiths, and BMus Creative Music Technology at Surrey. He is a multi-instrumentalist who plays in a variety of genres and bands.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #cpp #audio #juce #audioprogramming

Filed under: UncategorizedTagged with: , , , ,

Inference Engines and Audio – Harriet Drury – ADC23

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​

Inference Engines and Audio - Harriet Drury - ADC 2023

Machine learning has become a buzzword in recent years, but how does it actually work? This talk aims to introduce and explain inference pipelines. We’ll look at commonly used inference engines, how they work, their suitability for use in audio applications, and how to go about creating your own.

Also introduced will be an approach to writing a custom inference engine for the Cmajor platform.

Link to Slides: https://data.audio.dev/talks/2023/inference-engines-and-audio/slides.pdf
_

Harriet Drury
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audio #audiotech #machinelearning

Filed under: UncategorizedTagged with: , , , ,

Why You Shouldn’t Write a DAW – David Rowland – ADC23

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​

Why you shouldn’t write a DAW - David Rowland - ADC 2023

There are surprisingly few DAWs in the music making world, especially when compared to the number of audio plugins on the market. Why is this? Could it be that all the DAWs in existence are perfect and there’s no need for another one? Perhaps there’s another reason…

In this talk we dive behind the UI/UX to take a deeper look at the technology that underpins DAWs. We’ll take a tour of some of the problems they solve, often transparently to the user, and some of the technical concepts they have to navigate in order to keep music makers in the groove.

Finally, we look at what alternatives there might be if you want to build a product that looks a bit like a DAW and why not building from scratch might save you a lot of time and money.

Link to Slides:
_

David Rowland

Dave Rowland is the CTO at Audio Squadron (owning brands such as Tracktion and Prism Sound), working primarily on the digital audio workstation, Waveform and the engine it runs on. Other projects over the years have included audio plugins and iOS audio applications utilising JUCE. In academia, David has taught on several modules at the University of the West of England on programming for audio. David has a passion for modern C++ standards and their use to improve code safety and brevity, has spoken at the Meeting C++ and Cpp On Sea conferences and is a regular speaker at the Audio Developer Conference and related monthly meetup. Past presentations: https://github.com/drowaudio/presentations/
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #daw

Filed under: UncategorizedTagged with: , , , ,

Odd Challenges of Using Deep Learning in Designing a Feedback Delay Network Reverb – Wojciech Kacper Werkowicz & Benjamin Whateley

  • Lobby
  • Tag Archives: programming

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Odd Challenges of Designing a Feedback Delay Network Reverb With Deep Learning - Wojciech Kacper Werkowicz & Benjamin Whateley - ADC 2023

Past lustrum have seen the rise of interest in optimization of audio effects and synthesizer parameters in use cases including parameter inference from audio input, as well as approaches for Differentiable Digital Signal Processing (such as Magenta's DDSP). However, there are still notable limitations in the area, exemplified well by the problems posed by some fundamental DSP units such as IIR filters - issues of stability, interpretability and differentiability.

In this talk, we will take on all of the above. It will be done so in the context of a research endeavour into modelling room Impulse Responses using Feedback Delay Network (FDNs). Covering a range of approaches, from naive to more advanced, we will take multiple detours to look into machine learning challenges in context of direct applications to DSP, such as approximating common transformations, tackling computational efficiency, taming the explosivity of feedback systems, at last, hopefully, differentiating the undifferentiable.
_

Wojciech Kacper Werkowicz

Programmer, computer musician, improviser from Pruszków, Poland. After being introduced to electronic music by "Ishkur's Guide" in early episode of life, his interest persisted over years. Graduated from Music Computing and Technology BSc program at Goldsmiths in 2023, where he studied under Michael Zbyszynski, Seth Horvitz and Lance Putnam. Currently surveying historical and contemporary digital synthesis methods as a part of his Masters research at Institute of Sonology, The Hague, aiming to critically contextualise synthesis technologies through the lens of sound culture and philosophy. Interested in algorithmic music, machine learning, internet culture. Often enjoys mixing lo-fi technologies with the cutting edge.
_

Benjamin Whateley
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #deeplearning #dsp #audio

Filed under: UncategorizedTagged with: , , , ,