Category: Uncategorized

Spectral Audio Modeling: Why Did It Evolve and Do We Need It Now? – Julius Smith – ADC23

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Spectral Audio Modeling: Why Did It Evolve and Do We Need It Now? - Julius Smith - ADC 2023

This talk summarizes historical developments in spectral audio synthesis and processing, touching on origins in evolution, musical practices, innovations at Bell Labs and CCRMA, and AI approaches today. Our ears continue to feed spectral decompositions to the brain, showing no signs of become vestigial in favor of purely neural processing in the brain. In machine learning, on the other hand, spectral representations are often being omitted in favor of time-domain waveform encodings. How do we reconcile this? Looking at continuing uses of spectral audio processing in AI, we find that AI and spectral processing remain partners and are likely to continue symbiotically for the foreseeable future.
_

Julius Smith

Julius O. Smith is a research engineer, educator, and musician devoted primarily to developing new technologies for music and audio signal processing. He received the B.S.E.E. degree from Rice University in 1975 (Control, Circuits, and Communication), and the M.S. and Ph.D. degrees in E.E. from Stanford University, in 1978 and 1983, respectively. For his MS/EE, he focused largely on Stanford's superb curriculum in statistical signal processing. His Ph.D. research was devoted to improved methods for digital filter design and system identification applied to music and audio systems, particularly the violin. From 1975 to 1977 he worked in the Signal Processing Department at ESL, Sunnyvale, CA, on systems for digital communications. From 1982 to 1986 he was with the Adaptive Systems Department at Systems Control Technology, Palo Alto, CA, where he worked in the areas of adaptive filtering and spectral estimation. From 1986 to 1991 he was employed at NeXT Computer, Inc., responsible for sound, music, and signal processing software for the NeXT computer workstation. After NeXT, he became a Professor at the Center for Computer Research in Music and Acoustics (CCRMA) at Stanford, with a courtesy appointment in EE, teaching courses and pursuing/supervising research related to signal processing techniques applied to music and audio systems. At varying part-time levels, he was a founding consultant for Staccato Systems, Shazam Inc., and moForte Inc. He is presently a Professor Emeritus of Music and by courtesy Electrical Engineering at Stanford, and a perennial consultant for moForte Inc. For more information, see http://ccrma.stanford.edu/~jos/.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #ai

Filed under: UncategorizedTagged with: , , , ,

A Comparison of Virtual Analog Modelling Techniques (Part 2) – Christopher Clarke & Jatin Chowdhury

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

A Comparison of Virtual Analog Modelling Techniques (Part 2) - Christopher Johann Clarke & Jatin Chowdhury - ADC23

This talk will explore the spectrum of virtual analog modelling techniques including traditional methods (modified nodal analysis, wave digital filters), single-architecture neural network models, and grey-box methods that incorporate both physical modelling and machine learning techniques. Several models of the gain stage from the Boss DS-1 guitar pedal will be provided as a motivating example. The talk will discuss how these methods can generalize over a wide range of circuits, as well as the specific problems that users of each modelling technique can expect to see for different types of circuits.

Link to Slides:
_

Christopher Johann Clarke

Christopher Clarke is a PhD candidate studying at SUTD (Multiphysics, A.I/Machine Learning) with a background in music specialising in generative algorithms (MMus) and psychophysics in music (BA, recipient of Phillip Holt Award).
_

Jatin Chowdhury

Jatin is an audio signal processing engineer from Denver, Colorado, USA. For the past several years he has worked as a developer of audio effects and other music technology software. Jatin is a graduate from the Center for Computer Research in Music and Acoustics (CCRMA) at Stanford University, where he studied audio signal processing.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio

Filed under: UncategorizedTagged with: , , ,

Deep Learning for DSP Engineers: Challenges & Tricks for Audio AI – Franco Caspe & Andrea Martelloni

https://audio.dev/ -- @audiodevcon​

Deep Learning for DSP Engineers: Challenges and Tricks for Audio AI - Franco Caspe & Andrea Martelloni - ADC23

This talk aims to tackle and demystify the process of the development of an AI-based musical instrument, audio tool or effect. We want to view this process not from the point of view of technical frameworks and technical challenges, but from that of the design process, the knowledge required and the learning curve needed to be productive with AI tools; particularly if one approaches AI from an audio DSP background, which was our situation when we started out.

We are going to quickly survey the current applications of AI for real-time music making, and reflect on the challenges that we found, especially with current learning resources. We will then walk through the process of developing a real-time audio model based on deep learning, from dataset to deployment, highlighting the relevant aspects for those with a DSP background. Finally, we will describe how we applied that process to our own PhD projects, the HITar and the Bessel’s Trick.

Link to Slides:
_

Franco Caspe

I’m an electronic engineer, a maker, hobbyist musician and a PhD Student at the Artificial Intelligence and Music CDT at Queen Mary University of London. I have experience in development of real-time systems for applications such as communication, neural network inference, and DSP. I play guitar and I love sound design, so in my PhD I set out to find ways to bridge the gap that separates acoustic instruments and synthesizers, using AI as an analysis tool for capturing performance features present in the instruments’ audio, and as a generation tool for synthetic sound rendering.
_

Andrea Martelloni

Inventor of the HITar. Interested in applications of deep learning for rich real-time musical interaction and expressive digital musical instruments.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #ai #deeplearning

Filed under: UncategorizedTagged with: , , , ,

Exploration of Strongly-Typed Units: A Case-Study From Digital Audio – Roth Michaels – ADC23

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Exploration of Strongly-Typed Units: A Case-Study From Digital Audio - Roth Michaels - ADC 2023

API or math mistakes with units can cause problems ranging from a digital audio processing outputting silence to crashing your Mars rover—we’ll discuss real-life examples of both! The combination of user-defined types, conversion operators/constructors, and operator overloading in C++ give us the tools to use strong-types and avoid unit mistakes; std::chrono is a great example of this that everyone should be using. Unfortunately, when dealing with units beyond time many developers still use primitive types encoding units in variable names or comments because the standard does not offer any tools for user-defined units.

In this talk, we will look at the mp-units library which has been proposed for standardization in P1935 (A C++ Approach to Physical Units). We will look at the implementation of various units used in digital audio / DSP that go beyond “physical” units and what the experience is like to develop your own units with this library/proposal.
To close, we will look at things missing from P1935 that we as audio developers might need.
_

Roth Michaels

Roth Michaels is a Principal Software Engineer at Native Instruments, an industry leader in real-time audio software for music production and broadcast/film post-production. In his current role he is involved with software architecture and bringing together three merged engineering organizations and legacy codebases: Brainworx, iZotope, and Native Instruments. He also supports the Audio Research team to help accelerate moving research to productization and developing fast prototyping tools for product teams. Before merging with Native Instruments, when he joined iZotope, Roth was the lead library designer of a new internal cross-platform "Glass", part of which is now available as open-source. More recently in his former role as Mix/Master Software Architect, Roth helped develop the reference implementation to move iZotope's products to subscription and led the team that launched the company’s first SaaS offering for music producers. Roth studied music composition at Brandeis University and continued his studies in the Dartmouth Digital Musics program. Roth began his career in software development writing software for his own compositions, and the works of other composers and artists, and teaching MaxMSP to composers and musicians; both private instruction and designing university courses. Before joining iZotope, he was working as a consultant for small startups working on mobile applications specializing in location services and Bluetooth.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #cppprogramming #digitalaudio #audio #cpp

Filed under: UncategorizedTagged with: , , , ,

Implementation of an IIR Antiderivative Anti-Aliasing Wavetable Oscillator – Maxime Coutant – ADC23

https://audio.dev/ -- @audiodevcon​

Implementation of an IIR Antiderivative Anti-Aliasing Wavetable Oscillator - Maxime Coutant - ADC 2023

Anti-aliasing is a crucial consideration for digital audio synthesis. Usually, for an oscillator, techniques like band-limited signals or oversampling are employed to mitigate this problem, but I investigated a method a bit more recent : Antiderivative Anti-Aliasing (ADAA). My search for a practical ADAA application in wavetable synthesis first yielded limited results. However, a paper titled "Antiderivative Antialiasing for Arbitrary Waveform Generation," published in August 2022, caught my attention.

The presentation will focus on three aspects:

• An Introduction to ADAA and the algorithm itself
• Insights into practical implementation and results
• Reflections on engaging with Academic Research

By the end of the talk the listener will know about the pros and cons of this technique and how and when to employ it. Furthermore, we will have illustrated some challenges of working with academic material as a software developer.

Link to Slides: https://docs.google.com/presentation/d/1mx8f7yxXMLxQ-pl3IcoqLkcZtQGd7z6gOidcQMAfxPc/edit
_

Maxime Coutant

I'm an audio software engineer in the ADASP group, part of the LTCI public laboratory. Audio enthusiast, hobbyist musician and software addict, I love to share, learn and meet new people! Here at ADC23 I'll present a project I spent many hours on during this last year, hoping to lower the bridge between research and engineering!
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #dsp #audio #softwareengineering #digitalaudio

Filed under: UncategorizedTagged with: , , , ,

Three RADical Concepts in the Art of C++ Coding – Chris Nash – ADC23

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Three RADical Concepts in the Art of C++ Coding - Chris Nash - ADC 2023

What if MIDI was a programming language?
What if C++ had built-in audio semantics?
What if you could develop C++ plugins, live in the DAW?

This talk explores these ideas and the development of new technologies designed to blur the lines between music and code, for both artists and developers, and challenge traditional ways of thinking and working.

Drawing on concepts of flow, liveness, and rapid prototyping, the talk will present live demos, and discuss the development of:

Manhattan - a digital audio workstation and embeddable API built on a procedural music engine that integrates sequencing and programming. Used by artists, game composers, and in teaching computational thinking, example applications include crowd-driven music using machine vision, a Unity mini-game featuring a live (and somewhat mortal) orchestra, plus a growing library of famous works recomposed as code that shows the power of modelling music as both pattern and process.

Klang - an open C++ dialect (language extension) for audio, using modern language features (C++14/17) to extend the semantics of C++ to encapsulate audio, providing DSP primitives and types, and adapting the STL's concept of stream objects and operators to represent signals. Easier to read, more concise, and easily mapped to visual forms (block diagrams, Max), Klang feels like a new language (in the spirit of SOUL) but, as pure C++, retains the performance, portability, compatibility, and interoperability of the industry standard.

rapIDE - a C++ IDE inside a DAW plugin, designed for rapid audio prototyping and development of synthesisers and effects. Built on a full clang/LLVM-based toolchain, the plugin's source code can be live edited, rebuilt, reloaded and auditioned without restarting the DAW (or stopping playback). Compatible with C++ and Klang, rapIDE is designed to improve the accessibility, liveness, and immersion of audio programming, for applications in rapid prototyping and teaching, featuring realtime debugging, auto-complete, code sandboxing, and built-in audio analysis.

These technologies will support the new Music Systems Engineering (MuSE) degree programme, in development by Point Blank Music School in collaboration with industry, for launch in 2024.
_

Chris Nash

Chris Nash is a software developer, composer, educator and researcher in things that go beep in the night. Following a PhD on music software design at Cambridge, he has worked on technology and music projects across academia and industry, including for the BBC, Steinberg/Yamaha, and multiple start-ups, and independently develops and maintains several software projects, specialising in computer music and making music programming more accessible, including Manhattan (a hybrid DAW/programming language), Klang (a C++ dialect for audio), rapIDE (a plug-in based C++ IDE) and reViSiT (an award-winning plug-in based sound tracker). He is currently Senior Lecturer in Software Development for Audio, Sound, and Music at UWE Bristol, and recently founded nash.audio, a non-profit organisation supporting creativity and learning in music technology. Working with London-based Point Blank Music School, Dr Nash is the architect of the forthcoming MuSE (Music Systems Engineering) course, developed in collaboration with industry to be the world's first audio developer degree programme.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #cppprogramming #audio #dsp #digitalaudio

Filed under: UncategorizedTagged with: , , , ,

How to Make a Successful Plugin From Scratch as a Solo Audio Developer – Marius Metzger – ADC23

https://audio.dev/ -- @audiodevcon​

How to Make a Successful Audio Plugin From Scratch as a Solo Audio Developer - Marius Metzger - ADC23

After my well-received appearance on last year's panel on starting your first audio business, I'm resubmitting my talk proposal on the success story of the CrispyTuner, explaining to aspiring indie developers how it's possible to make a successful audio plugin from start to finish. The goal is to inspire aspiring developers by showing real challenges I faced and how I overcame them.

Link to Slides: https://docs.google.com/presentation/d/1oIM33u4huTFny9GasHak4yOwFd-gShP2aNkeGExGFMg/edit
_

Marius Metzger

My name is Marius, I'm 24 years old and have a passion for product design, leadership, and, of course, software development. After finishing school at 16 years of age, I got right into freelance software development, with Google as one of my first clients. In 2020, I released a pitch correction audio plug-in called CrispyTuner, which I created mostly by myself over the span of 2 years. It found great commercial success, and shortly after release I sold it to Plugin Alliance/brainworx to move on to new projects! At the moment, I live as a digital nomad, travelling the world and working as Development Lead at essential.gg.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audiodev #pitchcorrection #audioplugins

Filed under: UncategorizedTagged with: , , ,

An Introduction to CLAP, a New Plug-In Standard – Alexandre Bique – ADC23

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

An Introduction to CLAP, a New Plug-In Standard - Alexandre Bique - ADC 2023

Join Bitwig developer Alexandre Bique for an introduction to CLAP (“CLever Audio Plug-in API”), an open and free plug-in standard. CLAP was launched in 2022 by plug-in manufacturer u-he and DAW creators Bitwig with design and implementation contributions by a group of commercial and open-source audio developers from across the industry. In his presentation, Alexandre will give an overview of how CLAP works, its structure and features, and the advantages it offers modern plugin-development.

Link to Slides: https://data.audio.dev/talks/2023/introduction-to-clap/slides.pdf
_

Alexandre Bique

Alexandre Bique is a senior software engineer interested in low-level programming and audio processing. Since 2015, he has been part of the development team at Bitwig. Bique has also worked for u-he and spearheaded the project of porting their plug-ins to Linux. He is the lead developer behind the new plug-in standard CLAP.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #audioplugins

Filed under: UncategorizedTagged with: , , , ,

Bringing Plugins to Live: Fourier Audio Introduces transform.engine – Henry Harrod – ADC23

Join Us For ADC24 - Bristol - 11-13 November 2024
More Info: https://audio.dev/
@audiodevcon​

Bringing Plugins to Live: Fourier Audio Introduces transform.engine - Henry Harrod - ADC 2023

The Fourier Audio team introduce their new live plugin platform and share details of how third-party plugin manufacturers can take full advantage of the expanding live audio market.

Having recently joined the DiGiCo family and shared the first details of their live plugin platform at AES NYC, join the Fourier Audio team as they share the opportunity for any third-party plugin manufacturer to tap into the exciting live audio market.

Having already been tested on multiple arena/stadium tours around the world, ahead of shipping in Q1 2024, the team wants to give you the inside scoop of how it works, and what the future looks like.

The talk will walk you through the key features of the platform, the baseline requirements of plugin compatibility, how to fine-tune your software to take full advantage of all features, and their vision for the future of plugins (and licensing) in the live environment.

Link to Slides: https://data.audio.dev/talks/2023/fourier-audio-transform-engine/slides.pdf
_

Henry Harrod

Henry is the Co-Founder and CEO of Fourier Audio - a London-based audio start-up, developing a hardware-enabled software platform unlocking the power of reliable plugins and software DSP for live productions. Since graduating from Imperial College London as a Mechanical Engineer, Henry has worked as a sound engineer on some of the largest musical theatre shows in the UK, is a an Enterprise Fellow of the Royal Academy of Engineering, a Fellow of the ERA Foundation and an Acoustical Engineering alumnus of the Institute of Sound and Vibration Research, Southampton.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audio #plugins #audioplugins

Filed under: UncategorizedTagged with: , , , ,

RafterMarsh: Ask A Lawyer – Heather Rafter, Philipp Lengeling and Francine Godrich – ADC23

https://audio.dev/ -- @audiodevcon​

RafterMarsh: Ask A Lawyer About Audio Legal Problems - Heather Rafter, Philipp Lengeling, Francine Godrich - ADC 2023

Your intellectual property is the lifeblood of your business; do you have a legal question relating to your audio products? Want to discuss different ways to approach licensing and strategic partnerships? The new privacy regulations? Points to consider if you’re a UK or EU company doing business in the U.S. or vice versa? Or perhaps you have questions about protecting your intellectual property? A team of expert lawyers including Heather Rafter (RafterMarsh), Philipp Lengeling (RafterMarsh) and Francine Godrich (Focusrite) will be available to answer your questions. Bring us your most challenging legal questions!
_

Heather Rafter

Heather Dembert Rafter has been providing legal and business development services to the audio, music technology, and digital media industries for over twenty-five years. As principal counsel at RafterMarsh US, she leads the RM team in providing sophisticated corporate and IP advice (US practice) and entertainment law services (UK) to content creators, hardware and software developers, and event producers, among others.Heather served as Director of Legal Affairs and later General Counsel for Digidesign, the audio division of Avid Technology and the creator of the award-winning Pro Tools software. Heather was instrumental in the company’s acquisition of M-Audio and Sibelius Software and represented audio console leader Euphonix in its acquisition by Avid, as well as counsel for Imagine Research in its acquisition by iZotope, another audio industry flagship company.She began her legal career as a litigation attorney at Gibson Dunn & Crutcher, focusing on intellectual property and commercial matters. Heather served as Chair of the American Bar Association Section of Science & Technology Law and is a member of the ABA’s Fund for Justice and Education.Heather currently serves as an Advisor to Ardian, a French-based private equity firm, on the Board of Advisors of the Bob Moog Foundation and as a Senior Advisor for MediaBridge Capital, a leading investment banking and strategic advisory firm serving the media technology industry. Heather, an advocate for gender parity in the legal and music industry, also serves on the Boards of SoundGirls.org: http://soundgirls.org/, and WiMN, the Women’s International Music Network. A proud alumna, Heather serves on the advisory council for the Department of Music at Princeton University. Heather is a graduate of Princeton University (A.B., Woodrow School of Public & International Affairs, magna cum laude) and Columbia University School of Law (J.D., Harlan Fiske Stone Scholar). Heather’s sons both work in high tech, and her daughter is finishing her senior year at Princeton University. Heather is an avid yogi and fan of live music.
_

Philipp Lengeling

Philipp G. Lengeling, Mag. iur., LL.M. (New York), Esq. is an attorney based in New York (U.S.A.) and Hamburg (Germany), who is heading the New York and Hamburg based offices for RafterMarsh, a transatlantic boutique law firm (California, New York, U.K., Germany).
_

Francine Godrich

Francine is General Counsel (i.e. does lots of legal stuff) and Company Secretary (i.e. deals with corporate governance administration) to one of the world’s most passionate and prestigious Music Tech plcs. Francine spends a lot of her time looking at how Focusrite plc can grow its business whether this be through entering into agreements with suppliers and manufacturers to give the business the tools it needs to operate every day, investments into and acquisitions of businesses that will compliment and augment Focusrite or doing all the other legal things that no one really knows goes on e.g. confidentiality agreements, advising on how competition law can affect every day business, protecting our intellectual property portfolio, handling employment matters, reviewing software licences and creating the contracts the commercial teams come up with – fun times.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #audio #intellectualpropertylawyer

Filed under: UncategorizedTagged with: , , ,