Tag: software engineering

NO MORE CODE: New Graphical Programming Language for Audio Research and Developers – ChangHun Sung

  • Lobby
  • Tag Archives: software engineering

https://audio.dev/ -- @audiodevcon​

NO MORE CODE: Introducing a New Graphical Programming Language for Audio Research and Developers - ChangHun Sung - ADC 2023

Audio software development is rapidly moving towards incorporating machine learning-based processing. While research scientists are continuously presenting us with inventive results in the field of AI, there is a lack of software engineering tools to utilize these results.

We are introducing a new development framework to bridge the gap between AI researchers and software engineers, allowing both fields to work together seamlessly.

By borrowing some concepts from functional programming languages, we designed a new node-based graphical programming language for audio software development, which is capable of handling a variety of data types including audio, multi-dimensional tensors and MIDI. Furthermore, the system is designed to support looping and branching logic using only nodes and node connections. This allows the implementation of highly flexible data processing algorithms.

Finally, as an AI voice technology company, we will present a demonstration of the plug-ins developed using our new programming language, showcasing its adaptability and advanced capabilities.

Link to Slides: https://data.audio.dev/talks/2023/no-more-code/slides.pdf
_

ChangHun Sung

Chang Hun is a Software Engineer at Supertone, Inc. He previously worked in the game industry and used to develop game engines. Chang Hun now develops high performance C++ frameworks to accelerate the process of productizing ML models. He is also the principal clarinetist in an amateur orchestra in Seoul.
_

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC23 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#adc #dsp #audiosoftware #audio

Filed under: UncategorizedTagged with: , , , ,

Democratization of Audio Dev: How it Started, Where it’s Going – Aurelius Prochazka – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Democratization of Audio Dev: How it Started, Where it's Going - Aurelius Prochazka

In 2018, I gave a keynote at the ADC Conference in London. In that keynote, I discussed how audio developers can benefit from opening development to all, and how to escape the errors of past and design for the future. What did I get wrong? Did I get anything right? In this talk I'll give an overview of where we are now and update where things might be going.

Slides & Resources: https://data.audio.dev/talks/ADCxSF/2023/democratization-of-audio-dev/slides.pdf


_
Aurelius Prochazka

I'm Aurelius Prochazka, I am the founder of AudioKit, an open-source audio generation, processing, and analysis framework for the Apple ecosystem. I am a partner in AudioKitPro LLC, a company started to use the AudioKit framework to develop audio applications. Currently, AudioKit has delivered more synthesizer apps on iOS ever, including the most #1 charted music apps ever and the perennial global favorite, the free AudioKit Synth One.

In 2018 I traveled to London to give one of the keynotes for ADC in London. I have a Ph.D. from the California Institute of Technology in Computational Fluid Dynamics.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #opensource

Filed under: UncategorizedTagged with: , , ,

Processing Audio Post Production Deliverables at Scale with Microservice Architecture – Ryan Frias – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Processing Audio Post Production Deliverables at Scale with Microservice Architecture - Ryan Frias - ADCx SF

With the explosion of streaming services that operate on a global footprint, the audio mastering pipeline has ballooned to include as many as 765 unique language audio packages created from original, each of which needs to be quality checked, encoded and packaged for delivery. The process can take weeks and involves creative and technical teams working to make derivative versions which must preserve the original creative intent as much as possible. The "Coda" Automated Media Ecosystem is a new extensible software platform from Skywalker Sound that automates the creation of soundtrack versions and cuts the deliverable process down from weeks to faster-than real-time. The system has already been used on premium Disney+ releases such as The Mandalorian and Moon Knight.

By automating soundtrack mastering processing from the highest original source mix format (often the Dolby Atmos mix), the automatically derived versions can be created with the same fidelity and attention to detail as the original language, improving the experience for all consumers in international markets. As the process is automated without the possibility of human error, the need to QC each pass is reduced, resulting in better results for consumers and considerable time and cost savings for content owners.

The creation of this complex media pipeline ecosystem involved the integration of multiple programming languages, frameworks, environments and hardware systems for the full stack--from low-level digital signal processing, to high level scaffolds, such as a global service mesh.

Slides: https://data.audio.dev/talks/ADCxSF/2023/audio-in-midi-out/slides.pdf
_
Ryan Frias

Ryan is a software engineer from Skywalker Sound. He has worked in the post production sound industry for over 15 years, focusing on both the creative and technical bits.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #coda

Filed under: UncategorizedTagged with: , , ,

Using Faust in JUCE Projects – Julius Smith – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Using Faust in JUCE Projects - Julius Smith - ADCx SF

Faust (Functional AUdio STream) is a domain-specific functional programming language for sound synthesis and audio processing (https://faustdoc.grame.fr). Faust development is routinely an order of magnitude faster to write and debug than C++, and the run-time performance is usually within a factor of two. Development is further facilitated by the large Faust Libraries collection of signal-processing functions (https://faustlibraries.grame.fr). Since Faust compiles to C++, it is natural to integrate C++ header files generated by the Faust compiler into a JUCE project or the like. A limitation encountered is that Faust's powerful pattern-matching facility requires its "macro arguments" to be bound at compile time, i.e., not signals or controller parameters. An example is the filter order in Faust's filter-design functions. When these arguments need to change at run time, it can make more sense to translate Faust to C++, so that the recursive pattern-matching in Faust is replaced by recursive C++ functions. Experience using ChatGPT-3.5 and ChatGPT-4 for this purpose and others will be summarized.

_
Julius Smith

Professor Emeritus of Music and by courtesy Electrical Engineering, Stanford University, based at the Center for Computer Research in Music and Acoustics (CCRMA). Activities include teaching courses in signal processing and music technology, graduate student advising, and research in signal processing applied to music and audio. https://ccrma.stanford.edu/~jos/

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , , ,

DDSP-VST: Neural Synthesis for All – Nikhil Bhanu & @wilzh40 – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

DDSP-VST: Neural Synthesis for All - Nikhil Bhanu & Wilson Zhao - ADCx SF

We present DDSP-VST, a cross-platform audio plugin for real-time neural audio synthesis built using TensorFlow Lite and JUCE. DDSP is the underlying ML research behind this project that lets you combine the interpretable structure of classical DSP elements such as filters, oscillators, reverberation etc. with the expressivity of deep learning. This technology enables us to transform a given audio signal into any musical instrument by extracting the pitch and loudness and using those features for synthesis. In this talk we will discuss the technical and UX challenges of building an audio plugin powered by machine learning and making it accessible to musicians and artists.

_
Nikhil Bhanu

Audio software generalist with a passion for real-time systems, signal processing, musical interfaces and machine learning.

Wilson Zhao

Electronic music enthusiast + event organizer. Passionate about combining multimodal generative AI + creativity.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #vst

Filed under: UncategorizedTagged with: , , , ,

Test Strategies for Multi-Threaded Code – Ryan Avery – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Test Strategies for Multi-Threaded Code - Ryan Avery - ADCx SF

Multi-threaded code can be complicated. Realtime multi-threaded code even more so. And testing that code? Too often we give up faster than we can say “integration test”. But by switching around your thinking and adopting a few key strategies, you can start to tame the complexity and gain back a little bit of confidence in your critical code.

Slides: https://data.audio.dev/talks/ADCxSF/2023/test-strategies-for-multi-threaded-code/slides.pdf
_
Ryan Avery

Ryan is an audio software engineer who has worked in the industry for over 15 years. He is passionate about software quality and best practices in real-time audio software development. At Avid Technologies, he developed the Pro Limiter and Pro Multiband Dynamics plugins for Pro Tools. At Dolby Laboratories, Ryan helped develop a suite of plugins for producers to create spatial music in Atmos.

Ryan currently works at Apple, and is an active music producer under the alias of Chance's End, where he brings violin to the front of electronic production.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #softwaretesting

Filed under: UncategorizedTagged with: , , , ,

Using & Implementing Differential Reference Counting in Realtime Audio Code – Palmer Hogen – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Using & Implementing Differential Reference Counting in Realtime Audio Code - Palmer Hogen - ADCx SF

Safely sharing dynamic memory across threads – especially when some of those threads have strict time deadlines – is a tricky problem space; unfortunately this scenario appears in realtime audio code. Some threads may still be accessing old data, so algorithms need to carefully avoid deleting anything still in-use.

Many deferred-reclamation strategies have emerged to address this risk, but these techniques have a general tradeoff between ease-of-use and throughput; ideally we would like both!

This talk presents a variant of traditional reference counting, which offers improved throughput at the expense of a more limited API.

_
Palmer Hogen

Musician & Programmer; Software Engineer @ Roblox

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , ,

TX/RX Part 1: Workbenching Neural Audio Solutions – Kieran Coulter – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

TX/RX Part 1: Workbenching Neural Audio Solutions - Kieran Coulter - ADCx SF

Deploying neural audio solutions to hardware requires a robust design/deploy build system, and usually requires minimizing compute and reducing algorithm latencies to realtime. In Part 1 of this 2-part talk series, we will examine various shortcuts for workbenching (open source) neural audio DSP solutions on the host system.

Slides: https://data.audio.dev/talks/ADCxSF/2023/workbenching-neural-audio-solutions/slides.pdf
_
Kieran Coulter

Audio software developer with specializations in 3D Audio and Neural Voice Processing

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #neuralnetworks

Filed under: UncategorizedTagged with: , , ,

Fun with Functions: Designing Fast Math Approximations with Python – Ryan Robinson – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Fun with Functions: Designing Fast Math Approximations with Python - Ryan Robinson - ADCx SF

Standard library math functions generally prioritize accuracy over speed. In audio, however, we are often willing to trade some of that accuracy if we can get the computation done faster. In this workshop, we will go over the theory behind common methods of approximating special math functions and learn how to use popular Python packages to generate our own approximations. We will also compare our results to well-known open source examples.

This talk is intended to be an accessible introduction to the topic for curious people with a limited knowledge of calculus. It should also be a practical refresher for those that are more advanced. Topics discussed include: Taylor polynomials, Padé approximants, minimax approximations.

Slides: https://data.audio.dev/talks/ADCxSF/2023/fun-with-functions/slides.pdf
_
Ryan Robinson

Ryan Robinson is an independent iOS developer based in southern Oregon. Ryan’s apps are frequently among the top paid music apps in the United States. With a background in math education, Ryan likes to have fun with the more mathy parts of audio development. When not working on apps, he enjoys spending time with his wife and taking his newborn son for walks around the neighborhood.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #pythonprogramming

Filed under: UncategorizedTagged with: , , , ,

Audio In, MIDI Out – Avrosh Kumar & Chris Latina – ADCx SF

  • Lobby
  • Tag Archives: software engineering

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Audio In, MIDI Out - Avrosh Kumar & Chris Latina - ADCx SF

Audio plugins enable musicians to apply effects to audio tracks, synthesize sounds through virtual instruments, and even transform MIDI events using MIDI effects. Mixing and mastering engineers also make use of analyzers and mastering plugins that can extract instantaneous and statistical information about the audio track to help guide the mixing process. As plugin developers, we can tinker with audio and MIDI data in several ways to augment musicians’ creative workflows.

In this talk, we will explore a special case of such plugin implementations and generate MIDI output using audio as input. This can be achieved by performing real-time content analysis on an audio track, and produce control signals as MIDI events that represent high-level features extracted from audio. These MIDI events can then be used to trigger or modulate external parameters and engines.

Audio-to-MIDI capability is already natively supported by some DAWs. They convert the melodic contents of audio to its MIDI representation and is even used by some plugins for real-time voice-to-pitch conversion. MIDI is not only a format to represent melodies and harmonies but, is excellent for producing annotated events and control signals using program and control change (CC) messages. We will leverage this in our Audio-to-MIDI plugins to potentailly create controlled chaos (think Buchla).

Slides: https://data.audio.dev/talks/ADCxSF/2023/audio-in-midi-out/slides.pdf
_
Avrosh Kumar

Speech Research Engineer @ Pindrop
Plugin Developer, Music Tech Enthusiast

Chris Latina

As a sonic explorer melding hybrid hardware and software mediums, Christopher Latina works at the crossroads of engineering, design and music composition to create immersive environments.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , ,