Tag: coding

Processing Audio Post Production Deliverables at Scale with Microservice Architecture – Ryan Frias – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Processing Audio Post Production Deliverables at Scale with Microservice Architecture - Ryan Frias - ADCx SF

With the explosion of streaming services that operate on a global footprint, the audio mastering pipeline has ballooned to include as many as 765 unique language audio packages created from original, each of which needs to be quality checked, encoded and packaged for delivery. The process can take weeks and involves creative and technical teams working to make derivative versions which must preserve the original creative intent as much as possible. The "Coda" Automated Media Ecosystem is a new extensible software platform from Skywalker Sound that automates the creation of soundtrack versions and cuts the deliverable process down from weeks to faster-than real-time. The system has already been used on premium Disney+ releases such as The Mandalorian and Moon Knight.

By automating soundtrack mastering processing from the highest original source mix format (often the Dolby Atmos mix), the automatically derived versions can be created with the same fidelity and attention to detail as the original language, improving the experience for all consumers in international markets. As the process is automated without the possibility of human error, the need to QC each pass is reduced, resulting in better results for consumers and considerable time and cost savings for content owners.

The creation of this complex media pipeline ecosystem involved the integration of multiple programming languages, frameworks, environments and hardware systems for the full stack--from low-level digital signal processing, to high level scaffolds, such as a global service mesh.

Slides: https://data.audio.dev/talks/ADCxSF/2023/audio-in-midi-out/slides.pdf
_
Ryan Frias

Ryan is a software engineer from Skywalker Sound. He has worked in the post production sound industry for over 15 years, focusing on both the creative and technical bits.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #coda

Filed under: UncategorizedTagged with: , , ,

Using Faust in JUCE Projects – Julius Smith – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Using Faust in JUCE Projects - Julius Smith - ADCx SF

Faust (Functional AUdio STream) is a domain-specific functional programming language for sound synthesis and audio processing (https://faustdoc.grame.fr). Faust development is routinely an order of magnitude faster to write and debug than C++, and the run-time performance is usually within a factor of two. Development is further facilitated by the large Faust Libraries collection of signal-processing functions (https://faustlibraries.grame.fr). Since Faust compiles to C++, it is natural to integrate C++ header files generated by the Faust compiler into a JUCE project or the like. A limitation encountered is that Faust's powerful pattern-matching facility requires its "macro arguments" to be bound at compile time, i.e., not signals or controller parameters. An example is the filter order in Faust's filter-design functions. When these arguments need to change at run time, it can make more sense to translate Faust to C++, so that the recursive pattern-matching in Faust is replaced by recursive C++ functions. Experience using ChatGPT-3.5 and ChatGPT-4 for this purpose and others will be summarized.

_
Julius Smith

Professor Emeritus of Music and by courtesy Electrical Engineering, Stanford University, based at the Center for Computer Research in Music and Acoustics (CCRMA). Activities include teaching courses in signal processing and music technology, graduate student advising, and research in signal processing applied to music and audio. https://ccrma.stanford.edu/~jos/

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , , ,

DDSP-VST: Neural Synthesis for All – Nikhil Bhanu & @wilzh40 – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

DDSP-VST: Neural Synthesis for All - Nikhil Bhanu & Wilson Zhao - ADCx SF

We present DDSP-VST, a cross-platform audio plugin for real-time neural audio synthesis built using TensorFlow Lite and JUCE. DDSP is the underlying ML research behind this project that lets you combine the interpretable structure of classical DSP elements such as filters, oscillators, reverberation etc. with the expressivity of deep learning. This technology enables us to transform a given audio signal into any musical instrument by extracting the pitch and loudness and using those features for synthesis. In this talk we will discuss the technical and UX challenges of building an audio plugin powered by machine learning and making it accessible to musicians and artists.

_
Nikhil Bhanu

Audio software generalist with a passion for real-time systems, signal processing, musical interfaces and machine learning.

Wilson Zhao

Electronic music enthusiast + event organizer. Passionate about combining multimodal generative AI + creativity.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #vst

Filed under: UncategorizedTagged with: , , , ,

Test Strategies for Multi-Threaded Code – Ryan Avery – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Test Strategies for Multi-Threaded Code - Ryan Avery - ADCx SF

Multi-threaded code can be complicated. Realtime multi-threaded code even more so. And testing that code? Too often we give up faster than we can say “integration test”. But by switching around your thinking and adopting a few key strategies, you can start to tame the complexity and gain back a little bit of confidence in your critical code.

Slides: https://data.audio.dev/talks/ADCxSF/2023/test-strategies-for-multi-threaded-code/slides.pdf
_
Ryan Avery

Ryan is an audio software engineer who has worked in the industry for over 15 years. He is passionate about software quality and best practices in real-time audio software development. At Avid Technologies, he developed the Pro Limiter and Pro Multiband Dynamics plugins for Pro Tools. At Dolby Laboratories, Ryan helped develop a suite of plugins for producers to create spatial music in Atmos.

Ryan currently works at Apple, and is an active music producer under the alias of Chance's End, where he brings violin to the front of electronic production.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #softwaretesting

Filed under: UncategorizedTagged with: , , , ,

Using & Implementing Differential Reference Counting in Realtime Audio Code – Palmer Hogen – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Using & Implementing Differential Reference Counting in Realtime Audio Code - Palmer Hogen - ADCx SF

Safely sharing dynamic memory across threads – especially when some of those threads have strict time deadlines – is a tricky problem space; unfortunately this scenario appears in realtime audio code. Some threads may still be accessing old data, so algorithms need to carefully avoid deleting anything still in-use.

Many deferred-reclamation strategies have emerged to address this risk, but these techniques have a general tradeoff between ease-of-use and throughput; ideally we would like both!

This talk presents a variant of traditional reference counting, which offers improved throughput at the expense of a more limited API.

_
Palmer Hogen

Musician & Programmer; Software Engineer @ Roblox

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , ,

TX/RX Part 1: Workbenching Neural Audio Solutions – Kieran Coulter – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

TX/RX Part 1: Workbenching Neural Audio Solutions - Kieran Coulter - ADCx SF

Deploying neural audio solutions to hardware requires a robust design/deploy build system, and usually requires minimizing compute and reducing algorithm latencies to realtime. In Part 1 of this 2-part talk series, we will examine various shortcuts for workbenching (open source) neural audio DSP solutions on the host system.

Slides: https://data.audio.dev/talks/ADCxSF/2023/workbenching-neural-audio-solutions/slides.pdf
_
Kieran Coulter

Audio software developer with specializations in 3D Audio and Neural Voice Processing

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #neuralnetworks

Filed under: UncategorizedTagged with: , , ,

MIDI Polyphonic Expression (MPE) Profile for MIDI 2 – Gregory Pat Scandalis – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

MIDI Polyphonic Expression (MPE) Profile for MIDI 2 - Gregory Pat Scandalis - ADCx SF

MIDI Polyphonic Expression (MPE) is a MIDI Association standard, which allows for per-note expressive control based on the MIDI 1.0 protocol. The MIDI Association is currently developing a MIDI 2 profile for MPE, which is expected to be completed in 2023.

Initially, MPE was supported by innovative controllers such as the Haken Continuum, the LinnStrument, and the Roli Seaboard. Nowadays, it is supported in numerous music creation tools, including controllers, synthesizers, and DAWs. The aim of this presentation is to provide an introduction to the fundamentals of the current MPE 1 standard, as well as an overview of the work being done on the MPE 2 profile for MIDI 2, including the differences between MPE 1 and MPE 2.

_
Gregory Pat Scandalis

Gregory Pat Scandalis, CTO and acting CEO moForte Inc has worked for a number of Silicon Valley High Tech Companies. He has held lead engineering positions at National Semiconductor, Teradyne, Apple, and Sun. He has spent the past 29 years working in Digital Media. He was an Audio DSP researcher at Stanford University’s Center for Computer Research in Music and Acoustics (CCRMA). He co-founded and was the VP of engineering for Staccato Systems, a successful spinout of Stanford/CCRMA that was sold to Analog Devices in 2001. He has held VP positions at TuneTo.com (Rhapsody), and Jarrah Systems and he ran Liquid Digital Media which developed and operated all online digital music e-commerce properties for Walmart. He holds a BSc in Physics from Cal Poly San Luis Obispo is a visiting scholar at CCRMA, Stanford, and is currently the chairman of the MPE sub-committee within the MIDI Association.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #midi

Filed under: UncategorizedTagged with: , , , , ,

Fun with Functions: Designing Fast Math Approximations with Python – Ryan Robinson – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Fun with Functions: Designing Fast Math Approximations with Python - Ryan Robinson - ADCx SF

Standard library math functions generally prioritize accuracy over speed. In audio, however, we are often willing to trade some of that accuracy if we can get the computation done faster. In this workshop, we will go over the theory behind common methods of approximating special math functions and learn how to use popular Python packages to generate our own approximations. We will also compare our results to well-known open source examples.

This talk is intended to be an accessible introduction to the topic for curious people with a limited knowledge of calculus. It should also be a practical refresher for those that are more advanced. Topics discussed include: Taylor polynomials, Padé approximants, minimax approximations.

Slides: https://data.audio.dev/talks/ADCxSF/2023/fun-with-functions/slides.pdf
_
Ryan Robinson

Ryan Robinson is an independent iOS developer based in southern Oregon. Ryan’s apps are frequently among the top paid music apps in the United States. With a background in math education, Ryan likes to have fun with the more mathy parts of audio development. When not working on apps, he enjoys spending time with his wife and taking his newborn son for walks around the neighborhood.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #pythonprogramming

Filed under: UncategorizedTagged with: , , , ,

Massive leveraging of FlexBox using the JUCE C++ classes – Nick Porcaro – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Massive leveraging of FlexBox using the JUCE C++ classes - Nick Porcaro ADCx SF

UI development using the JUCE classes wrapping FlexBox particularly via PluginGUIMagic has been used for rewriting a new portable version of a GeoShred, large popular iOS music app.
Several strategic modifications and optimizations were made to PluginGUImagic to make this happen. In this talk a demonstration of app will be given and how the layouts are made.

Slides & Resources: https://data.audio.dev/talks/ADCxSF/2023/massive-leveraging-of-flexbox-using-juce/preset.pdf
https://data.audio.dev/talks/ADCxSF/2023/massive-leveraging-of-flexbox-using-juce/slides.pdf
https://data.audio.dev/talks/ADCxSF/2023/massive-leveraging-of-flexbox-using-juce/layout.pdf


_
Nick Porcaro

Nick is a software developer proficient in many languages including Objective-C, C++, PHP, Javascript, Python and Perl. He holds a B.S in electrical engineering from Texas A&M, and was a visiting scholar at the Center for Computer Research in Music and Acoustics (CCRMA), Stanford University. He was a founder of Staccato Systems, and worked for several other startup companies in a variety of fields – electronic design automation, geophysics, e-commerce, and digital audio. He has also done independent artistic work using 3D graphics with sound. In late 2011 he released an iPhone app called UndAground – New York, a cultural guide to New York City. He is also a jazz pianist.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #juce

Filed under: UncategorizedTagged with: , , , , ,

Creating Your Own Singing Voice Synthesizer: Overcoming Data Collection Challenges – by @mattricesound – ADCx SF

  • Lobby
  • Tag Archives: coding

Join Us For ADC23 - London - 13-15 November 2023
More Info: https://audio.dev/
@audiodevcon

Creating Your Own Singing Voice Synthesizer: Overcoming Data Collection Challenges - Matthew Rice - ADCx SF

While singing voice synthesizers have existed for decades, recent deep-learning-based products (Sinsy, Vocaloid) have greatly improved the quality of the results. However, these systems provide only a limited number of pre-trained "voices" based on proprietary datasets. Luckily, open-source systems (NNSVS, OpenUtau, VISinger, DiffSinger) exist, allowing users to use custom datasets to create a singing voice synthesizer. Unfortunately, creating the necessary datasets is a time-consuming process that requires collecting phoneme-level timing and other data points. As a result, few public datasets are available, and those that do exist are mostly restricted to Mandarin Chinese and Japanese. In this talk, I will demonstrate several approaches to collecting this data, from manual labeling to fully automated procedures, making it easier for everyone to create their own personalized singing voice synthesizers.

Slides: https://data.audio.dev/talks/ADCxSF/2023/creating-your-own-singing-voice-synthesizer/slides.pdf
_
Matthew Rice

Matthew Rice is a master's student at Queen Mary University of London, studying Sound and Music Computing with a focus on music production applications of deep learning. Previously, Matthew was at startup Mayk as a software engineer, working on both the audio engine and audio research teams. Matthew also has experience in digital hardware and embedded systems, having worked at Qualcomm designing PMICs and audio codec drivers.

Edited by Digital Medium Ltd - online.digital-medium.co.uk
_

Organized and produced by JUCE: https://juce.com/
_

Special thanks to the ADC Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper

#audiodevcon #audiodev #synthesizer

Filed under: UncategorizedTagged with: , , , ,