Tag: programming

Shrink Your Virtual Analog Model Neural Networks! – Christopher Clarke – ADCxGather 2024

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​
---

Shrink Your Virtual Analog Model Neural Networks! - Christopher Clarke - ADCxGather 2024
---

Capturing the complex nonlinear behaviors of analog circuits in virtual analog modeling is a significant challenge. Selecting the appropriate neural network size and architecture for these function approximation tasks currently relies heavily on trial-and-error methods like grid search. These approaches are time-consuming, computationally intensive, and lack a solid theoretical foundation, often resulting in oversized models that are inefficient and impractical for real-time applications. This talk introduces ideas for a framework that systematically determines optimal neural network architectures for modeling. The talk will speak about examining the geometric structures and symmetries in the complexity of the model, and the designation of neural network architectures that replicate these systems while focusing on efficient resource utilization. This approach centers specifically on function approximation, tailoring the network architecture to the mathematical functions underlying the model. Large networks memorize training data instead of learning underlying patterns, leading to poor generalization; additionally, oversized networks consume excessive computational resources, resulting in increased memory usage, adding to the challenge of hardware limitations and the necessity for low-latency responses as code, code as a compiler, and the output as a function. This perspective aims to streamline the development process and enhance the practical deployment of neural networks in audio signal processing.
---

Christopher Clarke

Graduated PhD in with research in Artificial Intelligence (DSP) from the Singapore University of Technology and Design (Science, Math, and Technology Cluster) – President’s Fellowship Program & Computer and Information Sciences (CIS) Scholarship. Member of the Interdisciplinary Audio and Acoustics Research Group at SUTD. My passion lies with low-latency audio plugin/framework implementations, particularly for applications that have traditionally been deemed otherwise. My PhD's research focuses on the AI/ML technologies to run extremely low-latency (microsecond and below) audio processing, even on low-compute devices such as embedded microcontrollers or System-on-a-Chip. As a Music Technologist with focus on generative algorithms and stochastic modelling for music generation, I have presented fixed site-specific installations and deployed software libraries on music generation
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADCxGather Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#ai #neuralnetworks #neuralnetwork #adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , ,

KEYNOTE: Foundation Models Don’t Understand Me – Lessons From AI Lutherie for Live Performances – Manaswi Mishra

  • Lobby
  • Tag Archives: programming

https://audio.dev/ -- @audiodevcon​
---

Keynote: Foundation Models Don’t Understand Me - Lessons From AI Lutherie for Live Performances - Manaswi Mishra - ADC 2024
---

Living in a world of rapidly accelerating synthetic media, the outputs of generative AI often leave us feeling frustrated, amused, and even manipulated. Early examples of creative AI tools struggle to go beyond imitating styles and patterns, producing a context-less blend of borrowed aesthetics from the datasets they’re trained on. This race to the statistically average flattened aesthetic, misunderstands the core goals of creative expression. In contrast, Audio developers and Instrument builders understand the importance of providing a toolkit of exploration, intentional serendipity and discovery to a new age of artists performing with AI. In my work of building AI musical instruments for live Opera, Symphony and Installations, I share a framework of frustrations and guidelines for AI instrument building.
---

Slides: https://data.audio.dev/talks/2024/foundation-models-dont-understand-me/slides.pdf
---

Manaswi Mishra

Manaswi Mishra is a LEGO Pappert Fellow and a current PhD research assistant in the Opera of the Future group, MIT Media Lab. His research explores strategies and frameworks for a new age of composing, performing and learning music using A.I. centered on bespoke human intent. He joined the MIT Media Lab in 2019 and completed his MS in Media Arts and Science, developing his work “Living, Singing A.I”, to empower bespoke A.I. music making with just the human voice. His AI instruments have been featured in Opera and Symphony performances like VALIS (2023), Brain Opera (2022), Flow Symphony (2024). His work has been published and exhibited in the MIT Press, Harvard Tech Review, Washington Post, Boston Globe, Conferences of Computational Creativity, ISEA Brisbane, IFA Stuttgart, CVPR 2024, Burning Man 2023, Copyright Society 2023, Bloomberg Law, Seoul Arts Center, etc.

Prior to joining MIT, he did a Masters in Music Technology at UPF, Barcelona and Bachelors in Technology at the Indian Institute of Technology Madras. He is passionate about a creative future where every individual can express, reflect, create and connect through music. Manaswi is also a founding instigator of the Music Tech Community in India and has organized workshops, hackathons and community events to foster a future of music and technology in his home country. In his free time, Manaswi loves collecting weird sounds.
---

ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---

Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---

Organized and produced by JUCE: https://juce.com/
---

Special thanks to the ADC24 Team:

Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra

#ai #artificialintelligence #artificialintelligencetechnology #adc #audiodev #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology

Filed under: UncategorizedTagged with: , , ,