https://audio.dev/ -- @audiodevcon
---
Mind-Matched Audio - Revolutionizing the Reading Experience through Real-Time Sound Synchronization - Luigi Cosi - ADC 2024
---
Step into the future of digital reading, where sound and text intertwine to transform stories into an immersive auditory adventure. This talk explores how synchronizing audio with the cognitive reading process creates a revolutionary experience. We leverage eye-tracking technology, sophisticated algorithms, and real-time audio processing to determine the optimal timing for soundscapes that synchronize with the reader's imagination, enhancing engagement. Learn about our journey of inventing a digital audio workstation (DAW) tailored specifically for the reading experience—something that previously did not exist. This foundational DAW lays the groundwork for how such a tool would look like for this purpose, allowing audio to be triggered dynamically based on the reader's pace and imagination, overcoming challenges in audio production, from creating flexible assets to ensuring continuity for non-linear reading. Our experiments show how well-timed audio cues can reduce gaze duration by 63%, enhancing both speed and comprehension. We’ll also explore future possibilities using machine learning to generate adaptive soundscapes. Join us for a live demonstration and discover how this innovation could transform reading, opening new possibilities for e-books, journalism, and beyond.
---
Luigi Cosi
Luigi Cosi is the founder and CEO of OIKLA, where he focuses on creating innovative audio technology that blends high-quality sound with hearing safety. With a background in sound engineering and a personal experience with tinnitus, Luigi developed a passion for making audio experiences that are both immersive and safe. He led the development of OIKLA's patented audio processing technology, designed to deliver balanced sound at any volume. His practical approach and dedication have helped OIKLA gain recognition in the industry, including a successful showcase at CES 2024 and partnerships with leading audio brands.
---
ADC is an annual event celebrating all audio development technologies, from music applications and game audio to audio processing and embedded systems. ADC’s mission is to help attendees acquire and develop new audio development skills, and build a network that will support their audio developer career.
Annual ADC Conference - https://audio.dev/
https://www.linkedin.com/company/audiodevcon
https://twitter.com/audiodevcon
https://facebook.com/audiodevcon
https://instagram.com/audiodevcon
https://www.reddit.com/r/audiodevcon/
https://mastodon.social/@audiodevcon
---
Streamed & Edited by Digital Medium Ltd: https://online.digital-medium.co.uk
---
Organized and produced by JUCE: https://juce.com/
---
Special thanks to the ADCxGather Team:
Sophie Carus
Derek Heimlich
Andrew Kirk
Bobby Lombardi
Tom Poole
Ralph Richbourg
Jim Roper
Jonathan Roper
Prashant Mishra
#digitalreading #audiosync #daw #adc #audiodev #dsp #audio #conferenceaudio #audioprocessing #audioproduction #audioprogramming #musictech #soundtech #audiotech #audiotechnology