Real-Time, Low Latency and High Temporal Resolution Spectrograms
This talk describes the proof of concept implementations of Resonate, a low latency, low memory footprint, and low computational cost algorithm to evaluate perceptually relevant spectral information from audio signals. A walk through the open source Swift, C++ and Python implementations outlines the basic principle of the algorithm, highlights critical implementation design elements and areas for potential improvements. The talk also features a few illustrative real-time audio analysis applications.
Alexandre R.J. Francois
Independent
Interactions Intelligence
Alex is a computer scientist and software engineer. His academic research focused on the modeling and design of interactive (software) systems, as an enabling step towards the understanding of perception and cognition. His interdisciplinary research projects explored interactions within and across music, vision, visualization and video games. After working in startups and larger companies for several years, he has recently dedicated some week-ends and extended holidays to the pursuit of real-time, low latency, high temporal and frequency resolution spectral analysis of audio (and other) signals. www.alexandrefrancois.org