Low Latency, High Temporal and Frequency Resolution Spectral Analysis of Audio Signals
All About That Phase
This talk presents extensions to the Resonate model introduced last year for the real-time computation of high temporal resolution spectrograms with low latency. By using phase information, starting with known techniques from the world of phase vocoder, it is possible to go further, namely estimate and track instantaneous frequencies, build tracking resonators and self-tuning resonator banks, and accurately extract the frequency components actually present in the input signal. The Resonate model allows to implement and use vocoder techniques more effectively and efficiently than traditional FFT-based implementations. The talk outlines and illustrates the theory, addresses efficient implementation, and showcases applications from high temporal and frequency resolution spectrograms to re-synthesis with temporal and/or frequency manipulations.
Alexandre R.J. Francois
Independent
Interactions Intelligence
Alex is a computer scientist and software engineer. His academic research focused on the modeling and design of interactive (software) systems, as an enabling step towards the understanding of perception and cognition. His interdisciplinary research projects explored interactions within and across music, vision, visualization and video games. After working in startups and larger companies for several years, he has recently dedicated some week-ends and extended holidays to the pursuit of real-time, low latency, high temporal and frequency resolution spectral analysis of audio (and other) signals. www.alexandrefrancois.org