Crafting Better Generative Music in Games with Deep Learning
While the procedural generation of mechanical or visual content is widely adopted within the games industry, procedural music generation is utilised much less. There are a variety of reasons why procedural music has not seen similar levels of adoption, especially in the advent of large language models and Generative AI tools such as ChatGPT and Midjourney, where public opinion on machine learning for creative arts and music is particularly controversial. However, there are ethical, and responsible ways to empower composers and music designers, and even improve procedural music systems with machine and deep learning. The adoption of such technology, if used correctly, could reduce burnout and provide novel experiences for players.
In this talk, I will introduce the audience to the basics of machine learning, before presenting multiple peer reviewed studies from my PhD investigating how deep learning can be used to generate: additional layers for bespoke pre-composed game music; expressive performances of MIDI during game play; and outline ethical and responsible design considerations for AI powered game audio tools.
Kyle Worrall
PhD Candidate
University of York
Kyle is an audio machine learning consultant and a lecturer in Games Programming at Edge Hill University. As a final-year PhD candidate with the Centre for Doctoral Training in Intelligent Games and Game Intelligence at the University of York, Kyle is at the cutting edge of research in his field. His work delves into the creation of ethical and responsible deep learning-driven music tools, exploring their transformative impact on professional composers and player experiences within video games.
Passionate about blending technology and creativity, Kyle's research has extended to his role as founder of Cocreative Technology, a tech start-up dedicated to developing responsible tools for musicians and sound designers. Cocreative Technology focuses on creating software that assists artists by automating mundane tasks, enabling them to channel their energy into the creative aspects of their work. The start-up is driven by the belief that technology should enhance and support, not replace, human creativity.