AIST2010 Introduction to Computer Music

Course Description

This course aims to present an overview of computer music for students with basic programming abilities. The course starts with fundamental audio analysis and synthesis, and finally progress towards algorithmic music generation with machine learning. Hands-on exercises also cover software toolboxes for music information retrieval and programming.

Next offering: Fall 2023

---

Lecture Videos (Fall 2019)

Course Materials

Lecture 1: Introduction to Computer Music

Lecture 2: Music in Real Life vs. Music in Digital World

Lecture 3: Audio Analysis and Visualization

Lecture 3P: MATLAB Programming

Lecture 4: Music Information Retrieval

Lecture 4P: MIR Programming with MiningSuite

Lecture 5: Sound Synthesis

Lecture 5P: CSound Programming

Lecture 6: Audio Filters and Effects

Lecture 7: More on Music Data Mining

Lecture 8P: Web Audio API

Lecture 9: A Primer to Machine Learning

Lecture 10P: Visual Programming: MaxMSP

Lecture 11: Algorithmic Composition

---

Student Projects

Fall 2022

• Music Reprocessing
• 8-bit music analysis
• Keyboard synthesizer
• Information Hiding Using Audio Steganography
• Classical music generation with AI
• Steganography
• Noise cancellation with Fourier Transformation
• Creating music with different sounds
• Color Organ
• Text-to-speech using machine learning
• Remaking Music in SuperCollider
• Vocal and Instrument Separation with Deep Neural Network
• Music VAE
• Music rhythm game by synthesizing drum set

Fall 2021

• Music Genre Classification
• Implementation of Music Game
• Instrument Recognition
• Song Recognition Application
• Noise Suppression on Musical Pieces Using Spectral Gating and Spectral Subtraction
• Voice Changer
• Building a Synthesizer in Max8
• Rhythm Game with Procedural Chart Generation
• Playing music with stepper motor
• Simple Synthesis and Effects in Librosa Based on Numpy
• Classical Music Generator
• Music Creation with SuperCollider
• Recover music from AI MIDI transcription to Tone.js
• Conversion from Digital Image into Audio Filter in terms of Image Texture and Colour Characteristics
• Exploring Automatic Karaoke Scoring Systems
• Music Generation from Text using Algorithmic Composition
• Accompaniment Auto-generation
• Music mood prediction with deep learning
• Guitar tuning app using pitch detection and audio analysis
• Web Piano

Fall 2020

• Finger Drumming/ Sample to midi – er
• Pop song structure analyzer
• Rhythm game with sound control
• Generate a phrase of music for piano with simple visualization
• Man-to-girl voice changer
• Rhythm game of new visuals or mechanics
• Web app about Loopstation/ DJ mixer/ Effects and Filters
• Composition with synthetic voices
• Accompaniment generator for pop songs
• YeeTube (meme generator)
• Web app of music instrument simulator
• Single Track wav to midi
• Chord Identifier and Visualizer on Piano
• Rhythm Generator
• Harmonization of Music
• A user-friendly synthesizer plug-in for DAW
• Chord recognizer
• Exploring Attack on Siri
• Lo-fi music plugin for Audacity
• Audio Deepfakes

Fall 2019

• Music Generation by Machine Learning
• iOS Sound Synthesis and Visualization
• Music Visualizer
• Melody Transcription from Human Voice and Musical Instruments
• Image Processing on Music
• Music Compare
• Mini Orchestra on Micro:bit
• Sound File Transcription to Music Score
• Emotion Play
• Hardware MIDI Keyboard Simulator
• Two-Dimensional Room Acoustics Simulation using Ray Tracing
• Building a Synthesiser Plugin based on JUCE Framework
• CSound GUI Frontend
• Rhythm Game

Useful References

• C. Roads, The computer music tutorial. Cambridge, Mass: MIT Press, 1995.
• M. Müller, Fundamentals of music processing. Cham: Springer, 2015.
• V. Lazzarini et al., Csound. Cham: Springer, 2016.
• V. Lazzarini, Computer Music Instruments. Cham: Springer, 2016.
• J. Burg, J. Romney and E. Schwartz, "Digital Sound & Music - Concepts, Applications, and Science", Digital Sound & Music, 2014. [Online]. Available: http://digitalsoundandmusic.com.