IIntroduction
Course and exam description. Motivation of digital audio processing.
Review of the basic concepts of DSP.
Elements of acoustics and psychoacoustics
Introduction to acoustics and sound propagation.
Elements of psychoacoustics. The human hearing system.
Beats. Consonance and dissonance. Critical bands.
Harmony, notes, pitch, timbre.
Tuning systems.
Introduction to room acoustics.
Sound analysis tools
A/D, D/A conversion of the audio signal.
The Discrete Time Fourier Transform (DFT). Windowing. The Short-Time Fourier Transform (STFT).
Sub-band decomposition and STFT.
Sound synthesis and modeling
Resolution of sinusoidal signals and windowing, Spectral interpolation.
Additive synthesis, sinusoidal peaks tracking, sinusoidal modeling.
Sound synthesis: additive and subtractive synthesis, granular synthesis, wavetable synthesis, nonlinear distortion (phase/frequency modulation).
Introduction to physical sound modeling for timbral synthesis.
Basic Audio Features
Low-level descriptors (Time Domain, Spectral and Timbral), Sound Classification and similarity.
Audio features. Time-frequency localization.
Pitch features. Chroma features.
Digital audio effects and 3D audio
Modulated digital delay lines, sound effects, reverberation and spatialization algorithms, binauralization, head-related transfer function, multi-channel processing, ambisonics.
Equalization: typical structures for equalization.
Fundamentals of microphone array signal processing.
Introduction to the speech signal
Acoustic theory of speech production. Analysis and modeling of the speech signal. Introduction to speech recognition, synthesis and coding.
Examples and concluding remarks
Audio retrieval. Cover song identification.
Music representation. Introduction to audio and speech coding (CELP, MP3, AAC, ...).
Examples of music instruments models.
Concluding remarks.