Glossary#
- sample#
A single value in a time series. In audio, this corresponds to the amplitude of the waveform at a given point in time.
- sampling rate#
The number of samples per second of a time series. This is denoted by a positive number sr.
- time series#
Typically an audio signal, denoted by y, and represented as a one-dimensional numpy.ndarray of floating-point values. y[t] corresponds to amplitude of the waveform at sample t.
- frame#
A short slice of a time series used for analysis purposes. This usually corresponds to a single column of a spectrogram matrix.
- window#
A vector or function used to weight samples within a frame when computing a spectrogram.
- frame length#
The (positive integer) number of samples in an analysis window (or frame). This is denoted by an integer variable n_fft.
- hop length#
The number of samples between successive frames, e.g., the columns of a spectrogram. This is denoted as a positive integer hop_length.
- window length#
The length (width) of the window function (e.g., Hann window). Note that this can be smaller than the frame length used in a short-time Fourier transform. Typically denoted as a positive integer variable win_length.
- Fourier transform#
- DFT#
- FFT#
A mathematical operation that transforms a time-domain signal into a frequency-domain representation. The discrete Fourier transform (DFT) is typically computed using the fast Fourier transform (FFT) algorithm.
- STFT#
The short-time Fourier transform (STFT) is a sequence of Fourier transforms of windowed frames of a time series. The STFT is typically represented as a complex-valued matrix D, where the rows index frequency bins, and the columns index frames (time).
- spectrogram#
A matrix S where the rows index frequency bins, and the columns index frames (time). Spectrograms can be either real-valued or complex-valued. By convention, real-valued spectrograms are denoted as numpy.ndarrays S, while complex-valued STFT matrices are denoted as D.
- magnitude#
A complex number z can be expressed as a combination of real and imaginary parts, \(z = a + jb\) (where j represents the imaginary unit). The magnitude of z is the distance from the origin as computed by the Pythagorean theorem: \(|z| = \sqrt{a^2 + b^2}\).
- phase#
The phase of a complex number \(z = a + jb\) is the angle between the positive real axis and the line connecting the origin to the point (a, b) in the complex plane. The phase is computed as \(\phi = \arctan(b / a)\).
- decibel#
- dB#
A logarithmic unit used to express the ratio of two values, typically power or intensity. In audio, decibels are often used to represent the amplitude of a signal relative to a reference level.
- dBFS#
Decibels relative to full scale (dBFS) is a unit of measurement for amplitude levels in digital audio systems. 0 dBFS represents the maximum possible digital level, while negative values indicate lower amplitudes.
- frequency bin#
In a discrete Fourier transform (DFT) representation, the signal is represented as a combination of sinusoidal components at a finite set of frequencies. Each frequency index k corresponds to a frequency bin.
- fundamental frequency#
- f0#
The fundamental frequency (f0) is the lowest frequency of a periodic waveform, and is often perceived as the pitch of the sound. Note that not all waveforms are periodic.
- pitch#
The perceived frequency of a sound, which is often associated with the fundamental frequency (f0) of a periodic waveform. In music, pitch is typically represented as a note name (e.g., A4, C#5) or as a MIDI note number.
- pitch class#
A pitch class is a set of all pitches that are a whole number of octaves apart. For example, the pitch classes for the note C include C, C1, C2, C3, etc. In Western music, there are 12 pitch classes corresponding to the 12 notes in the chromatic scale.
- chroma#
- pitch class profile#
Chroma representations measure the amount of relative energy in each pitch class (e.g., the 12 notes in the chromatic scale) at a given frame/time.
- onset#
The beginning time of a musical note or sound event.
- onset (strength) envelope#
- novelty function#
- novelty curve#
An onset envelope onset_env[t] measures the strength of note onsets at frame t. Typically stored as a one-dimensional numpy.ndarray of floating-point values onset_envelope.
- tempo#
The speed of a piece of music, typically measured in beats per minute (BPM).
- beat#
A beat is a basic unit of time in music, often corresponding to a regular pulse that listeners can tap their foot to.
- cqt#
The constant-Q transform (CQT) is a time-frequency representation of a signal that uses logarithmically spaced frequency bins with window lengths scaled inversely with frequency.
- mel scale#
The mel scale is a perceptual scale of pitches that approximates the human ear’s response to different frequencies. The mel scale is approximately linear below 1 kHz and logarithmic above 1 kHz.
- mel spectrogram#
A mel spectrogram is a time-frequency representation of a signal where the frequency axis is transformed to the mel scale.
- mel frequency cepstral coefficient#
- MFCC#
Mel-frequency cepstral coefficients (MFCCs) are a representation of the short-term power spectrum of a sound, based on a linear cosine transform of a log power mel spectrogram. MFCCs are commonly used as features in speech and audio processing.
- tempogram#
A representation of the rhythmic structure of a piece of music over time. It measures the strength of periodicities in the onset envelope, using either autocorrelation or Fourier analysis.
- recurrence matrix#
- self-similarity matrix#
A square matrix that measures the similarity between features at all pairs (i, j) of time or frame indices.
- beat synchronous features#
Beat-synchronous features are computed by aligning and aggregating features over detected inter-beat intervals.
- multi-channel audio#
Audio signals that contain more than one channel, such as stereo (2 channels) or surround sound (5.1 channels). Multi-channel audio is typically represented as a two-dimensional numpy.ndarray of shape (n_channels, n_samples).
- MIDI#
Musical Instrument Digital Interface (MIDI) is a technical standard that describes a protocol, digital interface, and connectors for communicating musical performance data between electronic musical instruments, computers, and other related devices.
- MIDI number#
A MIDI number is an integer value that represents a specific musical note in the MIDI standard. For example, the MIDI number for middle C (C4) is 60. This is sometimes extended to fractional values to allow representation of all frequencies.
- Scientific Pitch Notation#
- SPN#
Scientific Pitch Notation (SPN) is a standardized system for naming musical notes based on their pitch class and octave number.
- accidental#
An accidental is a musical notation symbol that indicates the alteration of a pitch. Common accidentals include sharps (#), flats (b), and naturals (♮).
- cent#
One one-hundredth (1/100) of a semitone in the 12-tone equal temperament scale.
- A440#
A tuning standard that defines the pitch of the musical note A4 (the A above middle C) as 440 Hz.
- 12TET#
A musical tuning system that divides the octave into 12 equal parts (semitones), commonly used in Western scales.
- Just intonation#
A musical tuning system that uses simple whole-number ratios to determine the frequencies of notes, resulting in consonant intervals.
- svara#
A pitch in Indian classical music, which can be thought of as a note in the context of a raga.
- Sa#
The tonic svara in Indian classical music.
- thaat#
A system of classifying ragas in Hindustani classical music based on their scale and note patterns.
- melakarta#
- mela#
A system of classifying ragas in Carnatic classical music based on their scale and note patterns.