IntermediateTopic 40 of 101Signals, Control & Comms
Audio and speech processing
Compression, recognition and synthesis of sound.
In depth
Speech and audio processing includes sampling, pre-emphasis, framing, MFCC features, linear prediction, codecs (MP3, AAC, Opus), noise reduction, beamforming, speech recognition and synthesis. Psychoacoustic masking enables lossy compression.
Key points
- Short-time Fourier transform
- Mel scale
- Codec bit rate vs quality
ExampleMP3 removes sounds the ear cannot hear because of masking.
What is Audio and speech processing?
Compression, recognition and synthesis of sound.
Why is it important to understand audio and speech processing?
Audio and speech processing turn sound into data for communication, recognition and synthesis, which shapes products from phones to assistants.
What is perceptual coding?
Compression that removes sounds the human ear cannot hear well, such as masked frequencies, to save bits.
How is speech recognised?
Features are extracted from the audio and matched with acoustic and language models, often using neural networks in modern systems.
How is Audio and speech processing used in practice?
Typical applications include compressing music into a smaller file with a perceptual codec, recognising spoken commands on a smart speaker and synthesising speech for an automated announcement system.
What should I learn before Audio and speech processing?
Study "Image processing basics" first (topic 39 of 101 in Signals, Control & Comms). It covers the groundwork this topic builds on.
What are the key points of Audio and speech processing?
Short-time Fourier transform. Mel scale. Codec bit rate vs quality.
Can you give an example of Audio and speech processing?
MP3 removes sounds the ear cannot hear because of masking.
What comes after Audio and speech processing?
The next topic is "Random signals and noise", which builds directly on this one.
How difficult is Audio and speech processing?
It is classed as Intermediate in Signals, Control & Comms (topic 40 of 101). It is an intermediate topic. Work through the beginner topics in Signals, Control & Comms first.