Audio MCP Server

Gives LLMs ears. Spectral, harmonic, rhythm, stereo, and structural audio analysis.

Local serverstdioPython

What is the Audio MCP Server?

Gives LLMs ears. Spectral, harmonic, rhythm, stereo, and structural audio analysis.

What it actually does

Point Claude at any audio file and it can tell you the key, tempo, dynamics, timbre, percussive character, stereo field, structural sections, and how the music evolves over time -- all from raw audio analysis, no images, no guessing, under 1% context window usage.

LLMs can see (vision) and read (text), but they can't hear. This project bridges that gap by running real audio analysis -- the same DSP techniques used in music information retrieval research -- and returning structured numerical data that Claude can reason about.

  • Audio decoding — -- mp3, wav, flac, ogg, aac via Symphonia (pure Rust)
  • Spectral analysis — -- centroid (brightness), bandwidth (richness), rolloff, flatness (tonality)
  • Frequency band energy — -- RMS energy across 7 standard producer bands (sub-bass through brilliance) for mix diagnosis
  • Spectral contrast — -- peak vs valley per band in dB, reveals clarity vs muddiness
  • Dynamic range — -- crest factor, loudness range (95th-5th percentile), peak dBFS
  • LUFS loudness — -- EBU R128 integrated loudness (ITU-R BS.1770-4 stereo channel summing), true peak (dBTP), loudness range (LRA), streaming platform targets. Validated to 0.0 dB of FabFilter Pro-L 2

Recorded tools

  • audio_info — Basic file info: duration, sample rate, sample count
  • spectral_features — Brightness, richness, loudness, texture, timbre (MFCCs), frequency band energy, spectral contrast, dynamic range, LUFS loudness, stereo field
  • harmonic_analysis — Key detection, pitch class distribution, tonnetz
  • rhythm_analysis — Tempo (BPM), beat positions, tempo stability
  • full_analysis — Everything above in one call, plus percussive character (HPSS), stereo field, and section boundaries. Recommended workflow: call without resolution first to get summary + section map, then zoom into interesting sections
  • compare — A/B two tracks -- analyses both and returns a compact diff table

More MCP options

Compare MCP servers by category, or browse hosted MCP servers if you prefer an endpoint over a local process.

Maintainer setup documentation.

Recorded tools

Check the linked publisher documentation and your connected client's tool list. Names and availability can vary with the server version and account permissions.

ToolWhat it does
audio_infoBasic file info: duration, sample rate, sample count
spectral_featuresBrightness, richness, loudness, texture, timbre (MFCCs), frequency band energy, spectral contrast, dynamic range, LUFS loudness, stereo field
harmonic_analysisKey detection, pitch class distribution, tonnetz
rhythm_analysisTempo (BPM), beat positions, tempo stability
full_analysisEverything above in one call, plus percussive character (HPSS), stereo field, and section boundaries. Recommended workflow: call without resolution first to get summary + section map, then zoom into interesting sections
compareA/B two tracks -- analyses both and returns a compact diff table

Example prompts to try

  • “Use Audio to audio info.”
  • “Use Audio to spectral features.”
  • “Use Audio to harmonic analysis.”

Frequently asked questions

Gives LLMs ears. Spectral, harmonic, rhythm, stereo, and structural audio analysis. Confirm the tools offered by your installed version in the connected client. Tool availability and permissions depend on the server and account configuration.