How it works
Good sound design is three jobs. Most AI setups only do a sloppy version of the middle one.
- Find real sounds. Openverse gives Claude a free library of over 5 million real recordings to search.
- Put them on the exact frame. Real SFX watches your video, finds every moment that should make a sound, and places a real recording on it.
- Check them, and make what doesn't exist. earshot lets Claude actually hear what it picked, and build a new sound from scratch when nothing real fits.
All three are free and open source. You paste one prompt into Claude Code and it sets up all of it, including a starter library of real sounds.
What you need
- Claude Code Or the Code tab in the Claude desktop app. Any paid plan.
- A Mac or Windows computer No GPU needed. Everything runs on your own machine.
- About 2 GB of free space Mostly earshot's two listening models.
- 15 to 20 minutes Most of it is downloads. You just watch.
You don't need to install Python, FFmpeg or anything else first. The prompt checks your computer and installs whatever is missing.
1. The one prompt that installs all 3
Open Claude Code (or the Code tab in the Claude desktop app) and paste this. It checks your computer, installs all three in the right order, fills your library with a starter pack of real sounds, tests each tool, and hands you a cheat sheet at the end.
It also dodges the 6 things that make this look installed when it isn't. Those are at the bottom if you want to know what they are.
Set up 3 free sound-effect tools for me, so you can add professional sound effects whenever you edit my videos:
1. Openverse: a free library of 5 million+ real recorded sounds. You'll search it and download from it.
2. Real SFX (by Clipwing): watches my video, finds every moment that should make a sound, and puts a real recording on the exact frame.
3. earshot (by Leonxlnx): gives you ears. You can describe a sound file in words, check if it fits, and build brand new sounds from scratch when nothing real exists.
I'm not a coder. Do every step yourself. Before each step, tell me in one plain sentence what you're about to do. Only stop when you actually need me (a password, or a yes/no).
STEP 0: Check my computer
- Tell me which operating system I'm on.
- Check for: Python 3.10 or newer, git, uv, FFmpeg and ffprobe. Install whatever is missing.
- Mac: install Homebrew first if it's missing (https://brew.sh). Then run: brew install python git uv ffmpeg-full
Then put ffmpeg-full first in my PATH by adding this line to ~/.zshrc and loading it: export PATH="$(brew --prefix ffmpeg-full)/bin:$PATH"
Check it worked: ffmpeg -filters | grep -E "drawtext|rubberband" must show BOTH filters. The plain "ffmpeg" formula doesn't have them, and Real SFX needs them.
- Windows: run winget install Python.Python.3.12, winget install Git.Git, winget install astral-sh.uv, winget install Gyan.FFmpeg. Then tell me to close and reopen the terminal so they load.
- Make one folder for all my sounds: ~/Sounds/SFX (on Windows: Sounds\SFX inside my user folder). Every sound from now on goes in there.
STEP 1: Openverse (no install, no account, no API key)
Openverse has a free public API at https://api.openverse.org/v1/audio/. Turn it into a skill so you always know how to use it. Create the file ~/.claude/skills/openverse-sfx/SKILL.md with exactly this:
---
name: openverse-sfx
description: Find and download free, real recorded sound effects from Openverse (5M+ sounds) for video edits. Use when I want a sound effect, a whoosh, a hit, a door slam, rain, typing, ambience, or "real sounds" for a video.
---
# Openverse SFX
Search with:
GET https://api.openverse.org/v1/audio/?q=<words>&license=cc0&length=short&page_size=20
Rules:
- Always use license=cc0. CC0 means free to use anywhere, commercially, with no credit needed. Only drop it if I say so.
- Use length=short for sound effects. Drop it for long ambience or background beds.
- Never add a "category" filter. It returns zero results right now.
- No key needed. The limits are 20 searches a minute and 200 a day, so search with intent. Don't loop.
- Each result has: title, creator, url (the audio file), foreign_landing_url (the page it came from), duration (in milliseconds), filetype.
- For hits, clicks, pops and whooshes, prefer results under 5 seconds (duration under 5000).
- If a search comes back thin, try 2 or 3 other words for the same sound (whoosh, swoosh, swish, air pass).
Downloading:
- Save the "url" file into ~/Sounds/SFX/<type>/ with a clean name, like whoosh-deep-01.mp3.
- Convert to WAV with ffmpeg if the edit needs it.
- Add a row for every download to ~/Sounds/SFX/CREDITS.csv: file, title, creator, license, source page.
- If earshot is installed, run "earshot match <file> '<what it should sound like>'" before using a download, and skip anything that comes back weak.
- If nothing on Openverse fits, make the sound with earshot instead.
Test it: search "whoosh" with license=cc0 and length=short, and show me the top 5 with their titles, lengths and source links.
STEP 2: Real SFX
- Download it: git clone --depth 1 https://github.com/Clipwing/skills into a temporary folder, copy its skills/real-sfx folder to ~/.claude/skills/real-sfx, then delete the temporary folder.
- Real SFX ships WITHOUT a sound library (only 78 free UI sounds), so fill mine first. Use the Openverse skill from Step 1 to download a CC0 starter pack into ~/Sounds/SFX, one subfolder per type, the best 6 to 8 short sounds each:
whoosh, swoosh, impact, hit, riser, pop, click, mouse click, keyboard typing, camera shutter, notification, cash register, paper, door, footsteps, rain, crowd cheer
That's 17 searches, well under the limit. Keep CREDITS.csv up to date as you go.
- Point Real SFX at the library. From inside ~/.claude/skills/real-sfx run (use python3 on a Mac):
python scripts/setup.py init --library main="<full path to my Sounds/SFX folder>" --uisfx --index
python scripts/setup.py check
Fix anything "check" complains about until it passes.
STEP 3: earshot
- Install it: uv tool install "earshot[mcp] @ git+https://github.com/Leonxlnx/earshot"
If "earshot" isn't found after that, run uv tool update-shell, then reopen the terminal.
- Download its 2 listening models up front (about 1.1 GB, a few minutes). Tell me before you start: earshot doctor --fetch
- Connect it to Claude Code for every project: claude mcp add earshot --scope user -e EARSHOT_THREADS=3 -- earshot mcp
- Add its skill so you know how to listen with it: git clone --depth 1 https://github.com/Leonxlnx/earshot into a temporary folder, copy skills/earshot to ~/.claude/skills/earshot, then delete the temporary folder.
- Test it: run earshot sfx list and pick a whoosh from the bank. Render it with earshot sfx render <id> -o ~/Sounds/SFX/whoosh/earshot-whoosh-01.wav. Then run earshot describe on that file and tell me, in plain words, what it says the sound is.
STEP 4: Check everything and give me a cheat sheet
- Show me a simple table: tool, installed (yes or no), and one thing I can type to use it.
- Tell me how many sounds are now in ~/Sounds/SFX.
- Tell me to fully restart Claude Code so the new skills and earshot load.
Rules for the whole setup:
- Only download Openverse sounds marked CC0.
- Never change anything else in my ~/.claude folder.
- If a step fails, read the error, fix it yourself, and try again. Only ask me if you're truly stuck, and tell me exactly what to click or type.
2. What each one actually does
1/ The library: Openverse
Built by the WordPress.org team, open source. Browse Openverse
Openverse is a free search engine for openly licensed media. Its audio side holds over 5 million real recordings, mostly pulled from Freesound and other open libraries. Real door slams, real rain, real keyboards, real crowds. Recorded by people with microphones, not made by an AI.
There's nothing to install. Openverse has a free public API, so the prompt writes Claude a small skill that teaches it how to search it, how to filter to sounds that are free to use anywhere, and where to save what it downloads. No account, no API key.
Find me 5 real door slam sounds on Openverse. CC0 only, under 3 seconds each. Download the best 2 into my sounds folder and tell me why you picked them.
2/ The sound designer: Real SFX
Built by Alexander Korbanov at Clipwing. View the repo
This is the one that actually edits. Give Claude a video and Real SFX finds the moments in the picture that should make a sound, picks real recordings from your library, puts each one on the exact frame, keeps your voice and music, and hands you a new MP4 plus the sound effects as their own WAV.
It also scores its own work (sync, balance, loudness) and then tells you the 5 moments to check by ear. Heads up: it ships with 78 free UI sounds and no big library. You bring the sounds. That's why the install prompt fills your library from Openverse first.
Add sound design to this render: [drag your video file in here]
3/ The ears (and the backup plan): earshot
Built by Leonxlnx. View the repo
Here's the problem nobody mentions: Claude can't hear. On its own, it picks sounds by their file names and hopes. earshot fixes that. It turns any sound into words Claude can reason about: what it sounds like, how well it fits what you asked for, and whether it lands on the cut or 80 milliseconds late.
And when the sound you want doesn't exist anywhere, earshot builds it from scratch in code, then listens back to the result and keeps improving it. It also comes with a bank of 252 ready-made sounds (pops, knocks, whooshes, risers, dings) that render in seconds.
Use earshot to make me a fast, crisp whoosh. Listen to your best 3 takes, describe each one to me in plain words, and save the best one to ~/Sounds/SFX/whoosh/.
3. Your first sound pass
This is where the three work together. Drop in a finished edit with no sound effects and paste this. Real SFX finds the moments, your library and Openverse supply the real sounds, earshot checks every pick and builds anything missing.
Add pro sound effects to this video: [drag your video file in here] 1. Watch it first. Use Real SFX to find every moment that should make a sound: cuts, text popping in, clicks, swipes, things landing, things leaving. 2. For each moment, pick a real sound from my library in ~/Sounds/SFX. 3. If my library doesn't have the right one, search Openverse for it (CC0 only), download the best one and add it to CREDITS.csv. 4. If it doesn't exist anywhere, build it with earshot. 5. Before you place anything, check your picks with earshot match against what each one should sound like. Swap out anything that comes back weak. 6. Put every sound on the exact frame. Keep my voice and music on top, and keep the effects under my voice. 7. Give me the new MP4, plus the sound effects as their own WAV track so I can adjust them in my editor. 8. Then give me the 5 moments I should listen to myself, with timestamps, and why.
Then actually listen to the 5 moments it gives you. Claude can measure a sound, but you're the one with real ears. If one sound is wrong, just tell it which one and what it should feel like instead ("the whoosh at 0:04 is too long and too airy, make it short and punchy").
Every sound you approve stays in your library, so every video after this one starts with a better set of sounds than the last.
The 6 things that quietly break this
None of these throw a clear error. They just make a tool sit there doing nothing while you assume it's working. The install prompt handles all six.
- Real SFX comes with almost no sounds The free version ships with 78 UI sounds and nothing else. If you install it and ask for a whoosh, it has nothing to pick from. The install prompt fixes this by pulling a starter pack of real CC0 sounds from Openverse into your library first, sorted by type.
- The normal FFmpeg on a Mac is missing two filters If you install FFmpeg with plain brew install ffmpeg, Real SFX breaks on its frame sheets and pitch shifts. It needs ffmpeg-full, put first in your PATH. The prompt installs the right one and checks both filters are there.
- One Openverse filter returns nothing Openverse's API has a category filter for sound effects. Right now it returns zero results for everything. Claude will try it, see nothing, and tell you there are no whooshes in a library of 5 million sounds. The skill tells it never to use that filter.
- Openverse lets you search 200 times a day No account means a limit: 20 searches a minute, 200 a day. That's plenty for editing, but not if Claude loops a search over and over. The skill tells it to search with intent and try a few other words when a search comes back thin.
- earshot downloads 1.1 GB the first time earshot runs two listening models on your own computer, no GPU needed. The first run downloads them, which takes a few minutes. After that it's offline. If Claude Code times out waiting for it on an older laptop, start Claude Code with MCP_TIMEOUT=60000 in front of the command.
- CC0 and CC BY are not the same Lots of Openverse sounds are CC BY, which means you have to credit the creator every time you use them. CC0 means free to use anywhere with no credit. The whole setup only grabs CC0 so you never have to think about it. It still keeps a CREDITS.csv of where every sound came from.
I didn't build any of these
All three are other people's work, given away free. The only things here that are mine are the install prompt, the Openverse skill and the list of things that break.
Openverse is an open-source project run by WordPress. The sounds belong to the people who recorded them. Real SFX is by Alexander Korbanov at Clipwing, released under MIT. earshot is by Leonxlnx, released under MIT.
If these save you real time, go star the repos. That's the whole payment these people asked for.