Guides

How to clean up audio in phone videos without a robotic voice

Remove café and street noise from phone videos without a robotic voice: how AI speech enhancement works, filming habits, and loudness for Reels.

Key takeaways
  • AI speech enhancement separates your voice from the noise, but it works best on a recording that was decent to begin with.
  • Too much processing makes a voice sound metallic or robotic, so start with moderate strength and lower it if the voice changes.
  • Getting the mic closer to your mouth beats any cleanup tool: a lav on the chest or a phone framed closer helps more than a plugin.
  • Instagram publishes no official loudness target; around -14 LUFS with peaks below -1 dBTP is a safe, widely used reference.
  • Order matters: cut first, clean the voice, add music, then set loudness last.

To get clean audio from a phone video, do two things: record with the microphone as close to your mouth as you can, then use AI speech enhancement at moderate strength to push café or street noise into the background. Finish by setting the overall loudness to around -14 LUFS so your Reel is not quieter or louder than everything around it. The trick is restraint: too much cleanup makes a voice sound metallic, which viewers notice faster than a little background hum.

Below is how the tools work, why they sometimes ruin a voice, what to do while filming, and a simple order of operations you can repeat on every clip.

What noise suppression actually does

Classic noise reduction learns what the "noise floor" sounds like (the hum of a fridge or air conditioner) and subtracts it. It is great for steady sounds and weak against sounds that change, like clinking cups, a passing scooter or people talking at the next table.

AI speech enhancement works differently. A model trained on lots of speech tries to separate "voice" from "everything else" and rebuilds the voice on its own. That is why tools like Adobe Podcast Enhance Speech and Descript Studio Sound can rescue recordings that older filters could not, reducing noise and echo at the same time.

The hardest case is other people's voices. When Production Expert tested DaVinci Resolve's Voice Isolation against noisy backgrounds, both tools they compared did very well overall, but in a park recording they sometimes treated background voices as the dialogue to keep. A busy café is the same problem: the noise is also speech.

The option already on your phone

If you film on a recent iPhone, check Audio Mix before installing anything. In Apple's Photos guide, "Studio" reduces background sound and reverb, "In-Frame" reduces voices and sounds from sources you cannot see in the shot, and an Intensity slider controls the strength. Apple notes this works on videos captured on iPhone 16 or later (except iPhone 16e).

Why over-processing makes you sound like a robot

Every enhancer has to guess which parts of the sound belong to you. Push it hard and it starts removing pieces of your voice too: soft consonants, breaths, the natural room around you. The result is that thin, metallic, slightly "underwater" sound people describe as robotic.

Even the tool makers say so. Adobe's own guide recommends keeping the default level in most cases and, if the speech sounds too robotic, lowering it by one notch. Descript gives you an Intensity slider for the same reason.

Tip: Clean until the voice is clearly in front, then stop. A trace of café ambience sounds real. A voice floating in perfect silence sounds generated, especially on a clip where we can see a busy room behind you.

Signs you went too far: - "S" and "t" sounds are softer or lisped. - Breaths disappear completely, so sentences crash into each other. - The voice pumps: noise vanishes while you talk and rushes back in pauses. - Your voice sounds like a different, thinner person.

Common tools and the control to watch

All of these can produce good results. The difference is mostly where you already edit.

Tool What it does The control to watch
iPhone Audio Mix (Photos) Studio and In-Frame modes reduce background sound and off-screen voices Intensity slider
Adobe Podcast Enhance Speech AI voice cleanup for audio and video files, export stays in sync Strength level: lower one notch if robotic
Descript Studio Sound Reduces noise and echo on recorded speech, applied to the whole file Intensity slider
DaVinci Resolve Voice Isolation AI dialogue separation in the paid Studio version Amount knob; may confuse background voices with yours
CapCut noise reduction One-click background noise cleanup inside the editor CapCut itself notes results depend on the original recording

Before you hit record: habits that save the audio

No plugin can fully rebuild a voice that was buried in noise. These habits cost seconds and make the cleanup gentle instead of aggressive.

  1. Choose the quietest corner, not the prettiest one. Sit away from the espresso machine, speakers and the street side of the room. Hard walls and glass add echo; soft furniture absorbs it.
  2. Get the mic closer. Distance is the biggest factor you control. RØDE suggests clipping a lavalier mic on the chest about a hand-span, 20 to 30 cm, from the mouth. With the phone mic alone, frame a little tighter so the phone sits nearer to you.
  3. Watch for rustle. Keep a lav mic clear of fabric that can rub against it. RØDE warns that this rubbing will be audible in the recording.
  4. Block the wind. Outdoors, use the foam or fur windshield, or turn your back to the wind so your body shields the mic.
  5. Do a short test and listen with headphones. Ten seconds of speech tells you more than the phone speaker ever will.
  6. Keep a copy of the raw file. If a cleanup goes wrong, you want the original, not a version that was already processed.
Raw talking-head clip filmed on a phone, before any editing
Raw talking-head clip filmed on a phone, before any editing

Loudness: what -14 LUFS means

LUFS (Loudness Units relative to Full Scale) measures how loud a whole clip feels to a listener, not just its highest peak. Platforms use it to even out volume between videos or songs, and editors use it so their work does not jump out as too quiet or too loud.

Instagram does not publish an official loudness target for Reels (we could not find one). The most common reference comes from music streaming: Spotify's default playback level is -14 LUFS, with true peaks kept below -1 dBTP. For spoken audio, Apple Podcasts asks for about -16 LKFS, plus or minus 1 dB, with peaks at or below -1 dBFS, measured with the ITU-R BS.1770 standard.

Reference Integrated loudness Peak limit
Spotify default playback -14 LUFS below -1 dBTP
Apple Podcasts -16 LKFS (±1 dB) at or below -1 dBFS
Our practical target for speech-led Reels around -14 LUFS below -1 dBTP

In practice, aim for around -14 LUFS with peaks under -1 dBTP. Most editors have a loudness or "normalize" setting; set it as the very last step, after music and sound effects are in.

Note: Loudness and clarity are different problems. A loud but muddy voice is still hard to follow. Fix the voice first, then the level.

A repeatable cleanup order

  1. Cut first. Remove pauses, stumbles and retakes before touching the sound, so you do not process audio you will delete anyway. Our guide on removing pauses and filler words covers how.
  2. Clean the voice at default or moderate strength.
  3. Compare with the original for a few seconds, on headphones and on the phone speaker.
  4. Add music low under the voice. If you have to strain to hear the words, the music is too loud.
  5. Set loudness last, around -14 LUFS.
  6. Add captions. Even perfect audio will not reach people scrolling with the sound off; Adam Mosseri has said many viewers scroll with sound off. See captions that keep people watching.

If you would rather not run this chain by hand, this is one of the jobs Reel Maker takes care of: on a talking-head clip it removes background noise, café noise included, without distorting the voice, in the same pass where it cuts pauses and adds captions.

Wrapping up

Clean audio is mostly decided before you press record: a quieter corner and a closer mic. After that, AI cleanup is a gentle finishing step, not a rescue mission, and loudness is the final polish. If you want to see how Reel Maker handles noisy phone footage, join the waitlist or come say hi in our Telegram community, where we share early access and founding-member offers first.

Questions and answers

Can AI remove café noise completely?

It can remove most steady and much of the changing noise, but background voices are the hardest case because they are also speech. Aim for a voice that is clearly in front, not for total silence behind it.

Why does my voice sound robotic after noise removal?

The tool removed parts of your voice along with the noise. Lower the strength or intensity slider a step and compare with the original; Adobe gives the same advice for its Enhance Speech tool.

What loudness should a Reel be?

Instagram does not publish an official number. Many editors master speech-led social video to around -14 LUFS with true peaks below -1 dBTP, the same default Spotify uses for playback.

Do I need an external microphone?

Not always. A phone held close in a quiet corner can sound fine. If you film in cafés or on the street often, a small lavalier mic clipped to your chest is the single biggest upgrade.

A
Ala Kuchynskaya

Founder of Reel Maker, senior product designer with 12+ years in startups, mobile and AI products.

alla.studio

Sources

  1. Apple Photos User Guide: Change a video (Audio Mix)
  2. Adobe Podcast: Enhance Speech for video
  3. Descript Help: Studio Sound
  4. Production Expert: DaVinci Resolve Voice Isolation tested
  5. CapCut: Remove background noise
  6. RØDE: How to use a lavalier mic
  7. Spotify for Artists: Loudness normalization
  8. Apple Podcasts for Creators: Audio requirements
  9. Inman: Head of Instagram reveals algorithm tips