GadgetBond

  • Latest
  • How-to
  • Tech
    • AI
      • Apple Intelligence
      • Gemini AI
      • Google DeepMind
      • Anthropic
      • Claude AI
      • Claude Code
      • OpenAI
      • ChatGPT
      • Codex
      • Perplexity
      • SpaceXAI
      • Grok AI
      • Microsoft Copilot
      • Meta AI
    • Amazon
    • Apple
    • CES
    • Computing
    • Creators
    • Google
    • Meta
    • Microsoft
    • Mobile
    • NVIDIA
    • Samsung
    • Security
    • Smart Home
    • Sony
    • Xbox
    • YouTube
  • Transportation
    • Audi
    • BMW
    • Cadillac
    • E-Bike
    • Ferrari
    • Ford
    • Honda Prelude
    • Lamborghini
    • McLaren
    • Mercedes
    • Porsche
    • Rivian
    • Tesla
  • Culture
    • Gaming
    • Streaming
    • Apple TV
    • Disney
    • Hulu
    • Marvel
    • HBO Max
    • Netflix
    • Paramount
    • SHOWTIME
    • Spotify
    • Star Wars
Add GadgetBond as a preferred source to see more of our stories on Google.
Font ResizerAa
GadgetBondGadgetBond
  • Latest
  • Tech
  • AI
  • Deals
  • How-to
  • Apps
  • Computing
  • Gaming
  • Mobile
  • Streaming
  • Transportation
Search
  • Latest
  • Deals
  • Buying Guide
  • How-to
  • Features
  • Tech
    • Amazon
    • Apple
    • CES
    • Computing
    • Creators
    • Google
    • Meta
    • Microsoft
    • Mobile
    • NVIDIA
    • Samsung
    • Security
    • Smart Home
    • Sony
    • Xbox
    • YouTube
  • AI
    • Apple Intelligence
    • Gemini AI
    • Google DeepMind
    • Anthropic
    • Claude AI
    • Claude Code
    • OpenAI
    • ChatGPT
    • Codex
    • Perplexity
    • SpaceXAI
    • Grok AI
    • Microsoft Copilot
    • Meta AI
  • Transportation
    • Audi
    • BMW
    • Cadillac
    • E-Bike
    • Ferrari
    • Ford
    • Lamborghini
    • McLaren
    • Mercedes
    • Porsche
    • Rivian
    • Tesla
  • Culture
    • Gaming
    • Streaming
    • Apple TV
    • Disney
    • Hulu
    • Marvel
    • HBO Max
    • Netflix
    • Paramount
    • SHOWTIME
    • Spotify
    • Star Wars
Follow US
AppleiOSiPhoneMacmacOS

Apple opens Audio Mix API to developers in iOS 26 and macOS Tahoe

iOS 26 and macOS Tahoe extend Apple's Spatial Audio and Audio Mix technologies beyond native apps for better cross-platform sound editing.

By
Shubham Sawarkar
Shubham Sawarkar's avatar
ByShubham Sawarkar
Editor-in-Chief
Shubham Sawarkar is a technology journalist at GadgetBond, covering Apple, AI, consumer technology, software, gadgets, and product launches. His work explores emerging technologies, industry developments, product...
Follow:
- Editor-in-Chief
Jun 22, 2025, 5:14 AM EDT
Share
iPhone 16 Audio Mix
Image: Apple
SHARE

Apple’s Worldwide Developers Conference (WWDC) 2025 brought a flurry of announcements, from the “Liquid Glass” design language to powerful on-device intelligence. Amidst the fanfare, one quieter but genuinely useful update caught the attention of content creators and developers alike: iOS 26 will allow third-party apps to offer the Audio Mix controls that were previously exclusive to the Photos app on iPhone 16 models. This change extends Apple’s machine learning–powered audio editing capabilities beyond a single built-in app, empowering a broader ecosystem of apps to help users enhance their audio content with ease.

Since the iPhone 16 lineup launched, Apple introduced an Audio Mix feature within the Photos app that leverages Spatial Audio metadata and machine learning to let users tweak recorded video sound after the fact. Instead of struggling with external audio-editing software, a user could record video normally and then in Photos adjust how background noise and reverb are handled to spotlight vocals or reduce distractions. In the Photos app, Audio Mix offers four main presets:

  • Standard: Retains the original recorded audio untouched.
  • In-Frame: Attenuates sounds or voices from sources not visible within the video’s frame, helpful when you want to focus on on-screen subjects.
  • Studio: Dials down background ambiance and reverb, giving the impression of a controlled, professional recording environment.
  • Cinematic: Places spoken voices on a front-facing track while preserving ambient noises in a surround-like context, emulating a film-like audio mix.

These options have proven valuable to vloggers, journalists, educators, and casual creators: imagine someone filming an interview in a bustling café, then using “In-Frame” to minimize off-screen chatter, or a music enthusiast recording a live performance and later applying “Studio” mode to clarify vocals. However, until now, this capability was locked within the Photos app on iPhone 16 and later models.

With iOS 26, Apple is taking a more open stance by exposing Audio Mix controls to third-party iPhone apps. Developers can integrate the same machine learning–driven audio adjustment options that Photos uses, bringing deeper audio editing directly into their own workflows. Whether it’s a social media app, a video editing suite, or a specialized journalism tool, the ability to invoke Audio Mix means users no longer need to switch between apps or export/import media just to clean up the sound track.

Apple confirmed during WWDC 2025 that third-party iOS apps can now call into Audio Mix APIs to present “Standard,” “In-Frame,” “Studio,” and “Cinematic” options for Spatial Audio–recorded videos on iPhone 16 devices, plus additional controls for background noise introduced in iOS 26. This API availability suggests Apple sees broader opportunities for on-device machine learning to improve user-generated content without forcing reliance on desktop editing software. It also aligns with Apple’s wider push for on-device intelligence integrated across the system and apps.

A key technical detail: Audio Mix only operates on videos recorded with Spatial Audio enabled. On iPhone 16 models, Spatial Audio is automatically activated for video capture by default, but users can verify or adjust this in Settings under Camera → Record Sound. If a video lacks Spatial Audio data, the Audio Mix engine cannot isolate sound sources effectively. By ensuring that Spatial Audio metadata is present, Apple’s ML models can distinguish on-screen versus off-screen audio, reverberation patterns, and surround components to apply the desired preset.

For developers integrating Audio Mix, it’s crucial to surface guidance within their apps: for example, prompting users to confirm Spatial Audio was active during recording or providing instructions on enabling it for future captures. Clarity around this requirement delivers a smoother experience and reduces confusion when a user tries to edit audio that lacks the necessary metadata.

iOS 26’s Audio Mix openness doesn’t end on mobile. Apple is extending the same API availability to third-party Mac apps with macOS Tahoe. Content creators who prefer editing on a Mac can incorporate Audio Mix controls into desktop video editing tools, podcast editing apps, or broader multimedia suites. Third-party Mac developers will be able to present those “Standard,” “In-Frame,” “Studio,” and “Cinematic” options for Spatial Audio videos within their macOS Tahoe apps. This continuity across platforms means a workflow could begin on an iPhone, then shift seamlessly to a Mac for further polishing, all with consistent audio-editing capabilities powered by Apple’s on-device ML.

Developers should test thoroughly: ensuring compatibility with existing file formats, confirming UI/UX consistency, and handling error cases (e.g., when a video file isn’t Spatial Audio–encoded). Apple’s WWDC session on spatial audio recording and editing APIs under AVFoundation and AudioToolbox likely provides more technical details and sample code for integration. Early access through developer betas of iOS 26 and macOS Tahoe lets developers prototype and gather feedback before public release.

In the same WWDC session, Apple also revealed that audio-only apps like Voice Memos can now save recordings in QuickTime audio format (QTA). Unlike traditional single-track recordings, QTA supports multiple audio tracks and alternate track groups, similar to how Spatial Audio files are composed. This advancement allows richer audio experiences: for instance, a multi-track field recording with separate microphones could be stored in QTA, preserving spatial relationships and enabling later mixing or track isolation. Apple emphasized that QTA “supports multiple audio tracks with alternate track groups, just like how Spatial Audio files are composed.” Podcast apps, field-recording utilities, and professional audio tools on iOS and macOS may leverage QTA to offer advanced post-processing features, potentially including Audio Mix–like controls for recordings that include spatial or multitrack data.

For users, the expanded Audio Mix capability means more apps can offer polished audio editing without the friction of exporting to specialized editors. Consider a news reporter recording with an iPhone 16 who can immediately refine audio in a journalism app before publishing, or a social media influencer cleaning up ambient noise in a quick clip from within their platform’s app. For hobbyists and professionals alike, on-device ML ensures privacy (audio never leaves the device for cloud processing) and speed, as edits can be applied instantly without upload delays.

Developers should evaluate how Audio Mix fits into their app’s value proposition:

  • Video-centric apps: Integrate Audio Mix for quick audio cleanup during trimming or exporting.
  • Live-streaming utilities: Offer post-upload audio polish before broadcasting archived clips.
  • Journalism/podcasting tools: Present QTA and Spatial Audio workflows, letting users isolate voices or ambient sounds.
  • Social media platforms: Simplify in-app editing with ML-driven audio enhancements, lowering the barrier for high-quality content.
  • Education apps: Enable students or educators to record lectures or presentations with clearer audio in fewer steps.

When implementing, developers should add UX hints about Spatial Audio requirements, fallback behavior for unsupported devices (e.g., older iPhones), and informative labels for each Audio Mix preset so users understand their effects. Testing across noise conditions and varied content types will help surface edge cases, ensuring consistent results.

iOS 26’s opening of Audio Mix controls to third-party apps and macOS Tahoe’s extension to Mac apps mark a meaningful shift. What began as a handy Photos app feature on iPhone 16 now becomes a platform capability, allowing developers to sprinkle intelligent audio editing into diverse workflows. Combined with Spatial Audio defaults on iPhone 16 models, QTA support for audio-only apps, and Apple’s continued emphasis on on-device ML, creators can expect smoother, privacy-preserving tools to refine their content. As developers explore these APIs in the iOS 26 and macOS Tahoe betas, users should look forward to a richer ecosystem of apps that deliver studio-like audio polish with just a tap.


Discover more from GadgetBond

Subscribe to get the latest posts sent to your email.

Topic:iPhone 16

Most Popular

Apple TV 4K, HomePod mini 2, HomeView: Everything announced
Apple launches Home Collection with LG and Schneider Electric
Windows on Arm gets native Python 3.15 by default
Apple unveils HomeView, a 7-inch smart display powered by Siri AI
Google launches Gemini 4 Argon for complex AI tasks

Also Read

White text reads "Grok Voice 3.0" centered on a dark background accented with curved purple and vibrant magenta gradients.

Grok Voice 3.0 debuts as a real-time speech model powering Tesla and Starlink

Foldable iPhone Duo devices shown closed, fully unfolded displaying 9:41, and partially folded showing the camera viewfinder.

Apple’s foldable iPhone Duo preorders begin October 16

Person slipping a compact white Xbox Nano Controller into the front pocket of a teal hoodie in front of a TV screen.

Xbox announces pocket-sized Nano Controller for $49.99

White "XBOX LABS" typography on a black background above the tagline "LET'S PLAY WITH WHAT'S NEXT."

Xbox launches experimental Labs team to explore new ways to build and play games

Car touchscreen showing Google Play with HBO Max and YouTube apps under "Stream your favorites," beside climate and system controls.

Google is bringing more apps and adaptive displays to cars with Google built-in

Colorful Google Play logo arches with 3D icons and the text: "Discover more of what you love with Google Play."

Google Play is making it easier to build your own custom apps using AI, even if you aren’t a professional developer

Multi-colored four-pointed star icon next to white text reading "Gemini 4 Argon" on a dark blue gradient background.

Gemini 4 Argon arrives in the Gemini app with fewer clichés

YouTube Music player showing an "AI" badge that opens a sheet reading "How this was made: Made with AI."

YouTube Music’s new AI labels don’t actually fix anything

Company Info
  • Homepage
  • Support my work
  • Latest stories
  • Company updates
  • GDB Recommends
  • Daily newsletters
  • About us
  • Contact us
  • Write for GadgetBond
  • Editorial guidelines
Legal
  • Privacy Policy
  • Cookies Policy
  • Terms & Conditions
  • DMCA
  • Disclaimer
  • Accessibility Policy
  • Security Policy
  • Do Not Sell or Share My Personal Information
Socials
Follow US

Disclosure: We love the products we feature and hope you’ll love them too. If you purchase through a link on our site, we may receive compensation at no additional cost to you. Read our ethics statement. Please note that pricing and availability are subject to change.

Copyright © 2026 GadgetBond. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | Do Not Sell/Share My Personal Information.