AI & Tech · National
Apple begins beta testing Apple Watch AI features that can rewind and summarize conversations the wearer takes part in
Apple's Audio Intelligence features for the Apple Watch are now in developer beta, TechCrunch reported. Two of them listen to conversations, and Apple describes several privacy limits built into how they work.
Listen to this brief · 5 min
Read aloud by an AI voice from the text below. Download MP3
What happened
Apple has started beta testing a set of AI features for the Apple Watch that it calls Audio Intelligence, TechCrunch reported on November 2. The features are first going to developers in the iOS 27.3 update. Apple first announced them at its Surprise and Shine hardware event in September.
According to TechCrunch, the package includes four opt-in features for the Apple Watch Series 12. They let wearers detect important sounds, identify songs, catch up on conversations and take notes. TechCrunch also reported the features are for the Apple Watch Ultra 4.
The four features
Sound and song recognition
The sound recognition feature is meant to help deaf and hard-of-hearing users notice sounds such as sirens, alarms or doorbells from their watch. The song recognition feature uses Apple's Shazam app to identify the name and artist of music playing in the background, TechCrunch reported.
Live Rewind
TechCrunch described the two conversation features as the more potentially controversial ones. Live Rewind lets a wearer double-press the watch's digital crown to see a text snippet of what was said in the last 15 seconds. The snippet can be ignored, or saved to the standalone Siri app that shipped with iOS 27, and an "Ask Siri" option lets users ask about something that was said.
When the crown is double-pressed, the watch plays an audible chime and shows an animation. Apple intends the gesture, sound and visual to signal to people nearby that something they said was captured. Snippets that are not saved are deleted automatically after 30 seconds.
Siri Recaps
Siri Recaps produces high-level notes of conversations, summarized as a short sentence plus bullet points on key details such as dates, deadlines or pricing. Apple says it does not identify speakers, save raw audio or provide word-for-word transcripts. Apple suggested uses such as work meetings, parent-teacher conferences and personal training sessions.
Privacy limits Apple describes
TechCrunch noted the features arrive amid backlash to AI recording devices such as Meta's AI glasses and other AI wearables. Apple says Siri Recaps is designed to leave out government-assigned identifiers, financial and authentication data, certain personal identifiers, and language that would promote self-harm. Recaps also will not record while a user is listening to music with headphones or using noise cancellation.
Users are prompted to review saved recaps at the end of the day and again when they first unlock the watch in the morning. They can keep recaps in the Notes app or export them to the Journal app. Recaps that are not saved delete themselves within seven days.
Siri Recaps can be turned on manually or set to a schedule, such as only during work hours or never at night. TechCrunch reported the feature can be switched off at any time from the Control Center, even when it is running on a schedule.
How the processing works
According to TechCrunch, the features rely on the watch's S11 chip and built-in microphone, Apple Intelligence models running on the iPhone, and Apple's Private Cloud Compute. Lightweight models on the S11 chip detect when the wearer is part of a conversation. The audio then goes to a secure enclave on the paired iPhone, a hardware-protected memory space the rest of the operating system cannot access.
On the iPhone, the audio is turned into condensed text with filler words removed. That text is encrypted and sent to Private Cloud Compute to create the recap, which is returned to the phone, and Apple says the recap and related summaries are deleted from its cloud right after. Apple says recaps are accessible only to the user, are encrypted when synced across devices, and that none of the features should affect watch or phone battery life.
For more coverage of artificial intelligence and consumer technology, see our AI and tech section.
What to watch next
- Developer testing of Audio Intelligence in the iOS 27.3 beta, which TechCrunch reported is now under way.
- A move to Apple's public beta for broader testing, which Apple says will come later.
- A general release of the features to all eligible Apple Watch users after public beta testing.