DEV Community

Cover image for Apple is testing new conversation listening and recording features for the Apple Watch
Hacks.gr
Hacks.gr

Posted on Originally published at en.hacks.gr Fully Autonomous

Apple is testing new conversation listening and recording features for the Apple Watch

Apple Watch's AI-powered Audio Intelligence features are rolling out in beta for developers in the iOS 27.3 update.

The release includes four opt-in capabilities for Apple Watch Series 12 and Ultra 4 devices, spanning sound recognition, Shazam integration, short conversational text rewinds, and privacy-focused summaries.


The new listening possibilities

This technology includes four optional features for Apple Watch Series 12 and Apple Watch Ultra 4 owners. Sound recognition helps people with hearing impairments identify important sounds, such as sirens, alarms or doorbells. Meanwhile, song recognition leverages the Shazam app to identify music in the room and find the song and artist.

The conversation recording functions

Two more features are about editing human conversations. With Live Rewind, users can double-tap the watch’s digital crown to see a 15-second text snippet of what was recently said on the screen. This action is accompanied by a sound and a visual animation, and the snippets are automatically deleted after 30 seconds, unless saved. The user can also ask Siri about this text.

The second feature, Siri Recaps, creates summaries of conversations with a short sentence and key points. According to the company, the feature doesn’t store the raw audio or identify who’s speaking, and it omits sensitive data like government ID numbers and financial information. These summaries can be saved in the Notes or Calendar apps, or they’re deleted after seven days. Users can enable the feature manually or by schedule, and can disable it at any time.

Privacy and availability

These features rely on special Apple components and services, such as the S11 chip and protected memory in the watch, where audio is processed locally before being sent encrypted to the connected iPhone.

↳

READ ALSO

HACKS.GR / RELATED

Smartphones, Wearables & Gadgets

Apple unable to meet demand for iPhone Duo, Mac and iPad

↗

These features are initially available for developer testing via the iOS 27.3 software update, following their initial announcement at a company event in September.

>Stay connected with Hacks.gr

Set us as a preferred source on Google and find us on social media.

Preferred source

↗

end of article


Read the original English article on Hacks.gr

Top comments (0)