Apple's Siri Recap, a new ambient listening feature for the Apple Watch Ultra 4, uses AI to summarize conversations a wearer has throughout the day, but a two-week beta test found the privacy-focused design undercuts how useful the recaps actually are. The feature is part of a wave of always-listening wearable tools that also includes Amazon's Bee Frontier, which takes a far more maximalist approach to capturing and summarizing speech. Both require users to disclose to the people around them that their words are being recorded.

Apple's version is built as a backup notetaker rather than a constant recorder. The company imagines a college student who can absorb a lecture without writing everything down, or a parent attending a solo parent-teacher conference who later needs to recount the discussion to a spouse. The feature is off by default and requires users to opt in, after which they can schedule when it activates, such as only at the office between 1 and 2PM on weekdays. Unless saved, recaps self-destruct after one, three, or seven days, and no viewable transcript or raw audio file is ever stored. Audio is processed and deleted through a secure enclave in the 2026 Apple Watch's S11 chip, with most processing done locally and any cloud work handled through Apple's Private Cloud Compute. Because the feature depends on that hardware, it cannot run on older Apple Watches.

Those privacy choices carry costs. Siri Recap does not train on a user's voice, which makes it harder for the system to tell when a real conversation is underway. In testing, Siri summarized a TikTok about a creator hospitalized with sepsis as though the wearer or an acquaintance had been sent to the emergency room, and recapped another TikTok about a Reddit thread as if the wearer had discussed a woman named Dana trying to seduce her best friend's husband. Neither video was something the tester wanted to remember, and the summaries omitted attribution, leaving the events unclear. The feature does switch off automatically when headphones are connected, which offers a workaround for podcasts and other media at the cost of changing user behavior.

Siri Recap also struggles to identify which moments matter to a person. It favors concrete details like statistics, factoids, and dates, which suits planning meetings but misses what a user might find salient. In one interview, a personal anecdote and strong opinions about RFK Jr. were left out in favor of more concrete facts, and recaps of personal conversations ranged from an argument with a cousin over hardwired versus battery-powered smoke detectors to a spouse's debate over movie recommendations. Some gossip and jokes were dropped as irrelevant, while others were rendered in blunt terms that read oddly out of context.

The tester, a Verge staffer, concluded that outside a few work situations Siri Recaps were not useful, though the privacy protections made the more than 50 generated recaps largely unreadable to anyone else. Amazon's Bee produced more material the tester considered useful, but after reviewing Bee's raw transcripts and summaries of nearly every spoken moment, the tester deleted all Bee data. The account raises the question of whether privacy-first design and a genuinely helpful AI notetaker can coexist.

More AI news from TechManNews.