Live Notes: AI at the Genius Bar raises surveillance concerns

A new tool is designed to relieve Apple Store employees of the tedious task of taking notes by automatically logging customer conversations. It sounds practical – but staff are increasingly worried that this helpful tool could become a means of control.

Apple is testing an internal tool called "Live Notes" in select Apple Stores. This tool listens to, transcribes, and summarizes conversations at the Genius Bar. It joins a whole range of internal AI applications, all built on Apple's own platform. Foundation Models building. A recent report by Bloomberg journalist Mark Gurman describes, how the tool works – and why it causes unrest among the staff.

What Live Notes is supposed to do

The tool listens to a consultation between a Genius Bar employee and a customer – only with the consent of both parties – and automatically creates a transcript and summary. This allows the employee to fully concentrate on the conversation instead of typing notes simultaneously. A subsequent appointment is then easier to follow: what was explained, what steps were taken, and what recommendations were given.

So far, this is a pilot project in a selection of stores, with no public timeline for wider implementation. There is no obligation to use the system – employees and customers must actively consent to the recording each time.

The concern among staff

Despite its voluntary nature, concerns remain. According to the report, some employees fear that management could use the transcripts for performance reviews. Apple has apparently addressed this concern during the testing phase: supervisors do not receive the transcripts, and employees can edit them before saving.

The catch lies in the future. Whether these protective measures will remain in place after the test is completed is uncertain – and that's precisely where the uncertainty stems. A voluntary time-saving tool could theoretically become a data set containing information about every single customer interaction.

Part of a larger AI toolkit

Live Notes isn't alone. Apple has been testing several internal AI assistants for months: "Enchanté" helps employees with proofreading, brainstorming, and general knowledge questions, while the "Enterprise Assistant" serves as a central knowledge base for corporate policies and technical processes. Live Notes could be a specialized version of this Enterprise Assistant.

What all these tools have in common is their foundation: they run on Apple's own Foundation Models, and therefore on an infrastructure that the company itself controls. For Apple, these internal tests are also a way to harden its AI under real-world conditions before it is integrated into consumer products.

What would additionally apply in Germany

In the US, implementing such a tool is relatively straightforward. In Germany, the hurdle would be higher: A system that records conversations and could be used for performance evaluation is subject to co-determination by the works council under Section 87 of the Works Constitution Act (BetrVG) – even if it is objectively suitable for monitoring, regardless of the actual intention. Furthermore, there are the strict requirements of the GDPR for processing employee and customer data; secretly recording spoken words is even a criminal offense in Germany.

Ironically, a corporation that consistently promotes its AI with data protection and local processing would have to be measured against precisely this standard with a recording tool.

The journey from pilot project to practical application is a long one

Live Notes is currently an optional test, not a standard tool in everyday Apple Store operations. There's no word yet on a rollout, binding rules, or even mandatory use. The crucial question remains: how will Apple handle the transcripts once the test phase is over? This will determine whether the tool remains a helpful resource or becomes a control mechanism. (Image: Shutterstock / Jonjon_01)