EU demands security theater. They are attempting to force backdoors into all of these APIs and systems (including locally run AI) for the nanny state. Very unfortunate.

There is on device AI in the Apple ecosystem. Many of the AI features that they announced will run locally (assuming hardware requirements are met). Things like Spatial Reframing will touch the cloud (via private compute) though. Other than that, Apple has an entire entry point for running AI close to the metal via MLX. It is kind of their entire angle at this point given their inability to create a competitive compelling AI product of their own. They appear to be taking on the role of “platform” once again.

Zen still works beautifully. The only downside I’ve come across is that there isn’t a mobile app, so the ability to hand off isn’t there.