Apple’s new AI wants to fix your tilted photos, sort your messy tabs, and write its own code
You’re staring at a photo of a gorgeous sunset over the beach, but your hand shook, and the horizon is tilted at a sad five-degree angle. Normally, straightening it means cropping the image and losing the very palm tree that made the shot. Apple’s new Extend tool in iOS 27 wants to solve this minor tragedy by using generative AI to hallucinate the missing corners of your vacation.
This is the consumer-facing side of Apple's massive June 8 press blitz, where the company announced the next generation of Apple Intelligence. Under the hood, this isn't just Apple's home-grown code; they've partnered with Google to run Gemini models directly on device. The target is clear: turn Siri AI into a tool that actually gets things done.
Autopilot for the daily grind
Strip away the WWDC26 stage-managed hype, and the features are all about micro-convenience.
- Smart Chores: The Passwords app will now agentically navigate websites to auto-fix compromised credentials, while Safari uses AI to sort your fifty open tabs into neat topics.
- Creative Hacks: Spatial Reframing lets you shift the camera perspective of a photo after it’s taken, and Image Playground generates photorealistic images on Private Cloud Compute, automatically embedding a hidden SynthID watermark.
- Agentic Coding: In Xcode 27, developers get coding agents from Anthropic, Google, and OpenAI that can write tests and debug code autonomously in Playgrounds, using the Model Context Protocol to import external tools.
- Gaming Shortcuts: A new Steam Asset Converter and Game Porting Toolkit 4 make it easier to bring PC games to Apple silicon, leveraging agentic code to optimize performance.
Who actually benefits?
So, where is the leverage here? Apple wins by making its premium hardware completely indispensable.
To run these complex LLMs locally, developers must build using the new Core AI framework, which is tailor-made for Apple silicon's Neural Engine. It is a subtle hint that if you want to run these local AI features without melting your battery, you’ll need to buy the upcoming iPhone 17 Pro.
Even the cloud-based models are a trap. Apple is offering small developers free access to models running on Private Cloud Compute—but only if they have fewer than 2 million downloads. Once your app gets popular, you're on the hook for cloud costs, or you're forced to push users toward local processing on newer, more expensive Apple hardware.
The kicker
Ultimately, Apple’s pitch is that AI shouldn't just write generic poetry; it should do your digital laundry. From auto-generating video descriptions in the Home app to predicting flight details in Call Context, the focus has shifted to domestic utility.
As coding agents start writing their own software in Xcode and Siri begins handling our passwords, we are slowly handing over the keys to the machine. But if it means never having to manually reset a password or crop a photo again, maybe a slightly taller walled garden is a compromise we’re willing to make.
Sources: Apple Developer Newsroom, Apple Intelligence Newsroom.
