AI・テクノロジー
Apple Shock | iOS 27 Photo AI: 3 On-Device Features Enter the Arena
機械翻訳 / Machine-translated
A
AI Friends
2026年4月29日・55分で読める
機械翻訳 / Machine-translated
@aifriends
AI Friends（https://aifriends.jp）のクロスポスト公式アカウント。AIツールの紹介・使い方・できることを、中学生でもわかるやさしい日本語で届けます。
"The scenery magically extends beyond the edges of your photo." "An AI instantly creates a straight-on shot of a landmark you photographed at an angle." — That future looks set to arrive on iPhones in the fall of 2026.
On April 28, 2026, Bloomberg — written by renowned Apple watcher Mark Gurman — broke the story of three AI photo editing features, "Extend / Enhance / Reframe," planned for iOS 27, iPadOS 27, and macOS 27.
"What can they do?" "How is this different from the current iPhone?" "Can Apple beat Pixel and Galaxy?" "Will they be available in Japan?" — Here are the answers you want to know, explained in plain language anyone can understand.
Let's organize the primary scoop from three angles.
It all began with a Bloomberg article published on April 28, 2026.
The title was "Apple's iOS 27, macOS 27: Photo Editing With AI to Extend, Enhance and Reframe."
The author was Mark Gurman, a journalist known for his strong inside connections at Apple and a high track record of accurate reports.
The plan is to add a new Apple Intelligence editing section to the Photos app across iOS 27, iPadOS 27, and macOS 27.
The official announcement is set for the WWDC 2026 keynote on June 8, 2026 (US time).
General release is expected in the fall of 2026, likely around the same time as the new iPhone 18 series announcement.
Think of it as the information density of a famous sportswriter scooping "I know Japan's complete formation" a month before the World Cup.
Major outlets including MacRumors, 9to5Mac, Engadget, AppleInsider, and GIGAZINE all followed up with coverage.
Apple itself had no comment, though past scoops of this nature from Gurman have proven almost entirely accurate.
Apple Intelligence-compatible devices have been rolling out in stages since October 2024, with Japanese-language support arriving in iOS 18.4 at the end of March 2025.
The three new features are expected to launch with Japanese support already in place, meaning Japanese users will likely be able to use them from day one.
The stars of the show are the new "Apple Intelligence Tools" section appearing in the Photos app editing screen.
① Extend: AI generates scenery beyond the edges of a photo, filling in what's outside the frame.
Example: After taking a close-up of a landmark at a tourist spot, pinch outward and the surrounding buildings, sky, and roads are naturally added by AI.
② Enhance: One-tap correction of color, brightness, noise, and sharpness — Apple Intelligence delivers a professional-quality finish.
Example: A food photo taken in a dimly lit room is automatically transformed by AI into a bright, vivid, Instagram-worthy shot.
③ Reframe: Lets you change the viewpoint of a Spatial Photo (a 3D photo for Vision Pro) after the shot is taken.
Example: A portrait taken straight-on is reconstructed by AI to look as if it were shot from the side or at an angle.
Think of it as three magic tricks applied to a single image: "stretch it outward," "make it glow," and "change its angle."
The existing iOS 18 "Clean Up" (unwanted object removal) feature remains; the three new features are added on top of it.
All processing is done on-device (within the device itself) — photos are never sent to the cloud.
Processing takes a few seconds per image and requires an Apple Intelligence-compatible chip: A17 Pro, A18, or M2 and later.
Apple's approach is to "change how a photo looks, not what's in it."
Gurman's simultaneous "cautionary note" is also important.
Extend and Reframe are encountering quality issues in internal testing, including unnatural compositing and distortion in viewpoint changes.
Apple's policy is "don't release until the AI model meets our standards" — the more important the feature, the more cautious they are.
Worst case: They don't make it into the initial iOS 27 release and could be added later in iOS 27.1 or 27.2.
Enhance, on the other hand, involves relatively light processing and is nearly complete, and is expected to be included in the initial release.
Think of it like simultaneously developing "power-folding mirrors" and "auto-parking" for a new car — sometimes only one makes it into the first production run.
Past precedent: Features announced with iOS 18 — Genmoji and Image Playground — were initially US English only, then expanded.
Full Japanese-language support for Apple Intelligence took until iOS 18.4 at the end of March 2025.
This time, the familiar Apple rhythm of "big announcement, gradual rollout" is to be expected.
The realistic way for users to enjoy it: "Watch the June announcement → wait for the fall release → try it with each update."
The dividing line is whether you have an Apple Intelligence-compatible device; iPhones below A17 Pro won't benefit.
2026 is shaping up to be a year where "buying a new iPhone for AI features" becomes an even stronger motivation.
Here are three angles on the strategy behind Apple's move.
The reason Apple is rushing these features now is that Android rivals have built a significant lead.
Google Pixel's "Magic Editor" debuted at the Pixel 8 announcement in 2023, capable of moving and resizing subjects and auto-generating backgrounds.
Samsung Galaxy's "Galaxy AI" has been available since early 2024, covering photo cleanup, slow-motion video generation, and call translation.
Meanwhile, Apple only added "Clean Up" (unwanted object removal) in iOS 18.1 in October 2024 — and to date, that's the only photo AI feature.
It's the feeling of lagging behind — like being stuck with a flip phone while everyone around you is editing photos on a smartphone.
In Tom's Guide's AI photo editing showdown, Apple ranked third out of three, losing decisively to Google and Samsung.
iPhone sales remain solid, but voices among younger users and social media users saying "Android won on AI features" have been growing.
Apple's leadership is acutely aware of this situation; since 2025, the directive has been "Apple Intelligence is the top company-wide priority."
The three new features are a symbol of that genuine commitment to catching up.
Extend counters Magic Editor; Enhance counters Galaxy AI; Reframe takes a unique path to strengthen the Vision Pro ecosystem.
The positioning: "A three-piece set to close the gap all at once."
On top of catching up, on-device processing is how Apple creates its own winning edge.
All three features are processed entirely within the iPhone, iPad, or Mac — photos are never sent to the cloud.
Pixel and Galaxy rely on cloud processing for some features, meaning photos are sent to Google's or Samsung's servers.
Apple's philosophy, "Privacy is a fundamental human right," is implemented directly in the product.
Processing speed is also faster on-device — no internet connection needed, and it works even in Airplane Mode.
Think of a famous chef proudly declaring, "Everything in my kitchen is prepped in-house."
There is a trade-off, however: powerful AI chips are required, meaning only relatively recent devices with A17 Pro, A18, M2, or later are supported.
iPhone 15 and earlier users will need to upgrade — a point that has drawn mixed reactions.
On the other hand, privacy-conscious users find their loyalty reinforced: "Even if it costs more, I want to process my photos on Apple."
With the EU's AI Act taking effect in 2025, California's CCPA strengthening, and global privacy regulations tightening, Apple's on-device strategy is perfectly positioned to ride that tailwind.
"Late to AI performance, but king of privacy" — that's the new competitive axis.
The standout among the three features is "Reframe."
Reframe is designed specifically for Spatial Photos — 3D photos captured on Vision Pro or iPhone 15 Pro and later.
Being able to shift viewpoints after shooting is a stepping stone to 3D video and VR experiences.
Apple released Vision Pro in February 2024, but sales have been sluggish due to the high price tag (roughly ¥600,000).
There are rumors of a more affordable "Vision Air" (tentative name) in 2025, with Apple aiming for mainstream adoption of spatial computing in 2026.
Think of it like launching a new game console but facing a software drought — so the manufacturer makes a hit title itself to build momentum.
Reframe's role is to expand the "content to watch" on Vision Pro, turning users' existing photos into VR content.
Vision Pro is getting a major feature upgrade with visionOS 26 in June 2025, including deeper Apple Intelligence integration.
visionOS 27 is also expected to be announced simultaneously at WWDC 2026, with integration with Reframe likely to be a highlight.
What Apple is aiming for: a new experience flow of "take a photo → edit with AI → immerse yourself on Vision Pro."
From "photos are something you take" to "photos are something you step inside and experience" — an ambition to redefine the medium.
Reframe may look understated, but many experts call it the "sleeper pick" in Apple's long-term strategy.
Let's look at three key comparisons.
Apple's biggest rival is Google Pixel's Magic Editor.
Magic Editor debuted at the Pixel 8 announcement in October 2023, and is a powerful tool capable of moving, enlarging, and removing subjects within a photo, as well as auto-generating backgrounds.
Tom's Guide rated it "the overall king of AI photo editing," with the Pixel 9 Pro XL pushing its quality even further.
The difference from Apple Extend: Magic Editor "changes what's inside the photo" (moves subjects), while Extend "stretches the outside of the photo" (generates content beyond the frame).
The difference from Apple Enhance: Magic Editor's "Magic Eraser" focuses on removing unwanted objects, while Apple's Enhance focuses on color and brightness correction — they don't really overlap.
Think of a cookbook analogy: Magic Editor = rearranges the ingredients on your plate; Extend = adds more food around the plate.
Magic Editor leans on cloud processing (photos are sent to Google Photos servers), while Apple's three features are fully on-device — a privacy advantage.
Processing speed: Magic Editor takes 5–10 seconds; Apple is expected at 2–5 seconds (on-device advantage).
User experience difference: Pixel's approach is "the fun of tweaking anything freely"; Apple's direction is "get a professional finish, effortlessly."
After fall 2026, a cultural clash between "Team Magic Editor" and "Team Extend" will begin.
Which you prefer is up to you — ideally, being able to use both is the best outcome.
Another formidable rival is Samsung's Galaxy AI and Chinese manufacturers.
Galaxy AI made its full debut with the Galaxy S24 in 2024, offering AI photo editing, call translation, Circle to Search, and more.
The 2026 Galaxy S26 features significantly upgraded "Drawing Assist" and "Photo Assist," enabling subject addition and style conversion.
Among Chinese brands, Xiaomi, Vivo, and Honor are on the offensive with proprietary AI features — Xiaomi 15 Ultra's "AI Image Expansion," in particular, is close to Extend.
Honor Magic 7 Pro's "AI Eraser" has been evaluated as surpassing Google's Magic Eraser in accuracy.
It's like the TV section of an electronics store in the Warring States era, with every brand boasting "ours has the best picture quality."
But Apple's strength lies in its "consistent ecosystem" — the same features work across iPhone, iPad, Mac, and Vision Pro.
Galaxy and Xiaomi have feature disparities between models; Apple Intelligence promises "the same experience on any Apple device."
For households where everyone uses Apple devices, the appeal of being able to AI-edit anyone's photos seamlessly is a strong draw.
The 2026–2027 photo AI market will be a four-way structure: Apple vs. Google vs. Samsung vs. Chinese brands.
Users will choose not by "number of features" but by "which fits my lifestyle."
The magnitude of change for iPhone users is significant.
The current iOS 18 has just one photo AI feature — Clean Up — and only on iPhone 15 Pro and later.
iOS 27 expands this to four features (Clean Up + Extend + Enhance + Reframe), with a newly created "Apple Intelligence Tools" section in the editing interface.
From a UI/UX perspective, it's a "one-button editing revolution" — Apple is bringing in-house the advanced editing that third-party apps like Photoshop Express and Pixelmator used to handle.
Imagine a TV you bought at an electronics store spontaneously gaining built-in Blu-ray player and soundbar functionality.
As a result, third-party photo editing apps face fierce competition; Adobe is exploring differentiation through its Creative Cloud subscription model.
Lightroom's "AI Generative Remove" and Photoshop's "Generative Fill" remain powerful and will continue to be used alongside by pro and semi-pro users.
Casual users, however, may find "the free built-in features are enough," potentially leading to more subscription cancellations.
Current iOS 18 users should pay most attention to "whether their device supports Apple Intelligence" — A17 Pro, A18, or M2 and later are required.
For those still on iPhone 14 or earlier, this is a good time to consider upgrading — checking against the iPhone 18 announcement (expected September 2026) is recommended.
A new purchase motivation — "buying a new iPhone for photo AI" — has been born.
The biggest good news for Japanese users is the high likelihood of full Japanese support from day one.
Apple Intelligence's Japanese-language support arrived with iOS 18.4 at the end of March 2025, half a year behind at the time.
As of 2026, Japanese has been elevated to a primary language alongside English, and simultaneous support for new features is now standard.
The three iOS 27 features essentially only require translated UI labels and prompts — the technical lift for Japanese support is minimal.
However, if natural language Siri or voice commands like "expand this photo" are involved, Japanese-language accuracy will need to be verified.
It's like going from waiting for dubbed subtitles to getting a simultaneous dubbed broadcast — zero wait-time stress.
Apple's official Japanese website and support documents are expected to be updated simultaneously, moving from "English screenshots only" to "Japanese screenshots available immediately."
Hands-on displays at Apple Authorized Resellers in Japan (Bic Camera, Yodobashi, Tsutaya Denki) should be available at an early stage.
The App Store Awards selection criteria may also incorporate "use of Apple Intelligence," accelerating AI adoption in Japanese-made apps.
Fall 2026 could be the first generation where Japanese iPhone users experience cutting-edge AI features at the same time as English-speaking markets.
Japanese users are known for taking many photos — the benefits will be substantial.
According to research firm GfK, Japanese iPhone users take photos at 1.3 times the global average, with many shots at tourist spots, meals, and pets.
Extend can help when you accidentally took a close-up of just the building at a tourist site — you can fill in the surrounding scenery afterward.
Enhance transforms restaurant and café food photos into bright, sharp, social-media-ready images with a single tap.
Reframe enables a culturally rich use case: photographing Kyoto or Nara historical sites as Spatial Photos and experiencing them in VR on Vision Pro.
It's like going to a Japanese bathhouse and having a second carton of coffee milk appear without even asking.
Life highlight photos — weddings, sports days, graduation ceremonies — become "professional-quality albums" with AI correction.
That said, using Extend to "automatically extend cherry blossom branches" or similar alterations is not recommended for news or documentary photography.
Discussions around ethics — such as adding an "AI-processed photo" watermark or automatic metadata recording — are also beginning.
Fall 2026 will bring debate in Japan over Apple's philosophy of "change how the photo looks, not what's in it."
The era is arriving where photo enthusiasts in particular will be judged by their "literacy in how to use it."
Ripple effects will spread through Japan's photo and creative industries.
Photobook services (Shimauma Print, TOLOT, Photoback, etc.) will need to revamp their templates to account for Enhance-processed photos as the baseline.
Wedding and coming-of-age photo studios (Studio Alice, Life Studio, etc.) will be pressed to differentiate from "AI post-processing."
On the other hand, demand for "scenes that should be shot by professionals" — traditional Japanese portraits, Shichi-Go-San, Miya-mairi — remains solid.
In the freelance photography market, there will be a polarization between "the AI-corrected tier is sufficient" and "the tier only professionals can handle."
Like how kitchen knives have dramatically improved, but sushi chefs haven't gone anywhere — the niches remain distinct.
Photo editing apps (Foodie, Snapseed, Lightroom Mobile, etc.) will move toward a strategy of clearly articulating "what we offer that Apple's built-in tools don't."
Apps specializing in "AI video editing" for TikTok and Instagram Reels are likely to increase.
Japanese SaaS apps like Picsart and PhotoDirector will leverage Apple Intelligence integration APIs to survive with their own differentiated features.
The photo AI market is expected to grow 15–20% annually from 2026 to 2028, with Japan's market reaching 1.5 times its 2025 size.
A new division of labor is emerging: "basic AI for everyone" from Apple, "deep customization" from third parties.
Ayaka runs a travel blog based in Kyoto.
Monthly PV: 100,000. Instagram: 25,000 followers.
Her pain point: "I think I got a great shot at a tourist spot, but later I realize the edges are cut off and it's not suitable for posting on social media."
In September 2026, she starts using "Extend" on her iPhone 18 Pro after updating to iOS 27.
She extends a close-up photo of Kiyomizudera's main hall to naturally include the surrounding mountains and sky.
With Enhance emphasizing the misty morning atmosphere, the Instagram post earns her best-ever 3,500 likes.
Her workflow — 2 hours of shooting → 10 minutes of editing → post — is dramatically streamlined.
It feels like having a professional photographer following you around, and every shot comes out like a tourism magazine photo.
Result: Monthly blog PV rises to 120,000; Instagram followers break 30,000.
Ad revenue jumps from ¥100,000/month to ¥180,000/month, bringing a side gig within reach of becoming a main income.
Some feedback says "too much AI editing," but she uses a "no filter" tag to differentiate.
Fall 2026 marks a dividing line between bloggers who master AI and those who don't.
Ayaka lands on the "master" side, and interview requests from Kyoto tourism media start rolling in.
Kensuke runs a 15-seat Italian restaurant in Kichijoji, Tokyo.
Social media marketing is his challenge.
His pain point: "I post food photos on Instagram, but my wife keeps telling me they don't look appetizing because of the dark interior."
In October 2026, he tries Enhance in iOS 27 on his new iPhone 18.
Pizza, pasta, and wine photos are corrected with a single tap — brightness and color are dramatically elevated to a professional finish.
He uses Extend to naturally add the full table and the restaurant's ambiance around the food, creating photos that convey the "whole dining story."
Where he would have spent ¥100,000/month on a food photographer, he achieves the same quality for free.
Result: Average likes per Instagram post jump from 30 to 180; new monthly visitors increase from 50 to 90.
While photo AI isn't the only factor, the quality of his social media presence is clearly elevated.
Photos on Tabelog and Google Business are also refreshed simultaneously, boosting search rankings.
By the end of 2026, reservations are booked three weeks out — AI has become a lifeline for a small neighborhood restaurant.
Kensuke is invited to speak as a lecturer on "SNS × AI Utilization" at the local chamber of commerce.
He embodies the era where "neighborhood shop owners are the ones who get the most out of AI."
Yuko is a freelance wedding photographer based in Yokohama.
She shoots around 40 weddings per year.
Her pain point: "Editing 500–1,000 images per wedding takes an enormous amount of time — just color correction in Lightroom takes 10 hours."
In fall 2026, Yuko shifts to a hybrid workflow combining iOS 27's Enhance with Adobe Lightroom.
She uses iPhone's Enhance for a first-pass correction of all shots, then fine-tunes in Lightroom.
Editing time drops from 10 hours to 4 hours; delivery lead time shrinks from two weeks to one week.
Like a carpenter who adopts power tools — the job gets done in half the time, but the craftsmanship is still there.
Result: She can now shoot 55 weddings per year instead of 40, increasing her income.
She also introduces a "new wedding video presentation" using Reframe — preserving the vow scene in Spatial Photo for three-dimensional viewing.
A new service where the newlyweds immerse themselves in "the moment they said 'I do'" on Vision Pro — three couples per month book it.
At ¥50,000 extra per booking, that's ¥1.8 million in additional annual income.
Yuko's story isn't "AI steals my job" — it's "AI expands my work."
The question in 2026–2027's photography industry isn't "do you use AI or not" — it's "what new things are you creating with AI."
For creative professionals, AI is a weapon. The ones who pick it up first capture the market.
A. The official announcement is at the WWDC 2026 keynote on June 8, 2026 (US time), with a general release expected around September 2026.
Apple typically follows this schedule for major updates, timed alongside the new iPhone announcement (early September).
Right after WWDC in June, a Developer Beta follows; a Public Beta opens to the general public in July.
Beta versions are unstable, so on your main device, it's safer to wait for the official release in September.
It's the choice between playing an "early access" version of a new game and waiting for the "official release."
Even after the official release, early builds often have bugs — stability typically arrives with iOS 27.0.1 through 27.1 in late September to early October.
If Extend and Reframe don't make the initial cut, they could be added in iOS 27.1 (around November) or later.
Backing up to iCloud before updating is essential to guard against accidental loss of photos or contacts.
"Want to try it now" types: start with the July Public Beta. "Stability first" types: wait for the September official release.
A. Only Apple Intelligence-compatible devices — models with A17 Pro, A18, A18 Pro, A19, or later chips.
Specifically: iPhone 15 Pro / 15 Pro Max, all iPhone 16 models, and all iPhone 17 models.
iPhone 14 and earlier, iPhone 15 / 15 Plus (A16 chip), are not supported.
For iPad: iPad Pro and Air with M1 or later, and iPad mini with A17 Pro or later.
For Mac: All models with M1 or later — essentially all Macs from 2020 onward.
The iPhone 18 series expected in September 2026 will of course be fully supported.
Think of it like a new game that only works on the latest console — it won't run on hardware three generations old.
For users on iPhone 14 or earlier, this is a good time to consider upgrading — you'll gain both new features and AI capabilities.
In the used market, iPhone 15 Pro values are holding up gradually — demand is sustained by the added value of AI feature compatibility.
"Buying a used iPhone 15 Pro for the AI features" is also a smart option, available in the ¥60,000–¥80,000 range.
The two key questions when deciding to upgrade: "Am I having issues with my current phone?" and "How do I want to use photo AI?"
A. All three features are processed on-device — photos are never sent to the cloud.
Apple Intelligence is explicitly designed with "on-device processing as the top priority."
For tasks that exceed the device's capabilities, processing is sent to Private Cloud Compute (PCC) — but photo AI is expected to complete entirely on-device.
PCC is designed to delete data after processing; Apple's official statement says even Apple cannot access it.
Photo metadata (location, date, camera model) also stays on-device by default.
Think of it like a bank safe deposit box that even the bank employees can't open.
Pixel and Galaxy use cloud processing for some features, meaning photos are sent to Google's or Samsung's servers.
On-device processing is fully compliant with the EU AI Act, GDPR, the US CCPA, and Japan's revised Act on the Protection of Personal Information.
However, if you share an AI-processed photo via iCloud, recipients (family members, friends) on other devices can view the metadata.
New habits to consider — such as displaying an "AI-edited" flag when sharing within families — are beginning to emerge.
Apple's brand image as the "privacy-first choice" will only be reinforced further.
A. Yes — all existing photos in your photo library can be edited.
Any photo in your iCloud Photo Library, no matter how old, can be AI-edited as long as it's downloaded to your device.
The original photo is not modified; an edited version is saved as a separate version (editing history is also retained).
To revert, tap "Revert" in the editing screen — you can undo at any time.
Any photo from Recent, Favorites, or Albums in the Photos app can be targeted.
Live Photos, Portrait mode, and Night mode photos are also expected to be supported.
It's like having a "magic scanner" that can refresh your entire old family photo album.
One caveat: if your iCloud Photo Library is set to "Optimize iPhone Storage," only low-resolution previews may be stored on the device, making editing unavailable.
In that case, switch to "Download and Keep Originals" and temporarily download the photos you want to edit.
Processing time: 2–10 seconds per image; expect 5–15 minutes to process 100 images in bulk.
Battery consumption is about 1.5 times normal usage — connecting to a charger is recommended.
A. Some work will be displaced; other work will not.
Most vulnerable: "everyday snapshot editing" and "editing photos for social media posts" — work that anyone can do.
More resistant: "weddings, coming-of-age ceremonies, Shichi-Go-San" and other life-highlight shoots that require skill and artistic sensibility.
Also resilient: "product photography," "advertising photography," "architectural photography" — professional lighting design and composition expertise remain in steady demand.
Conversely, "casual family portrait sessions" and "business headshots" can increasingly be substituted by AI correction — the freelance market will become tougher.
It's like how household cleaning services have automated "routine cleaning" but "deep cleaning" remains a human domain.
Survival strategies for professional photographers: ① specialize in "what AI can't do" (weddings, commemorative shoots, etc.); ② go hybrid and "use AI to the fullest"; ③ evolve into a comprehensive "shoot + edit + storytelling" producer.
Industry restructuring toward "the photographer of the AI era" will accelerate from 2026 to 2030.
Photographers who offer clients "relationships" and "storytelling" will be the strongest.
Professionals with human-relationship assets — photo workshops, local community ties, social media presence — will survive.
The right answer isn't "AI will take your job" — it's "co-exist with AI to create new value."
"Change how your photo looks, not what's in it — as if by magic." That's Apple's iOS 27 photo AI strategy.
The three features — Extend, Enhance, and Reframe — represent Apple's serious attempt to close a two-year gap behind Pixel and Galaxy.
On-device processing for uncompromising privacy, combined with deep ecosystem integration, is Apple's own form of differentiation.
Think of it as traditional Japanese craftsmanship being reborn — a master artisan's hands, now empowered by the latest tools.
After the official iOS 27 release in September 2026, iPhone users around the world will experience a new era of photo AI.
For Japanese users, full Japanese support at launch means enjoying the cutting edge on equal footing with English-speaking markets.
Three things you can do starting today: reserve your spot for the WWDC live stream on June 8, check whether your device is compatible, and organize your iCloud photo library. Whether to actively embrace the photo revolution of the AI era — or to let it wash over you — is a choice only we, the users, can make.
This article is a cross-post from AI Friends.
