At Google I/O 2023, Google unveiled an exciting upcoming feature for Google Photos called Magic Editor. Powered by advanced AI technology, Magic Editor promises to deliver remarkable edits to your favorite pictures. But what exactly is Magic Editor, and how does it work?

What is Magic Editor, and how does it work?

Magic Editor is a generative AI-based tool integrated into Google Photos. It harnesses the power of artificial intelligence to assist with subject framing and the generation of new content to fill in when repositioning a subject. Although Magic Editor has only been demonstrated at Google I/O 2023 and is yet to be rolled out, its potential has already captured the imagination of users worldwide.

Google Photos, renowned as one of the most popular photo gallery apps on Android, initially gained popularity through Google’s offer of free unlimited high-quality photo backups to users’ Google accounts. While this promotional offer is no longer unlimited, the app’s popularity has endured due to the continuous addition of innovative features over the years.

Magic Editor is one such feature poised to enhance the utility of Google Photos. By leveraging generative AI and other advanced techniques, Google aims to enable complex edits without requiring users to possess professional-level editing skills.

It’s worth noting that Google Photos has already integrated AI into its functionalities with features such as Magic Eraser and Photo Unblur, both of which have proven surprisingly effective. These successes have raised expectations for the performance of Magic Editor.

Magic Editor features

1. Framing

During the demonstration at Google I/O 2023, one of the standout features showcased was Magic Editor’s ability to reframe photos that have already been captured. This feature empowers users to reposition the subject within the frame, ensuring it is placed in the most optimal spot.
This functionality is particularly useful for individuals who may have had a general vision for their photo but failed to recognize imperfections during the initial capture. With the aid of AI, Magic Editor can align the final photo with the user’s original vision.

2. Generating new content

Magic Editor heavily relies on generative AI, allowing it to excel in tasks that involve generating new content. The demo at I/O illustrated how Google Photos could remove unsightly elements such as a bag strap from a person, using generative AI to fill in the missing content seamlessly.
Combining framing and content generation capabilities, Magic Editor can perform complex transformations. The demos showcased how users can reposition individuals from the sidelines of a waterfall to the perfect location near it. Furthermore, Magic Editor enables users to effortlessly center a person in an image by generating extensions for objects like benches and balloons.

When will Google Photos’ Magic Editor be available?

Early access to the Magic Editor feature will be rolled out to select Pixel phones by the end of 2023. While Google has not provided a specific timeline for this early access, users can expect to experience the feature relatively soon. The early access phase will serve as an opportunity for Google to gather feedback from users and make necessary improvements, ensuring the success of Magic Editor.

Regarding availability, Google has stated that Magic Editor will be exclusively available on select Pixel phones. However, no mention has been made regarding Google One subscribers in their official announcement.

Speculating on the matter, it is likely that the feature will be limited to Pixel phones equipped with the Tensor and Tensor G2 SoCs. This suggests that the Pixel 6 series and the Pixel 7 series (including the A-series) will be compatible. There is a possibility that older Pixel models may not meet the requirements for Magic Editor. Furthermore, it is reasonable to assume that when the feature transitions from early access to a stable release, it will remain restricted to paid Google One subscribers.