Apple is set to infuse its Vision Pro headset with a suite of powerful AI features under the banner of Apple Intelligence. This new update, part of visionOS 2.4, brings together a range of capabilities—some familiar, others entirely novel—that aim to redefine how users interact with both their digital memories and day-to-day tasks.

Apple has long been known for its knack for blending hardware with seamless software experiences, and the upcoming Vision Pro update is no exception. With Apple Intelligence, the headset isn’t just about immersive visual display—it’s about smart, intuitive assistance. At its core, the update leverages machine learning to help users access and interact with their digital world more naturally.

One of the standout features is the innovative Create Memory Movie tool, now built directly into the Photos app. Imagine being able to relive your favorite moments on a large-scale virtual screen or within a custom-built virtual environment—all with just a few words. Users simply enter a description or voice prompt, and Apple Intelligence does the heavy lifting by selecting the photo or video that best matches the narrative. It’s not just about nostalgia; it’s about transforming static memories into dynamic, immersive experiences that feel both personal and cinematic.

This feature underscores Apple’s vision of the Vision Pro as a device that’s more than a tool; it’s a medium for storytelling. Whether you’re reminiscing about a family vacation or piecing together a digital scrapbook of your latest adventure, Create Memory Movie is poised to become a favorite for those who value both technology and the art of memory-making.

Beyond reminiscing, Apple Intelligence is also set to change how we work while immersed in virtual environments. One of the more practical integrations is the inclusion of writing tools powered by technology similar to ChatGPT. Whether dictating memos, drafting emails, or refining the tone of a document, Vision Pro users will find that creating and editing text becomes a far more natural process—even when a Bluetooth keyboard isn’t at hand.

For many, writing on a virtual interface could have been a clunky affair, but these new AI-driven features help smooth out the process. Smart replies will allow users to respond to messages with a simple tap, while bulleted summaries and tone adjustments provide a level of assistance that feels both helpful and intuitive. It’s a nod to the broader trend of integrating generative AI into everyday tasks—a trend that has seen rapid adoption across various platforms in recent years.

The new update doesn’t stop at improving productivity. For the creatively inclined, Apple Intelligence brings several features designed to unleash artistic expression. Genmoji and Image Playground allow users to generate images based on prompts, while Image Wand takes rough sketches and refines them into more polished visuals. These tools could prove invaluable for artists and designers looking to experiment without the constraints of traditional software. In essence, Apple is building a digital playground where creativity and technology converge, offering users a taste of what’s possible when AI meets immersive hardware.

Adding another layer to the experience is the natural language search capability within the Photos app. Instead of sifting through countless albums, users can simply describe what they’re looking for, and Apple Intelligence will fetch the perfect memory in moments. This level of intuitive interaction is set to redefine personal archiving and media consumption.

While the new AI features steal much of the spotlight, visionOS 2.4 also includes enhancements aimed at solving practical user issues. An improved Guest Mode makes it easier for friends or family to share the device, ensuring that the Vision Pro is as welcoming as it is powerful. Additionally, two new discovery apps—one tailored for the iPhone and another as an Apple-curated guide within the headset—aim to enrich the content discovery process, ensuring that users are always just a tap away from their next great experience.

It’s worth noting that, initially, Apple Intelligence for visionOS will launch exclusively in US English. However, Apple has assured users that more languages and additional features are on the horizon, gradually expanding the ecosystem throughout the year.

Apple Vision Pro

Apple Vision Pro is a spatial computing device that blends digital content with the physical world using eye, hand, and voice controls. It features an infinite canvas for arranging apps, a personalized entertainment system, and a 3D camera for spatial photos and videos. The device is designed by Apple, with a custom dual-chip system for advanced spatial experiences. It includes a high-performance eye-tracking system, a sophisticated sensor array, and a custom micro-OLED display. The device supports spatial audio, audio ray tracing, and seamless integration with AirPods Pro (2nd generation).

From $3,499 at Apple