At the Worldwide Developer Conference, Apple unveiled several new Apple Intelligence features across its product lineup including iPhone, iPad, Mac, Apple Watch and Apple Vision Pro. Some of these include Live Translation, enhanced Visual Intelligence, and more powerful Image Playground and Gemoji and Shortcuts, which now has direct access to Apple Intelligence.
The tech giant is also opening up Apple Intelligence for third party app developers so they can better integrate with their offerings. Since these large language models process data on the device itself, Apple says the functionalities will work offline as well. Here’s a quick look at some of the Apple Intelligence features coming to several Apple devices with iOS 26, iPadOS 26, macOS 26 and watchOS 26.
Live Translation is available in Messages, FaceTime and the Phone app. (Image Source: Apple)
Live Translation
With Live Translation, Apple says users will be able to communicate with others without any language barrier. The feature is integrated with several first party apps like Messages, Phone and FaceTime, and run entirely on the device itself.
Coming to the Messages app, Apple says Live Translation will “automatically translate messages.” For example, when a user is making plans with their friends when abroad, the message will be translated in real time, and delivered in the recipient’s preferred language. As for FaceTime, the audio will be shown as live captions in the speaker’s original language. If you are on a phone call, the translation will be “spoken aloud throughout the conversation.”
Genmoji and Image Playground
Genmoji and Image Playground, two new Apple Intelligence features that were introduced last year are also getting some upgrades. Now, users will not only be able to generate a Genmoji with text, but also mix and combine emojis to create a new one. Moreover, when making images inspired by your friends or family, Apple says you can now change their expressions and even change personal attributes like hairstyle to match their look.
Image Playground is also getting a bunch of enhancements. The ChatGPT powered functionality can turn images into various styles like vector art and oil painting. You can also use the feature to describe a user or photo to generate a new “unique image.”
Visual Intelligence
The Google Lens powered Visual Intelligence is also getting some new features. For example, users will now be able to ask ChatGPT questions about what they are looking at and search about things on Google, Etsy and select supported apps.
Story continues below this ad
Also, if a user is interested in, say, a lamp, they can now highlight the object to get more information about it online or find similar objects. Using Apple Intelligence, Visual Intelligence will also be able to see if a user is looking at an event and automatically suggest it to add it to their calendar with details like time, location and date.
Apple Intelligence powered Shortcuts
Apple is also bringing its AI feature suite to the Shortcuts app. To maintain privacy, Apple says these features will either be processed on the device itself or with Private Cloud Compute. For example, students can now make a new shortcut that uses Apple Intelligence to compare things like an audio transcription of a lecture to their notes and add key points they may have missed out on.
Apple Watch gets Apple Intelligence treatment
Apple Watch, one of the most popular smartwatches in the world is also getting new AI powered features like Workout Buddy. The new Apple Intelligence powered functionality “incorporates a user’s workout data and fitness history” to give them personalised insights during their workout sessions.
Workout Buddy also analyses data from your current workout while referencing their fitness history for data like heart rate, distance, pace, Activity rings, personal milestones and more. Based on this, the functionality will then use a text-to-speech model to translate them into a “dynamic generative voice built using voice data from Fitness+” to motivate them.
Story continues below this ad
It will be available on Apple with Bluetooth headphones, but users will need an Apple Intelligence supported iPhone nearby. Some of the most popular workout types Workout Buddy is coming to include Outdoor and Indoor Run, Outdoor and Indoor Walk, Outdoor Cycle, HIIT, and Functional and Traditional Strength Training.
