Heres what to expect ahead of the launch in fall 2024.
What is Apple Intelligence?
Apple Intelligence is Apples version of large language model (LLM) artificial intelligence.
Apple
Its a lot like existingtools like ChatGPT and Google Gemini, except it works solely within Apples ecosystem.
Many of Apples existing tools and apps will receive support for Apple Intelligence when the feature launches.
Siri is the interface through which users will primarily interact with the AI model.
Apple
The new and improved Siri can better understand spoken requests, including those where you stumble over your words.
Youll be able to issue more complex commands and Siri should be able to understand them.
Context is maintained so Siri stays on the same page, every step of the way.
Apple
A new feature called punch in-to-Siri lets you issue commands to Siri without using your voice.
Siri will also be able to understand whats happening on your screen at any given moment.
This will allow you to issue commands related to whatever information is on-screen.
Apple
One example is adding an address to a contact card while chatting in a Messages window.
On the iPhone, Siri also gets a brand-new look.
you’re free to generate new versions or revert to the original text at any time.
Apple
Context-aware replies let you generate responses based on the contents of a message or email.
These appear in theQuick throw in box on an iPhone, and provide prompts to gather information.
you’ve got the option to tap a few boxes and Apple Intelligence will respond in kind.
Apple
In addition to rewriting and responding, a new proofreading tool shows grammar and spelling mistakes.
Apple Intelligence can analyze bodies of text and make decisions based on the context.
This is applied to things like your email inbox with smart prioritization.
Apple
, where youll see your most important messages at the top of your inbox.
Lastly, Apple Intelligence will sort your notifications based on importance.
Generate Images Like Custom Emoji
Apples model also includes generative image capabilities, starting with Genmoji.
Apple
you could thensend them as tapbacks,stickers, or as in-line emoji in your messages.
Apple also showed off a feature that generates emoji based on contact appearance.
Image Playground is Apples version of a generative AI image tool, likeDALL-Eand Midjourney.
Apple
Image generation takes place on your unit.
An extension of Image Playground called Image Wand adds context-aware generation to other apps.
Apple Intelligence also brings prompt-based editing to Photos.
Apple is also making it easier to create memory movies from your Photos library.
This is par for the course when it comes to AI-generated images.
The variety of commands was varied enough to get us excited about the potential.
If Apple can pull it off, this could be something special.
By leveraging this context, these AI-powered operations become personal.
They become a lot more useful, and a lot more relevant.
Search is one area where this context can really come in handy.
Siri can make use of all of the information on your unit that the assistant already knows.
Privacy is Built-In
The other big deal with Apples implementation is the companys focus on privacy.
Many of these requests will take place entirely on-equipment.
For tasks that require more processing power, Apples Private Cloud Compute steps up.
Your gear will allegedly only send relevant data to Apples servers when necessary.
This data is never stored and supposedly never accessible to Apple.
These servers were built by Apple using its own Apple Silicon chips specifically for Apple Intelligence.
It remains to be seen just how many of these requests can be performed on-machine.
Apple is all-in on AI at this point, so expect future chip designs to prioritize Apple Intelligence capabilities.
Once youve given your permission the request will be processed and youll get a response.
ChatGPT integration will be free to all Apple Intelligence users.
