A new leak, reportedly from sources close to Apple’s AI projects, includes almost everything Siri can do across various iPhone applications.

Siri will understand complex commands

Apple is conducting various tests to make Siri more powerful and to improve its understanding of voice commands given in natural language. It is claimed that the company is intentionally training Siri with difficult-to-understand commands. For example, instead of giving a simple command like “Hey Siri, show me vacation photos,” Apple is testing with ambiguous commands like “I want to create a blog” or “I’m feeling nostalgic right now.” These are not specific commands instructing Siri to do something particular; rather, they are commands that require Siri to interpret and then decide the best way to present what the user might want or need.

The aim is to move Siri beyond needing a specific syntax for tasks. Users won’t need to use exact commands like “turn on the coffee maker”; instead, they can make more natural requests like “Siri, I want some coffee.” The leak also details Siri’s integration with at least 18 built-in iPhone applications. Here are some of the most notable points:

Camera control capabilities

Siri will be able to respond to the user’s voice commands for camera control. Users will be able to switch between video and photo modes, start the timer, and switch between the front and rear cameras using voice commands.

Managing emails

With iOS 18, Siri will use machine learning to automatically classify emails in the Mail app. Siri will be able to perform tasks such as composing, sending, and scheduling emails, marking emails as junk, setting reminders, summarizing emails, and creating “smart replies.”

Photo app enhancements with generative AI

Apple is bringing generative AI features to the Photos app in iOS 18. This will allow iPhone users to remove unwanted objects from photos and fill in gaps, similar to features seen on Android phones.

Summarizing web pages

Apple will integrate Siri with the Safari browser in the iOS 18 update. The assistant will be able to summarize web pages. Simple tasks like creating new tab groups and opening private tabs will be faster through Siri.

Voice note recordings

Users will be able to record voice notes with Siri. Through voice commands, users can instruct Siri to create a new recording, start speaking, stop the recording, name it, and even move it to a specific folder.

System settings control

Siri will also be able to interfere with system settings. It will be able to manage brightness settings, home screen and app library settings, and open multitasking and gesture settings. Siri will also be able to scan documents with the Files app and move specific files to the trash. In the Contacts app, it will be able to edit contact details. In the Magnifier app, it will recognize people and doors along with objects in front of the camera. The System Settings app is expected to get a reorganization with iOS 18 and macOS 15.

Apple will share the details of iOS 18 and other operating system updates at the WWDC24 event on June 10.