Apple on Monday released the next generation of Apple Intelligence, powering Siri AI, an entirely new version of Siri, and capabilities that make the apps and experiences users rely on every day more personal and helpful than ever. Siri AI is a profoundly more capable and conversational assistant with personal context understanding, broad world knowledge, onscreen awareness, and even more systemwide app actions. Siri AI can help users find what they need in the moment, from answering questions on virtually any topic to surfacing relevant information from a user’s messages, emails, photos, and more. And Apple Intelligence makes everyday experiences across Apple products more personal and helpful with new editing capabilities in Photos, intelligent browsing tools in Safari, an all-new Image Playground that can create photorealistic imagery, and more. With Apple’s 2027 software releases, users can now access new Apple Intelligence capabilities across apps. Siri AI begins rolling out today in beta in English, and will expand to French, Japanese, Korean, Portuguese, and Spanish next month. An Entirely New Siri Siri AI is a completely reimagined version of Siri that is more personal and powerful. With detailed responses and rich, natural conversations, Siri AI helps users get more done than ever before. Built on Apple Intelligence, this new version of Siri draws on personal context understanding to help users find what they need in the moment across messages, emails, photos, and more. And with even more systemwide app actions, Siri AI can help users with tasks such as drafting an email from scratch or editing and sharing a set of photos.
For example, if a user asks Siri what a family member suggested as an activity during an upcoming visit, Siri can search the user’s messages and find that they mentioned wanting to bake a family recipe together. It can then pull up the cooking instructions from an email the relative sent previously and add the ingredients to their grocery list in the Reminders app. Siri AI already works seamlessly with apps from Apple’s vast ecosystem of developers. Users can continue to take action in the apps they already use with Siri, like texting a friend in WhatsApp or playing a book on Audible. And soon, users will be able to ask Siri AI to draft an email in Microsoft Outlook, search for a homework assignment in Notability, or add a restaurant recommendation to Tripsy. With onscreen awareness, Siri AI can answer questions or take actions related to the content on a user’s screen. For example, while viewing their favorite sports team’s website, a user can ask Siri to find all the upcoming home games and add them directly to their calendar. And Siri AI can also use broad world knowledge to get up-to-date information on virtually any topic. Whether a user is looking for the score of a football game, tips for planning a vacation, or the best local coffee spot in a new city, Siri AI will leverage information from across the web to deliver helpful, accurate answers.
Users can extend almost any response from Siri into a rich conversation and ask follow-up questions. And users can take advantage of Siri AI anywhere across the system. In addition to saying “Hey Siri,” iPhone users can invoke Siri with the side button, or swipe down from the Dynamic Island to start a conversation and get an in-depth answer. On iPad and Mac, Siri AI is integrated into Spotlight so users can search for answers to almost any question. It is also integrated into systemwide context menus, allowing users to Control-click to ask about images, files, or text on their screen. On Apple Vision Pro, Siri AI leverages spatial computing with a 3D visualization that users can place anywhere in their space, and they can invoke Siri by looking at it and starting to speak. To revisit a past conversation or start a new one, users can open the all-new dedicated Siri app. The Siri app uses iCloud to privately sync conversational history across a user’s products, so they can start chatting with Siri on iPhone, and pick up the conversation on Mac, iPad, Apple Watch, or Apple Vision Pro, bringing together rich conversations in one place.
Expressive Voices and Improved Dictation Powered by the Most Advanced On-Device Model Siri AI offers even more expressive voices, as well as a major boost in accuracy, with systemwide dictation for products that support Apple’s most advanced on-device model ever, AFM Core Advanced. Users have the ability to customize the expressiveness and pace of Siri’s voice so it’s just right for them. Dictation now captures what users say as polished text with greater precision, automatically handling capitalization, punctuation, and formatting as they speak. And with improved speech understanding, users can speak naturally and trust that their words will appear clearly, accurately, and as intended. Visual Intelligence Is Now on iPad, Mac, and Apple Vision Pro With Visual Intelligence, Siri AI offers powerful image understanding and multimodal capabilities, so users can ask questions about visual content across iPhone, iPad, Mac, and Apple Vision Pro. On iPhone, Siri’s multimodal capabilities are integrated right into the Camera app with a brand-new Siri mode, allowing users to get information and take action on what’s in front of them. For example, while looking at a poster for a music festival, a user can ask Siri what the set times are for their favorite artists, and then have Siri automatically create multiple calendar events for the weekend. On iPad, Visual Intelligence is integrated right into the screenshot experience. And on Mac, users can tap into it with a dedicated keyboard shortcut, allowing them to select something on their Mac display and type directly to Siri to get a helpful answer. Visual Intelligence also expands to Apple Vision Pro, allowing users to ask Siri about things just by looking at them, from the content inside app windows to physical objects around them. The Ability to Write and Edit Virtually Anywhere with Siri AI Siri now offers integrated Writing Tools that are more powerful than ever, allowing users to write with Siri AI virtually anywhere they type. Users can describe what they need and Siri can generate a draft from scratch to get the ball rolling. If a user wants to refine what they’ve written, they can describe the change they want to make and Siri can quickly update it.
When writing in Mail and Messages, Siri can reflect how users usually communicate with each recipient, including the punctuation and tone they typically use. Users can ask Siri for tips and suggestions to improve their written work. Plus, Apple Intelligence now automatically proofreads for users as they type across the system, including within most third-party apps.
Powerful AI Capabilities Integrated into Everyday Experiences In addition to Siri AI, Apple Intelligence powers many more new capabilities in the apps users rely on every day: • The Photos app taps into more powerful image models to provide new ways to edit photos, while still respecting the original moment as it was captured. With Spatial Reframing, users can improve the composition of a photo by adjusting the camera perspective after the photo was taken. Users can also expand their shots with the Extend tool to give their subjects more breathing room, and the popular Clean Up tool is more powerful than ever, allowing users to remove distractions from their photos with even better quality and more realistic infill. • Powered by a new generative model that runs on Private Cloud Compute, Image Playground is more powerful and useful than ever, giving users the ability to create high-quality images in virtually any style — now including photorealistic — and simply describe any changes they want to make. This capability extends to the new Siri, allowing users to generate images just by describing them in the Siri AI app, powered by Image Playground. And with upcoming support for the SynthID standard, users can identify images generated or edited with AI using Apple Intelligence-powered tools. • Safari adds new tools that transform how users can browse the web. Now, Safari can simplify the browsing experience by automatically organizing a user’s tabs into topics. It can also notify users of website changes, like product restocks or price drops, with Notify Me, and create custom extensions based on a user’s description. • In Mail and Messages, Smart Reply can draw on a user’s personalized writing style, and Suggestions in Mail are even more capable with the ability to take actions with third-party apps. • With Call Context in Phone, users can proactively receive relevant information, like a confirmation code or reservation number, when they’re calling a business. • In Calendar, users can now add or modify events with simple descriptions. • Shortcuts is more approachable than ever. With the ability to describe a shortcut, users can create complex automations simply by describing what they want. • The Home app adds the ability to understand related notifications as a single activity, view what’s happening across a sequence of video clips with generated video descriptions, search for clips across multiple cameras, and access noteworthy ones at the top of the Search page. Coming Later This Year: New Audio Intelligence and Health Capabilities Since Apple Watch is always on a user’s wrist, it is the perfect device to help users stay alert to important sounds and stay present and engaged in conversations throughout the day. With the built-in microphone, the power of the S11 chip, the latest Apple Audio Intelligence features include: • Sound Recognition, which comes to Apple Watch to alert users who are deaf or hard of hearing of important sounds, even when their iPhone isn’t with them. This feature listens for sounds like sirens, alarms, doorbells, or a baby crying, and uses on-device intelligence to notify users when they’re detected. • Live Rewind, which can help users recall what was just said in conversation. A double press of the Digital Crown shows the previous 15 seconds of a conversation as a text snippet, so users can catch something they may have missed or are less familiar with. Users can ask Siri about the content of the text or save it to the Siri app to revisit later. • Siri Recap, which can create high-level summaries of conversations that users can review later to jog their memory. When Siri Recap is turned on, after a conversation, Apple Intelligence automatically generates a title and key points in the new Siri app, allowing users to be more present and engaged in the moment. • Shazam, which instantly detects the music playing around the user and automatically displays the song title and artist’s name on the Music Recognition widget in the Smart Stack, easily glanceable on the wrist.
Audio Intelligence features are private by design, combining hardware, software, and services to protect user privacy in a way that only Apple can. These features do not create or store audio recordings, and the raw audio used for processing is completely inaccessible to the operating systems, apps, the user, or Apple. This is because the S11 chip on Apple Watch Series 12 and Apple Watch Ultra 4 includes Secure Exclave, a dedicated hardware-isolated compartment that processes audio in complete isolation from the rest of the system, then immediately deletes it. Users are in control and can choose whether to opt in to each Audio Intelligence feature. They can decide exactly where and when Siri Recap takes notes, and can turn Siri Recap on or off at any time, right from Control Center. By design, Audio Intelligence features do not identify and attribute speakers, to protect the privacy of both the user and those around them. Siri Recap produces a brief, high-level summary of conversations — not a transcript — and is designed to exclude sensitive information like financial information or government-assigned identifiers. Live Rewind plays an audible chime when it is being used, even if Apple Watch is on silent, and shows a full-display animation and microphone indicator so people nearby can hear and see that the feature has been activated. Live Rewind text snippets and Siri Recap summaries are end-to-end encrypted in the Siri app with iCloud syncing, and are not accessible even by Apple. Learn more about how Audio Intelligence protects privacy. Siri Recap and Live Rewind arrive in beta later this year. In addition, the Health app gets a new design, turning a user’s metrics into personalized guidance with Apple Intelligence at its core. The new Insights tab has a summary generated by Apple Intelligence that highlights a user’s most timely information, surfacing details like the latest on their sleep or peak VO2 max. Users will also get personalized guidance from the Health app. For example, if they are working to improve their cardiovascular health, they may see suggestions to incorporate intervals in their regular morning run — recommendations that dynamically adapt to the user and their data. The new health capabilities will be available later this year.
A Bold Architecture, Built Privacy-First These new capabilities are powered by the next generation of Apple Foundation Models, custom-built in collaboration with Google and its Gemini models for deeply integrated Apple Intelligence experiences. These latest models run on device and on servers using Private Cloud Compute. Every facet of new Apple Intelligence architecture is built privacy-first, from the latest Apple Foundation Models to the core operating system technologies that integrate these models deep into Apple’s platforms. Apple Intelligence uses on-device processing and Private Cloud Compute to help protect users’ privacy. Private Cloud Compute gives users access to frontier-level intelligence while extending the privacy and security of iPhone into the cloud. When Private Cloud Compute is handling users’ requests, their personal data is not stored nor made accessible to Apple or anyone else. Outside experts can continue to verify this privacy promise at any time. Siri has been rebuilt from the ground up with powerful AI, taking full advantage of the bold new architecture for Apple Intelligence. Additionally, Siri AI uses the system orchestrator to tap into core capabilities like the Spotlight index and App Toolbox, which work entirely on device to keep users in control of their data. With powerful new features and unrivaled privacy protections, Siri remains the world’s most private digital assistant, backed by a bold architecture that allows Apple to deliver innovative new features with privacy and security at their core. Pricing and Availability • Apple Intelligence in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 is available on iPhone 16 models or later, iPhone 15 Pro, iPhone 15 Pro Max, iPad mini (A17 Pro), iPad models with M1 or later, MacBook Neo (A18 Pro), Mac models with M1 or later, Apple Vision Pro, Apple Watch Series 9 or later, Apple Watch Ultra 2 or later, and Apple Watch SE 3 when paired with an Apple Intelligence-enabled iPhone nearby. • Apple Intelligence is available with Siri settings and device language set to Chinese (simplified), Chinese (traditional), Danish, Dutch, English, French, German, Italian, Japanese, Korean, Norwegian, Portuguese, Spanish, Swedish, Turkish, or Vietnamese. Some features may not be available in all regions or languages. Some devices may not be available in all regions. • Siri AI is rolling out in beta in English in iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27, and requires an Apple Intelligence-enabled device set to a supported language. Support for French, Japanese, Korean, Portuguese, and Spanish is coming next month. • Siri AI will not be available initially in the EU on iOS, iPadOS, and watchOS. Features that rely on Siri AI will also not be available in the EU on iOS, iPadOS, and watchOS. Apple is working hard to find a path forward that preserves its users’ privacy and security. • Siri AI and the other new Apple Intelligence features will not be available in China while Apple works through regulatory requirements. • Certain Apple Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Siri AI, intelligent photo editing tools, Image Playground, and AFM 3 Cloud models in Shortcuts. Daily limits may vary by feature, request complexity, system demand, system policies, and other factors. Expanded access to such features will be available for a fee in the future. Use of these features is subject to Apple Intelligence terms and conditions. Learn more at apple.com/apple-intelligence.
Apple’s most powerful on-device model and the features it enables, like expressive voices and more advanced dictation, are available on iPhone Duo, iPhone 18 Pro, iPhone 18 Pro Max, iPhone Air, iPhone 17 Pro, iPhone 17 Pro Max, iPad (M4) or later with at least 12GB of unified memory, and Mac (M3) or later with at least 12GB of unified memory. The model and expressive voices are also available on Apple Vision Pro (M5). SynthID will be available in a software update later this year, and will be included for most edited images, depending on the edits applied. Home app’s ability to understand related notifications as a single activity, view what’s happening across a sequence of video clips with generated video descriptions, search for clips across multiple cameras, and access noteworthy ones at the top of the Search page requires a home hub such as HomePod (2nd generation), HomePod mini, or Apple TV 4K with the latest operating system software. The owner of the home must have an Apple Intelligence-enabled iPhone, have Apple Intelligence enabled in the Home app, and subscribe to an eligible iCloud+ plan. Audio Intelligence includes Live Rewind, Siri Recap, Sound Recognition, and faster Shazam, and requires Apple Watch Series 12 or Apple Watch Ultra 4. Live Rewind and Siri Recap will be available in beta in late 2026, and require an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). They will be available in English to start and will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354. Sound Recognition requires Apple Watch Series 12 or Apple Watch Ultra 4. Live Rewind will be available in beta in late 2026, and requires Apple Watch Series 12 or Apple Watch Ultra 4, paired with an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). It will be available in English to start and will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354. Siri Recap will be available in beta in late 2026 and requires Apple Watch Series 12 or Apple Watch Ultra 4, paired with an Apple Intelligence-enabled iPhone 16 or later (excluding iPhone 16e). Available in English to start. Siri Recap will not initially be available in the EU. Certain Audio Intelligence features that rely on server-side models are subject to daily usage limits, including but not limited to Live Rewind and Siri Recap. For more information, visit support.apple.com/148354. Faster Shazam requires Apple Watch Series 12 or Apple Watch Ultra 4. The redesigned Health app is available on Apple Intelligence-enabled iPhone and iPad models with the latest software, with select features available only on iPhone. Some features may not be available in all regions or languages. Health Age requires Apple Watch. The test to estimate VO2 max requires Apple Watch, AirPods Pro 3, or a third-party heart rate sensing device. Some features require users to be 18 or older. For information on Apple Intelligence availability, visit support.apple.com/en-us/121115. Support MacDailyNews at no extra cost to you by using this link to shop at Amazon. The post Apple’s Siri AI, a profoundly more capable and personal assistant, is finally here appeared first on MacDailyNews. Invite your friends and earn rewards
If you enjoy MacDailyNews, share it with your friends and earn rewards when they subscribe.
|
No comments:
Post a Comment