Apple WWDC June 2024 Event Live Updates: ChatGPT integration with Siri announced

Apple has announced that third party apps will gain major advantage from Apple Intelligence. 

While Apple Intelligence will be listed as a preview feature as of now, it will work on  iPhone 15 Pro or later, along with Macs or iPads running on M Series chipset. This includes iPhone 15 Pro, iPhone 15 Pro Max, MacBook Pro, iMac, Mac mini, Mac Studio, Mac Pro, MacBook Air, iPad Air, and iPad Pro.

Apple has announced that ChatGPT will be integrated into Siri and other Apple apps powered by generative AI models. Apple says that you will have the option to simply tap into ChatGPT for expertise and it is always an option where your permission will be required and you'll be notified every time you use ChatGPT for an action. Questions you ask ChatGPT will be via Siri. You can even include photos and other visual references in your queries. 

ChatGPT has also been integrated into writing tools like Compose. 

ChatGPT will be coming to iOS 18, iPadOS 18 and MacOS 15 later this year and will be free of cost with no requirements of creating an account for ChatGPT. However, subscription to a ChatGPT plan is required for full access to Siri's paid features, as well as other Apple apps that have integrated ChatGPT support. 

Apple Intelligence will be built into macOS 15 or macOS Sequoia, iOS 18 and iPadOS 18, and its capabilities can be accessed for free. 

This includes a Rewrite feature that makes suggestions on the phrasing of your text like in the Mail app, or Messages. You can also use Apple Intelligence to summarize emails and notifications. 

Apple Intelligence powers image editing in Apple devices too with features like Genmoji that allows you to create emojis with your keyboard. 

Image Playground is supported in apps like Messages, with provisions of previews of different images that are suggested for your text messages. 

These tools are supported in apps like Pages, Keynote and Freeforms too, and developers too can integrate them into their apps. 

The Notes app includes an Image Wand feature that creates clean images from rough sketches using Image Playground. The Clean Up tool can be used to remove objects from the background. 

Apple Intelligence has more interesting features to offer like the ability to generate stories or videos, including chapters and music from the photos and videos in your library.

Additionally, Voice Memos will also be adding transcripts and summaries using the power of Apple Intelligence.

Siri's look has been revamped with light illuminating the edges of your screen. With the power of Apple Intelligence, Siri also takes into account context when responding to queries. 

Using generative AI, Siri will also be able to cross-reference content within the smartphone, along with data available online to respond to queries. 

Siri's latest features can be expected to be made available to developers soon, along with iPhones, iPads and Macs. 

Apple Intelligence is built on large language models and focuses on new writing tools. It will read your notifications, and accordingly help you organise your tasks based on your priorities. 

You can also create original images that you can further personalise using Apple Intelligence with features like sketching, animation or illustration. 

Apple Intelligence can pick up natural commands. While answering queries, it takes into account the context which includes the processing of data like people, events, and locations. 

Apple also aims to secure privacy with Apple Intelligence, for devices using either A17 chipset or M series silicon. Private Cloud Compute will keep data secure on servers powered by Apple silicon. 

Safari now includes a 'summaries' feature with quick summaries of web pages that you need the key information of. Viewer is another feature that puts videos on web pages in picture-in-picture mode. 

As for when these features will roll out, the developer betas are now live, with public betas slated or a July release, and full launch scheduled for later this year. 

macOS 15 will be called macOS Sequoia. It features iPhone Mirroring allowing you to check your iPhone from your Mac and use it as a wireless with the keyboard. Even notifications will appear on the Mac, as your iPhone remains locked on the side. 

Presenter Preview in macOS along with apps like FaceTime or Zoom to provide you a preview of what others are seeing of your screen. 

Game Porting Toolkit 2 improves the method of porting games to the Mac, in addition to similar tools for porting games to iPad or iPhone. 

Along with iOS 18 features like personalised home screen, customisable Control Screen, iPadOS 18 has a floating tab bar for apps. Pages, Numbers, Keynote and Swift Playgrounds apps have been redesigned with new looks. 

SharePlay now supports tapping and drawing with real-time reflections of the caller's device's screen. Users will need to request permission to take over control of the caller's screen which can be used for remote IT support. 

iPad has its own calculator app, designed for the large screen. It includes a Math Notes feature that uses Apple Pencil support to write formulas. 

Smart Script feature helps decipher text from messy handwriting. 

watchOS 11 gets new Training Mode, which allows you to rate your workouts on a scale of 1 to 10. It motivates you to push further, keeping in account how intensely the particular workout affects your body over time. 

New personalisation feature introduces new ways of customising your Apple Watch screen, including a 'pause' button in case of injuries and emergencies. 

The Vitals app keeps track of your health metrics and notifies you if something's off. It also includes a menstruation cycle tracking feature, as pregnancy-friendly features as a part of the Health app.

Multiple new features have been introduced to tvOS including the ability to look up information about actors, and automatic close captions that appear when you mute. There's a new audio enhancement feature, along with support for 21:9 aspect ratio on projectors, new screensavers and more. 

AirPods have gotten new controls that recognises head movements like nods and shakes as responses to Siri. 

Voice Isolation has been improved, in addition to a new API that optimises game audio for game developers. 

Photos app too has been revamped with single view, including the Photo Grid at the top and Collections at the bottom. Recent Days organises your photos by day. Other Collections include People, Pets, Trips and Pinned Collection that uses AI and facial recognition to organise the photos into the categories.

Performance will be enhanced in iOS 18's Game Mode and background activity will be minimised, coupled with Airpods and game controllers that are now more sensitive. 

Topographic maps will now be available on Maps which can be saved and accessed offline. 

Tap to Cash feature has been introduced to Wallet, similar to AirDrop, only for exchanging money within the iPhone community. 

Tapbacks in Messages have been revamped where you can now use emojis or stickers. There's a new Send Later feature for scheduling texts that you can now format with bold, italic, etc. Text Effects add further special visual effects to your messages. 

The Mail app now includes new features like a Primary Category for known senders and scheduled messages, and other categories like shopping and promotions. Emails from senders can be linked to apps on your phone- as a result you can organise messages according to specific companies or labels. Automatic Categorisation is optional but will be available later this year. 

To start with, we have different personalisation features for iPhones like being able to place apps wherever you want on the home screen, along with changes to the app icons in the Dark Mode. Tinted colours of the apps too can now be changed manually. 

Customisations to the Control Center too has been announced. It is now a multiscreen feature with provisions for developers to add controls for their apps. Size of the Control Center widgets too can be adjusted. Camera and flashlight controls on home screen can be switched with other controls of your choice. 

New Privacy Controls have been introduced like the feature to lock specific apps and using passwords to unlock them. You can also arrange apps in a locked Hidden Apps folder that hides your selected apps from public view. 

Virtual display can now be expanded into two side-by-side 4K displays. For developers, new frameworks and APIs for creating spatial apps are now available. 

Apple has also announced a partnership with Blackmagic Design.

Other features of VisionOS 2 include new intuitive gestures. 

Apple Vision Pro will be available starting with wth China, Japan and Singapore on June 28. Five more countries will join the list on July 12. 

Updates to visionOS 2 for Apple Vision Pro have been shared. These include the use of advanced machine learning in the Photos app to create spatial photos of the 2D photos in the gallery. SharePlay is another feature in the Photos app, which lets you share photos and videos with other users represented by their Avatars. 

VisionOS 2 has added Train support that will let you watch videos even while travelling. 

CEO Tim Cook appears to kick-off WWDC24. He begins with a trailer of the upcoming lineup of new Apple Originals shows coming to Apple TV+. 

Apple's WWDC 2024 event will go live in two hours on Apple's official website, YouTube channel and Apple TV, starting with a keynote by CEO Tim Cook at 10:30pm IST.

Expect major AI enhancements across the latest versions of iOS, iPadOS, macOS, and WatchOS, including an overhauled Siri, instant photo editing, AI emojis, and a new Passwords app for secure login management and authentication.