Apple Visual Intelligence Is Out With ChatGPT & Google Integration

Dec 12, 2024 - 7:31 am 4 by
Filed Under Apple App Store

Apple Visual Intelligence

Apple yesterday, including what I've been waiting to play with - Apple Visual Intelligence. It seems, at least for now, that Apple Visual Intelligence works with ChatGPT and Google Search but I was not able to trigger it for Apple Maps like the initial demo showed.

Apple wrote:

A new visual intelligence experience builds on Apple Intelligence and helps users learn about objects and places instantly, thanks to the new Camera Control on the iPhone 16 lineup. Visual intelligence can summarize and copy text, translate text between languages, detect phone numbers or email addresses with the option to add to contacts, and more. Camera Control also allows users to search Google so they can see where they can buy an item, or benefit from ChatGPT’s problem-solving skills to ask for an explanation about a complex diagram, such as from class notes. Users are in control of when third-party tools are used and what information is shared.

So sure, I was able to help me find how to buy a similar football with Google:

Apple Visual Intelligence Google

I was able to get it to do some of my homework with ChatGPT:

Apple Visual Intelligence Chatgpt Homework

Even describe the toys I have on my shelf with ChatGPT:

Apple Visual Intelligence Chatgpt Describe

But when I tried local searches of restaurants that I am looking at, it would not work, like we saw in the demo.

Here is the original demo that starts at the 55:05 mark:

ChatGPT is super integrated, just watch this demo from Sam Altman and the OpenAI team:

So this has a ton of potential, if integrated into more AI solutions.

Forum discussion at X.

 

Popular Categories

The Pulse of the search community

Follow

Search Video Recaps

 
- YouTube
Video Details More Videos Subscribe to Videos

Most Recent Articles

Google

Google Is Testing Gemini 2.0 Powered AI Overviews In Search

Dec 12, 2024 - 7:51 am
Google Ads

Google Ads Testing Video Assets For Search Campaigns?

Dec 12, 2024 - 7:41 am
Apple App Store

Apple Visual Intelligence Is Out With ChatGPT & Google Integration

Dec 12, 2024 - 7:31 am
Bing Search

Official: Bing Search Drops Cache Link

Dec 12, 2024 - 7:21 am
Google

Google Tests Sitelinks With Arrow Down To Show More

Dec 12, 2024 - 7:11 am
Search Forum Recap

Daily Search Forum Recap: December 11, 2024

Dec 11, 2024 - 10:00 am
Previous Story: Official: Bing Search Drops Cache Link