Jump directly to the content
TALK TO ME!

Genius ChatGPT upgrade adds ‘voice chats’ and can now analyse any photo – but blocks dangerous new question

A HUGE ChatGPT upgrade is rolling out now that purports to let the AI app see, hear, and speak.

It's a major update that totally changes the way you can use the app.

You can now show ChatGPT images and ask for information about what you're seeing
1
You can now show ChatGPT images and ask for information about what you're seeingCredit: OpenAI

Until today, you would typically load up ChatGPT and type a message, then wait for a text response.

Now the new version of ChatGPT lets you speak a message out loud.

And if you want, ChatGPT will talk back to you too.

The app has also gained the ability to analyze images that you share too.

"ChatGPT can now see, hear, and speak," OpenAI said in a blog post.

"We are beginning to roll out new voice and image capabilities in ChatGPT.

"They offer a new, more intuitive type of interface by allowing you to have a voice conversation or show ChatGPT what you’re talking about."

For some people, this will be a more natural way to interact with chatbots.

And it means ChatGPT is one step closer to feeling like a lifelike entity.

The image analysis also means that ChatGPT can absorb an entirely new type of data.

"Voice and image give you more ways to use ChatGPT in your life," OpenAI explained.

"Snap a picture of a landmark while traveling and have a live conversation about what’s interesting about it.

"When you’re home, snap pictures of your fridge and pantry to figure out what’s for dinner (and ask follow-up questions for a step-by-step recipe).

"After dinner, help your child with a math problem by taking a photo, circling the problem set, and having it share hints with both of you."

However, OpenAI has limited ChatGPT so you can't ask a dangerous type of question.

It'll be impossible to ask ChatGPT to make "direct statements" about people in images.

So you won't be able to ask who a specific person in a photo is, for example, in hopes of pulling together a load of information about a stranger.

OpenAI said that the system "should respect individuals' privacy."

But OpenAI also said that its safeguards will get better over time as more people use the new version of ChatGPT.

The bad news is that the new features are only available to paid users.

You'll need to be a Plus or Enterprise subscriber to get access to voice and images.

READ MORE SUN STORIES

Voice will be available on iOS and Android, while images will land on all platforms.

The new changes are rolling out now, and will arrive for users "in the next two weeks."

Topics