Six months ago, OpenAI made a strong impression by presenting its new GPT-4o model, as well as the new advanced voice mode. This functionality relies on GPT-4o’s ability to directly understand (without going through intermediate models) the audio format and images, to offer a new interface that allows you to chat with AI in a fluid and natural way, like if we were talking to a human. Today, this advanced voice mode is already available on ChatGPT, even for French users. But OpenAI is preparing something even more impressive: live video.
An AI that listens to you, and can see
As you can see in the demonstration below, it will be possible to chat with ChatGPT’s AI, while activating the camera (and GPT-4o is able to understand what you show it in the video). It’s like you’re on a call with a real person, with video enabled. In other words, the AI will no longer only be able to hear you, but also to see.
And according to our colleagues at Android Authority, some Internet users have already had the chance to test this new feature on an alpha version.
Trying #ChatGPT‘s new Advanced Voice Mode that just got released in Alpha. It feels like face-timing a super knowledgeable friend, who in this case was super helpful — reassuring us with our new kitten. It can answer questions in real-time and use the camera as input too! pic.twitter.com/Xx0HCAc4To
— Manuel Sainsily (@ManuVision) July 30, 2024
The beta version would arrive soon
In addition, soon OpenAI could offer this new feature to more users. By digging into a beta of the ChatGPT application, Android Authority has indeed discovered elements suggesting that the launch of a beta version of this functionality is in preparation. As a reminder, moving from an alpha version to beta means that the functionality is getting closer to the final version, and that the developer is ready to test it with a larger number of people. As part of the beta test, OpenAI would name this functionality “Live camera”. This would also have provided a warning asking the user not to use ChatGPT’s vision for navigation or for any other decision that has an impact on their health or safety.
Competition is getting tougher in the field of AI
If OpenAI popularized generative AI, it now faces competition from other AI laboratories, such as Anthropic or the French startup Mistral, but also Google. On its Gemini application, Google already offers a mode called Gemini Live which competes with the advanced voice mode. And recently, Google launched a Gemini application for iPhones which allows access to Gemini Live.
- In May, OpenAI presented ChatGPT’s advanced voice mode which allows you to chat with AI as if you were chatting with a human
- This feature is already available, but the company is working on another feature that will add live video to these interactions
- According to Android Authority, this vision feature on ChatGPT is already available in alpha version and it could soon be offered in beta
