Since OpenAI launched ChatGPT in late November 2022, the free model of ChatGPT has remained comparatively unchanged, utilizing the identical giant language mannequin (GPT-3.5) and consumer interface — and with the identical limitations. Nonetheless, OpenAI’s slew of ChatGPT upgrades will considerably enhance customers’ expertise with the chatbot. 

At OpenAI’s live-streamed occasion on Monday, the corporate unveiled important updates to the free model of ChatGPT that unlock an entire vary of latest multimodal capabilities for customers, together with new and improved voice and picture help.

This is a round-up of the brand new options and what they imply for you.

GPT-4o 

The most important information from the occasion was the launch of a brand new flagship giant language mannequin (LLM) from OpenAI — GPT-4o. Because the identify implies, this mannequin supplies GPT-4 degree intelligence; nevertheless, it boasts a number of upgrades from its predecessor, corresponding to sooner efficiency and multimodal capabilities throughout textual content, voice, and imaginative and prescient. 

Not solely does this improve unlock cutting-edge options — together with a brand new Voice Mode and expanded languages — but it surely lastly offers free customers entry to a lot of the options that had been sometimes restricted to ChatGPT Plus subscribers for $20 per thirty days. 

For instance, free customers can now expertise GPT-4 degree intelligence, get responses from the online by way of ChatGPT Browse with Bing, analyze information, chat about photographs and paperwork, use GPTs, and entry the GPT Retailer. Beforehand, all these options had been obtainable solely to ChatGPT Plus subscribers. 

The benefits that ChatGPT Plus customers proceed to get pleasure from embody 5 instances the capability obtainable to free customers, precedence entry to GPT-4o, and upgrades corresponding to the brand new macOS app. In distinction, free customers will get booted again to GPT-3.5 when GPT-4o is at capability. 

GPT-4o is being rolled out to ChatGPT Plus and Group customers immediately, with availability for Enterprise customers coming quickly, in accordance with the corporate. Free customers even have the LLM rolled out to them; nevertheless, these customers may have some utilization limitations. 

New Voice Mode

The livestream demo that stole the present was the brand new and improved Voice Mode, supercharged with GPT-4o’s new video and audio capabilities. Not like the earlier Voice Mode, customers will now expertise extra pure conversations. For instance, customers can interrupt the voice assistant and have the assistant converse with numerous voices. Within the reside stream demo, the consumer had ChatGPT sing responses or converse in numerous tones, corresponding to “dramatic robotic voice.”

The AI assistant may even be capable of use the context out of your surroundings to offer voice solutions. Within the demo beneath, you may hear ChatGPT’s voice mode chat with the consumer and elaborate on his environment, corresponding to what he’s carrying and the place he’s sitting. 

This may very well be helpful if you need help with what you’re viewing. For instance, if you wish to know the identify of that lovely constructing you encountered just lately in a brand new metropolis, or if you need a menu translated. The live-streamed demo included a portion through which two people had a dialog in two completely different languages, and ChatGPT’s improved Voice Mode translated the complete dialog. 

The improved Voice Mode can be rolling out in alpha within the coming weeks, and ChatGPT Plus customers will get early entry as the corporate rolls it out extra broadly.

Add screenshots, photographs, and paperwork

As talked about above, GPT-4o permits customers to add pictures and paperwork, along with textual content, to get AI insights on the knowledge they want. It is a large win as a result of the function is arguably one of the crucial useful that AI chatbots have to supply, and till now, it has been restricted to ChatGPT Plus customers. Moreover, the one free mainstream chatbot that provided doc add till now was Anthropic’s Claude. 

Some methods customers can profit from the function is by importing PDFs, corresponding to analysis papers or prolonged authorized paperwork, and asking the chatbot for detailed summaries or questions in regards to the content material, to which ChatGPT can present conversational solutions. Customers can use the picture function to assist with content material they’re viewing, corresponding to a math equation on a worksheet or figuring out what kind of plant they’re seeing. 

Expanded languages 

With GPT-4o, ChatGPT now helps greater than 50 languages; you may see the entire record right here. Based on OpenAI, that is designed to make ChatGPT extra accessible to a worldwide viewers. Nonetheless, the expanded languages are additionally useful for on a regular basis customers as a result of they assist with the chatbot’s translation capabilities, which have additionally been improved with the brand new Voice Mode.

New browser interface and app

For the reason that launch of ChatGPT, its consumer interface has not modified in any respect — till now. The chatbot now has what OpenAI calls a “simplified appear and feel” that’s each “friendlier and extra conversational.” When customers go to the web page, they are going to see a brand new house display, message structure, and extra, as seen within the screenshot beneath. 

The modifications appear minimal, with the largest distinction being a cleaner, extra simplified look. Moreover, the corporate is releasing a brand new macOS app to ChatGPT Plus customers beginning immediately, which can be made extra broadly obtainable within the upcoming weeks. The corporate shares that Home windows will get its personal model later this yr. 

GPT Retailer entry 

GPTs are customized ChatGPT chatbots tailor-made to carry out particular duties. They changed ChatGPT plugins in March as a result of they’re simpler for builders to construct; customers can now discover greater than three million GPTs on the GPT Retailer. 

This functionality is efficacious as a result of it permits customers to increase ChatGPT capabilities and combine the AI with a few of their favourite purposes. For instance, Canva has its personal GPT, which permits customers to design initiatives from inside the chatbot. One other instance is the Wolfram GPT, which assists customers with math inside the chatbot interface.