Anthropic’s newest Claude chatbot beats OpenAI’s GPT-4o in some benchmarks

Date:

Share:


Anthropic rolled out its newest AI language model on Thursday, Claude 3.5 Sonnet. The updated chatbot outperforms the company’s previous top-tier model, Claude 3 Opus, while working at twice the speed. Claude users (including those on free accounts) can check it out beginning today.

Sonnet, which tends to be Anthropic’s most balanced model, is the first release in the Claude 3.5 family. The company says Claude 3.5 Haiku (the fastest in each generation) and Claude 3.5 Opus (the most powerful) will arrive later this year. (Those models will stay on version 3 in the meantime.) The Sonnet update comes only a few months after the arrival of the Claude 3 family, showcasing the breakneck speed AI companies are working to spit out their latest and greatest.

Chart showing benchmarks comparisons between recent AI chatbot models: Claude 3.5 Sonnet, Claude 3 Opus, GPT-4o, Gemini 1.5 Pro and Llama-400b.

Anthropic

Anthropic claims Claude 3.5 Sonnet marks a step forward in understanding nuance, humor and complicated prompts, and it can write in a more natural tone. Benchmarks (above) show the new model breaking industry records for graduate-level reasoning, undergraduate-level knowledge and coding proficiency. It beats OpenAI’s GPT-4o on many of the benchmarks Anthropic published. However, the latest Claude, ChatGPT, Gemini and Llama models tend to score within a few percentage points of each other on most tests, underscoring the tight competition.

The company claims Claude 3.5 Sonnet is also better at interpreting visual input than Claude 3.0 Opus. Anthropic says the new model can “accurately transcribe text from imperfect images,” a skill it hopes will attract customers in retail, logistics and financial services who need to grok data from charts, graphs and other visual cues.

Claude’s update also brings a new workspace the company calls Artifacts (above). When you prompt the chatbot to generate content like code, text documents or web designs, a dedicated window appears to the right of the chat. From there, you can prompt Claude to make changes, and it will keep the Artifacts window updated with its latest output.

The company sees Artifacts as a first step towards making Claude a space for broader team collaboration. “In the near future, teams — and eventually entire organizations — will be able to securely centralize their knowledge, documents, and ongoing work in one shared space, with Claude serving as an on-demand teammate,” the company wrote in a press release.

Claude 3.5 Sonnet is available now for anyone with an account to try on its website, as well as in the Claude iOS app. (On both of those platforms, Claude Pro and Team subscribers get higher token counts.) You can also access it through the Anthropic API, Amazon Bedrock and Google Cloud’s Vertex AI. It costs $3 per million input tokens and $15 per million output tokens — the same as the previous model.



Source link

━ more like this

Check out NASA’s skywatching tips for July | Tech Reader

NASA is back with another rundown on what to look out for in the sky in the coming weeks. Planets galore For example, there’s plenty...

Xbox Live is down, so you can’t sign into your Xbox account | Tech Reader

Xbox Live experienced a major sign-in outage Tuesday afternoon that made it impossible to log into your Xbox profile to play games online. I...

Google’s greenhouse gas emissions climbed nearly 50 percent in five years due to AI

Google’s greenhouse gas emissions spiked by nearly 50 percent in the last five years thanks to energy-guzzling data centers required to power artificial...

Best OLED monitor deals: Get an OLED screen from just $450 | Tech Reader

OLED TVs have some of the best image fidelity on the market, but if you’re looking for a similar experience when on the...

A new Resident Evil game is in the works from the director of Resident Evil 7

It’s been a hot minute since we’ve had a brand new Resident Evil game. Then again, it’s hard to blame Capcom for that...
spot_img