• Education
    • Higher Education
    • Scholarships & Grants
    • Online Learning
    • School Reforms
    • Research & Innovation
  • Lifestyle
    • Travel
    • Food & Drink
    • Fashion & Beauty
    • Home & Living
    • Relationships & Family
  • Technology & Startups
    • Software & Apps
    • Startup Success Stories
    • Startups & Innovations
    • Tech Regulations
    • Venture Capital
    • Artificial Intelligence
    • Cybersecurity
    • Emerging Technologies
    • Gadgets & Devices
    • Industry Analysis
  • About us
  • Contact
  • Advertise with Us
  • Privacy & Policy
Today Headline
  • Home
  • World News
    • Us & Canada
    • Europe
    • Asia
    • Africa
    • Middle East
  • Politics
    • Elections
    • Political Parties
    • Government Policies
    • International Relations
    • Legislative News
  • Business & Finance
    • Market Trends
    • Stock Market
    • Entrepreneurship
    • Corporate News
    • Economic Policies
  • Science & Environment
    • Space Exploration
    • Climate Change
    • Wildlife & Conservation
    • Environmental Policies
    • Medical Research
  • Health
    • Public Health
    • Mental Health
    • Medical Breakthroughs
    • Fitness & Nutrition
    • Pandemic Updates
  • Sports
    • Football
    • Basketball
    • Tennis
    • Olympics
    • Motorsport
  • Entertainment
    • Movies
    • Music
    • TV & Streaming
    • Celebrity News
    • Awards & Festivals
  • Crime & Justice
    • Court Cases
    • Cybercrime
    • Policing
    • Criminal Investigations
    • Legal Reforms
No Result
View All Result
  • Home
  • World News
    • Us & Canada
    • Europe
    • Asia
    • Africa
    • Middle East
  • Politics
    • Elections
    • Political Parties
    • Government Policies
    • International Relations
    • Legislative News
  • Business & Finance
    • Market Trends
    • Stock Market
    • Entrepreneurship
    • Corporate News
    • Economic Policies
  • Science & Environment
    • Space Exploration
    • Climate Change
    • Wildlife & Conservation
    • Environmental Policies
    • Medical Research
  • Health
    • Public Health
    • Mental Health
    • Medical Breakthroughs
    • Fitness & Nutrition
    • Pandemic Updates
  • Sports
    • Football
    • Basketball
    • Tennis
    • Olympics
    • Motorsport
  • Entertainment
    • Movies
    • Music
    • TV & Streaming
    • Celebrity News
    • Awards & Festivals
  • Crime & Justice
    • Court Cases
    • Cybercrime
    • Policing
    • Criminal Investigations
    • Legal Reforms
No Result
View All Result
Today Headline
No Result
View All Result
Home Science & Environment

AI Report Highlights Smaller, Better, Cheaper Models todayheadline

April 10, 2025
in Science & Environment
Reading Time: 6 mins read
A A
0
Conceptual and abstract digital generated image of multiple AI chat icons hovering over a digital surface
4
SHARES
9
VIEWS
Share on FacebookShare on Twitter


Where AI Is Now: Smaller, Better, Cheaper Models

A state of the AI industry report shows that 2024 was a breakthrough year for small, sleek models to rival the behemoths

By Nicola Jones & Nature magazine

Top AI models’ performance is improving quickly, and the competition between them is growing ever fiercer.

The artificial intelligence (AI) race is heating up: the number and quality of high-performing Chinese AI models is rising to challenge the US lead, and the performance edge between top models is shrinking, according to an annual state of the industry report.

The report highlights that as AI continues to improve quickly, no one firm is pulling ahead. On the Chatbot Arena Leaderboard, which asks users to vote on the performance of various bots, the top-ranked model scored about 12% higher than the tenth-ranked model in early 2024, but only 5% higher in early 2025 (see ‘All together now’). “The frontier is increasingly competitive — and increasingly crowded,” the report says.

The Artificial Intelligence Index Report 2025 was released today by the Institute for Human Centered AI at Stanford University in California.


On supporting science journalism

If you’re enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


All together now. Line chart showing Chatbot Arena scores for Google, OpenAI, DeepSeek, xAI, Anthropic, Meta and Mistral AI from January 2024. The world’s top AI models are converging in performance, as measured by scores of human preference for the answers from various providers’ chatbots.

Nature; Source: AI Index Report 2025

The index shows that notable generative AI models are, on average, still getting bigger, by using more decision-making variables, more computing power and bigger training data sets. But developers are also proving that smaller, sleeker models are capable of great things. Thanks to better algorithms, a modern model can now match the performance that could be achieved by a model 100 times larger two years ago. “2024 was a breakthrough year for smaller AI models,” the index says.

Bart Selman, a computer scientist at Cornell University in Ithaca, New York, who was not involved in writing the Index report, says it’s good to see relatively small, cheap efforts such as China’s DeepSeek proving they can be competitive. “I’m predicting we’ll see some individual teams with five people, two people, that come up with some new algorithmic ideas that will shake things up,” he says. “Which is all good. We don’t want the world just to be run by some big companies.”

Neck and neck

The report shows that the vast majority of notable AI models are now developed by industry rather than academia: a reversal of the situation in the early 2000s, when neural nets and generative AI had not yet taken off. Industry produced fewer than 20% of notable AI models before 2006, but 60% of them in 2023 and nearly 90% in 2024, the report says.

The United States continues to be the top producer of notable models, releasing 40 in 2024, compared with China’s 15 and Europe’s 3. But plenty of other regions are joining the race, including the Middle East, Latin America and southeast Asia.

And the previous US lead in terms of model quality has disappeared, the report adds. China, which produces the most AI publications and patents, is now developing models that match their US competition in performance. In 2023, the leading Chinese models lagged behind the top US model by nearly 20 percentage points on the Massive Multitask Language Understanding test (MMLU), a common benchmark for large language models. However, as of the end of 2024, the US lead had shrunk to 0.3 percentage points.

“Around 2015, China put itself on the path to be a top player in AI, and they did it through investments in education,” says Selman. “We’re seeing that’s starting to pay off.”

The field has also seen a surprising surge in the number and performance of ‘open weight’ models such as DeepSeek and Facebook’s LLaMa. Users can freely view the parameters that these models learn during training and use to make predictions, although other details, such as the training code, might remain secret. Originally, closed systems, in which none of these factors are disclosed, were markedly superior, but the performance gap between top contenders in these categories narrowed to 8% in early 2024, and to just 1.7% in early 2025.

“It’s certainly good for anyone who can’t afford to build a model from scratch, which is a lot of little companies and academics,” says Ray Perrault, a computer scientist at SRI, a non-profit research institute in Menlo Park, California, and co-director of the report. OpenAI in San Francisco, California, which developed the chatbot ChatGPT, plans to release an open-weight model in the next few months.

Better, smaller, cheaper

After the public launch of ChatGPT in 2022, developers put most of their energy into making systems better by making them bigger. That trend continues, the index reports: the energy used to train a typical leading AI model is currently doubling annually; the amount of computing resources used per model is doubling every five months; and the training data sets are doubling in size every eight months.

Yet companies are also releasing very capable small models. The smallest model registering a score higher than 60% on the MMLU in 2022, for example, used 540 billion parameters; by 2024, a model achieved the same score with just 3.8 billion parameters. Smaller models train faster, give faster answers and use less energy than larger ones. “It helps everything,” says Perrault.

Some smaller models can emulate the behaviour of larger models, says Selman, or take advantage of better algorithms and hardware than those in older systems. The index reports that the average energy efficiency of hardware used by AI systems improves by about 40% annually. As a result of such advances, the cost of scoring just over 60% on the MMLU has plummeted, from about US$20 per million tokens (bits of words produced by language models) in November 2022 to 7 cents per million tokens in October 2024.

Despite striking improvements on several common benchmark tests, the index highlights that generative AI still suffers from issues such as implicit bias and a tendency to ‘hallucinate’, or spit out false information. “They impress me in many ways, but horrify me in others,” says Selman. “They surprise me in terms of making very basic errors.”

This article is reproduced with permission and was first published on April 7, 2025.

Previous Post

Space leaders emphasize collaboration amid geopolitical challenges

Next Post

‘People were getting yippy’: Donald Trump’s 90-day pause triggers Wall Street surge todayheadline

Related Posts

Bacteria list

OCD’s Origins Might Not Lie in The Brain Like We Thought : ScienceAlert todayheadline

July 7, 2025
6
YouTube Thumbnail

Scientists Discovered This Amazing Practical Use For Leftover Coffee Grounds : ScienceAlert todayheadline

July 7, 2025
2
Next Post
ET logo

‘People were getting yippy’: Donald Trump's 90-day pause triggers Wall Street surge todayheadline

  • Trending
  • Comments
  • Latest
Family calls for change after B.C. nurse dies by suicide after attacks on the job

Family calls for change after B.C. nurse dies by suicide after attacks on the job

April 2, 2025
Pioneering 3D printing project shares successes

Product reduces TPH levels to non-hazardous status

November 27, 2024

Police ID man who died after Corso Italia fight

December 23, 2024

Hospital Mergers Fail to Deliver Better Care or Lower Costs, Study Finds todayheadline

December 31, 2024
Harris tells supporters 'never give up' and urges peaceful transfer of power

Harris tells supporters ‘never give up’ and urges peaceful transfer of power

0
Des Moines Man Accused Of Shooting Ex-Girlfriend's Mother

Des Moines Man Accused Of Shooting Ex-Girlfriend’s Mother

0

Trump ‘looks forward’ to White House meeting with Biden

0
Catholic voters were critical to Donald Trump’s blowout victory: ‘Harris snubbed us’

Catholic voters were critical to Donald Trump’s blowout victory: ‘Harris snubbed us’

0
Iranian poet Payam Feili, who was granted political asylum by Israel, at the entrance of his building in Haifa on July 1, 2025. (Rossella Tercatin/Times of Israel)

Iranian dissident poet in Israel prays recent war marks beginning of regime’s end

July 7, 2025
Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

July 7, 2025

Roblox's SWOT analysis: gaming giant's stock faces AI-driven future todayheadline

July 7, 2025
Bacteria list

OCD’s Origins Might Not Lie in The Brain Like We Thought : ScienceAlert todayheadline

July 7, 2025

Recent News

Iranian poet Payam Feili, who was granted political asylum by Israel, at the entrance of his building in Haifa on July 1, 2025. (Rossella Tercatin/Times of Israel)

Iranian dissident poet in Israel prays recent war marks beginning of regime’s end

July 7, 2025
3
Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

July 7, 2025
5

Roblox's SWOT analysis: gaming giant's stock faces AI-driven future todayheadline

July 7, 2025
6
Bacteria list

OCD’s Origins Might Not Lie in The Brain Like We Thought : ScienceAlert todayheadline

July 7, 2025
6

TodayHeadline is a dynamic news website dedicated to delivering up-to-date and comprehensive news coverage from around the globe.

Follow Us

Browse by Category

  • Africa
  • Asia
  • Basketball
  • Business & Finance
  • Climate Change
  • Crime & Justice
  • Cybersecurity
  • Economic Policies
  • Elections
  • Entertainment
  • Entrepreneurship
  • Environmental Policies
  • Europe
  • Football
  • Gadgets & Devices
  • Health
  • Medical Research
  • Mental Health
  • Middle East
  • Motorsport
  • Olympics
  • Politics
  • Public Health
  • Relationships & Family
  • Science & Environment
  • Software & Apps
  • Space Exploration
  • Sports
  • Stock Market
  • Technology & Startups
  • Tennis
  • Travel
  • Uncategorized
  • Us & Canada
  • Wildlife & Conservation
  • World News

Recent News

Iranian poet Payam Feili, who was granted political asylum by Israel, at the entrance of his building in Haifa on July 1, 2025. (Rossella Tercatin/Times of Israel)

Iranian dissident poet in Israel prays recent war marks beginning of regime’s end

July 7, 2025
Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

Sloppy USMNT performances to blame as U.S. loses yet another Gold Cup final to Mexico

July 7, 2025
  • Education
  • Lifestyle
  • Technology & Startups
  • About us
  • Contact
  • Advertise with Us
  • Privacy & Policy

© 2024 Todayheadline.co

Welcome Back!

OR

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Business & Finance
  • Corporate News
  • Economic Policies
  • Entrepreneurship
  • Market Trends
  • Crime & Justice
  • Court Cases
  • Criminal Investigations
  • Cybercrime
  • Legal Reforms
  • Policing
  • Education
  • Higher Education
  • Online Learning
  • Entertainment
  • Awards & Festivals
  • Celebrity News
  • Movies
  • Music
  • Health
  • Fitness & Nutrition
  • Medical Breakthroughs
  • Mental Health
  • Pandemic Updates
  • Lifestyle
  • Fashion & Beauty
  • Food & Drink
  • Home & Living
  • Politics
  • Elections
  • Government Policies
  • International Relations
  • Legislative News
  • Political Parties
  • Africa
  • Asia
  • Europe
  • Middle East
  • Artificial Intelligence
  • Cybersecurity
  • Emerging Technologies
  • Gadgets & Devices
  • Industry Analysis
  • Basketball
  • Football
  • Motorsport
  • Olympics
  • Climate Change
  • Environmental Policies
  • Medical Research
  • Science & Environment
  • Space Exploration
  • Wildlife & Conservation
  • Sports
  • Tennis
  • Technology & Startups
  • Software & Apps
  • Startup Success Stories
  • Startups & Innovations
  • Tech Regulations
  • Venture Capital
  • Uncategorized
  • World News
  • Us & Canada
  • Public Health
  • Relationships & Family
  • Travel
  • Research & Innovation
  • Scholarships & Grants
  • School Reforms
  • Stock Market
  • TV & Streaming
  • Advertise with Us
  • Privacy & Policy
  • About us
  • Contact

© 2024 Todayheadline.co