• Education
    • Higher Education
    • Scholarships & Grants
    • Online Learning
    • School Reforms
    • Research & Innovation
  • Lifestyle
    • Travel
    • Food & Drink
    • Fashion & Beauty
    • Home & Living
    • Relationships & Family
  • Technology & Startups
    • Software & Apps
    • Startup Success Stories
    • Startups & Innovations
    • Tech Regulations
    • Venture Capital
    • Artificial Intelligence
    • Cybersecurity
    • Emerging Technologies
    • Gadgets & Devices
    • Industry Analysis
  • About us
  • Contact
  • Advertise with Us
  • Privacy & Policy
Today Headline
  • Home
  • World News
    • Us & Canada
    • Europe
    • Asia
    • Africa
    • Middle East
  • Politics
    • Elections
    • Political Parties
    • Government Policies
    • International Relations
    • Legislative News
  • Business & Finance
    • Market Trends
    • Stock Market
    • Entrepreneurship
    • Corporate News
    • Economic Policies
  • Science & Environment
    • Space Exploration
    • Climate Change
    • Wildlife & Conservation
    • Environmental Policies
    • Medical Research
  • Health
    • Public Health
    • Mental Health
    • Medical Breakthroughs
    • Fitness & Nutrition
    • Pandemic Updates
  • Sports
    • Football
    • Basketball
    • Tennis
    • Olympics
    • Motorsport
  • Entertainment
    • Movies
    • Music
    • TV & Streaming
    • Celebrity News
    • Awards & Festivals
  • Crime & Justice
    • Court Cases
    • Cybercrime
    • Policing
    • Criminal Investigations
    • Legal Reforms
No Result
View All Result
  • Home
  • World News
    • Us & Canada
    • Europe
    • Asia
    • Africa
    • Middle East
  • Politics
    • Elections
    • Political Parties
    • Government Policies
    • International Relations
    • Legislative News
  • Business & Finance
    • Market Trends
    • Stock Market
    • Entrepreneurship
    • Corporate News
    • Economic Policies
  • Science & Environment
    • Space Exploration
    • Climate Change
    • Wildlife & Conservation
    • Environmental Policies
    • Medical Research
  • Health
    • Public Health
    • Mental Health
    • Medical Breakthroughs
    • Fitness & Nutrition
    • Pandemic Updates
  • Sports
    • Football
    • Basketball
    • Tennis
    • Olympics
    • Motorsport
  • Entertainment
    • Movies
    • Music
    • TV & Streaming
    • Celebrity News
    • Awards & Festivals
  • Crime & Justice
    • Court Cases
    • Cybercrime
    • Policing
    • Criminal Investigations
    • Legal Reforms
No Result
View All Result
Today Headline
No Result
View All Result
Home Science & Environment

Free Open-Source Tool Matches Big Tech’s Best in Cracking Tough Patient Cases todayheadline

March 17, 2025
in Science & Environment
Reading Time: 4 mins read
A A
0
9
SHARES
19
VIEWS
Share on FacebookShare on Twitter


In a development that could reshape how hospitals deploy artificial intelligence, a free open–source AI system has matched the performance of a leading proprietary tool in solving complex medical cases that often stump human doctors.

Harvard Medical School researchers found that Llama 3.1 405B, an open-source AI model whose code is publicly available, performed at the same level as GPT-4, the flagship closed-source model from tech giant OpenAI, according to a study published yesterday in JAMA Health Forum.

When tested on 92 diagnostically challenging clinical scenarios from The New England Journal of Medicine, the open-source challenger correctly diagnosed 70 percent of cases compared to GPT-4’s 64 percent. Even more impressively, Llama ranked the correct diagnosis as its first suggestion 41 percent of the time, slightly outperforming GPT-4’s 37 percent.

“To our knowledge, this is the first time an open-source AI model has matched the performance of GPT-4 on such challenging cases as assessed by physicians,” said senior author Arjun Manrai, assistant professor of biomedical informatics in the Blavatnik Institute at Harvard Medical School. “It really is stunning that the Llama models caught up so quickly with the leading proprietary model. Patients, care providers, and hospitals stand to gain from this competition.”

The findings may mark an inflection point in medical AI, as hospitals consider which AI systems to adopt. Open-source models like Llama offer several advantages – they can be run locally on hospital servers, keeping sensitive patient data in-house rather than sending it to external servers operated by commercial entities.

“The open-source model is likely to be more appealing to many chief information officers, hospital administrators, and physicians since there’s something fundamentally different about data leaving the hospital for another entity, even a trusted one,” explained lead author Thomas Buckley, a doctoral student in the AI in Medicine track at Harvard Medical School’s Department of Biomedical Informatics.

For Dr. Sarah Chen, a primary care physician at Boston Medical Center who wasn’t involved in the research, the findings offer a glimpse into how AI might eventually assist in her daily practice. “I see patients with vague symptoms every day, and sometimes the correct diagnosis isn’t immediately obvious,” she said after reviewing the study. “Having an AI tool that could suggest possible diagnoses I hadn’t considered could be incredibly helpful, especially if that tool keeps data secure and can be customized for our patient population.”

Both AI systems in the study rely on similar approaches – training on vast datasets including medical textbooks, research papers, and anonymized patient information. When presented with a new clinical scenario, they compare it against their training data to suggest possible diagnoses.

The researchers were careful to control for any advantage Llama might have had from potentially being exposed to some test cases during its training. They included 22 new cases published after Llama’s training period ended, and the open-source model performed even better on these newer cases, correctly diagnosing 73 percent and listing the right answer as its top suggestion 45 percent of the time.

Another key advantage of open-source models is their flexibility. “This is key,” noted Buckley. “You can use local data to fine-tune these models, either in basic ways or sophisticated ways, so that they’re adapted for the needs of your own physicians, researchers, and patients.”

The gap between open and closed AI systems resembles earlier technology shifts in medicine, such as when open-source electronic health record systems began challenging proprietary platforms. While closed-source developers like OpenAI provide customer support and hosting, open-source models require institutions to handle setup and maintenance themselves.

“As a physician, I’ve seen much of the focus on powerful large language models center around proprietary models that we can’t run locally,” said Adam Rodman, an HMS assistant professor of medicine at Beth Israel Deaconess Medical Center and co-author on the research. “Our study suggests that open-source models might be just as powerful, giving physicians and health systems much more control on how these technologies are used.”

The stakes for improving diagnostic accuracy are high. Approximately 795,000 patients in the United States die or suffer permanent disability due to diagnostic errors annually, according to a 2023 report cited in the study. Beyond the human toll, delayed or incorrect diagnoses drive up healthcare costs through unnecessary testing and treatments.

“Used wisely and incorporated responsibly in current health infrastructure, AI tools could be invaluable copilots for busy clinicians and serve as trusted diagnostic aides to enhance both the accuracy and speed of diagnosis,” Manrai said. “But it remains crucial that physicians help drive these efforts to make sure AI works for them.”

As hospitals increasingly evaluate AI tools for clinical use, the competitiveness of open-source options could lead to more affordable and customizable solutions. For patients, this might ultimately translate to more accurate diagnoses without the privacy concerns associated with sending their data to third-party companies.

With both open and closed-source systems demonstrating impressive diagnostic capabilities, the choice for healthcare institutions may increasingly hinge on factors beyond raw performance – including data privacy, customization needs, and implementation costs.


If you found this piece useful, please consider supporting our work with a small, one-time or monthly donation. Your contribution enables us to continue bringing you accurate, thought-provoking science and medical news that you can trust. Independent reporting takes time, effort, and resources, and your support makes it possible for us to keep exploring the stories that matter to you. Together, we can ensure that important discoveries and developments reach the people who need them most.

Tags: artificial intelligencediagnostichealthcarehospitalsMedicalopensourceTechnology
Previous Post

Ceres-1 rocket launches 8 Chinese commercial satellites

Next Post

Light snowfall and rain hit parts of Himachal Pradesh; IMD predicts wet spell until March 21 todayheadline

Related Posts

We’re about to unlock the secrets of ancient human brains

We’re about to unlock the secrets of ancient human brains todayheadline

May 28, 2025
6

Cosmic Dawn Screening – NASA

May 28, 2025
4
Next Post
ET logo

Light snowfall and rain hit parts of Himachal Pradesh; IMD predicts wet spell until March 21 todayheadline

  • Trending
  • Comments
  • Latest
Family calls for change after B.C. nurse dies by suicide after attacks on the job

Family calls for change after B.C. nurse dies by suicide after attacks on the job

April 2, 2025
Pioneering 3D printing project shares successes

Product reduces TPH levels to non-hazardous status

November 27, 2024

Hospital Mergers Fail to Deliver Better Care or Lower Costs, Study Finds todayheadline

December 31, 2024

Police ID man who died after Corso Italia fight

December 23, 2024
Harris tells supporters 'never give up' and urges peaceful transfer of power

Harris tells supporters ‘never give up’ and urges peaceful transfer of power

0
Des Moines Man Accused Of Shooting Ex-Girlfriend's Mother

Des Moines Man Accused Of Shooting Ex-Girlfriend’s Mother

0

Trump ‘looks forward’ to White House meeting with Biden

0
Catholic voters were critical to Donald Trump’s blowout victory: ‘Harris snubbed us’

Catholic voters were critical to Donald Trump’s blowout victory: ‘Harris snubbed us’

0
1

Altimetrik nears Rs 5,100 crore acquisition of SLK Software todayheadline

May 28, 2025
We’re about to unlock the secrets of ancient human brains

We’re about to unlock the secrets of ancient human brains todayheadline

May 28, 2025

Cosmic Dawn Screening – NASA

May 28, 2025
Hanford site’s radioactive waste could soon be treated for disposal

Hanford site’s radioactive waste could soon be treated for disposal

May 28, 2025

Recent News

1

Altimetrik nears Rs 5,100 crore acquisition of SLK Software todayheadline

May 28, 2025
3
We’re about to unlock the secrets of ancient human brains

We’re about to unlock the secrets of ancient human brains todayheadline

May 28, 2025
6

Cosmic Dawn Screening – NASA

May 28, 2025
4
Hanford site’s radioactive waste could soon be treated for disposal

Hanford site’s radioactive waste could soon be treated for disposal

May 28, 2025
4

TodayHeadline is a dynamic news website dedicated to delivering up-to-date and comprehensive news coverage from around the globe.

Follow Us

Browse by Category

  • Africa
  • Asia
  • Basketball
  • Business & Finance
  • Climate Change
  • Crime & Justice
  • Cybersecurity
  • Economic Policies
  • Elections
  • Entertainment
  • Entrepreneurship
  • Environmental Policies
  • Europe
  • Football
  • Gadgets & Devices
  • Health
  • Medical Research
  • Mental Health
  • Middle East
  • Motorsport
  • Olympics
  • Politics
  • Public Health
  • Relationships & Family
  • Science & Environment
  • Software & Apps
  • Space Exploration
  • Sports
  • Stock Market
  • Technology & Startups
  • Tennis
  • Travel
  • Uncategorized
  • Us & Canada
  • Wildlife & Conservation
  • World News

Recent News

1

Altimetrik nears Rs 5,100 crore acquisition of SLK Software todayheadline

May 28, 2025
We’re about to unlock the secrets of ancient human brains

We’re about to unlock the secrets of ancient human brains todayheadline

May 28, 2025
  • Education
  • Lifestyle
  • Technology & Startups
  • About us
  • Contact
  • Advertise with Us
  • Privacy & Policy

© 2024 Todayheadline.co

Welcome Back!

OR

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In
No Result
View All Result
  • Business & Finance
  • Corporate News
  • Economic Policies
  • Entrepreneurship
  • Market Trends
  • Crime & Justice
  • Court Cases
  • Criminal Investigations
  • Cybercrime
  • Legal Reforms
  • Policing
  • Education
  • Higher Education
  • Online Learning
  • Entertainment
  • Awards & Festivals
  • Celebrity News
  • Movies
  • Music
  • Health
  • Fitness & Nutrition
  • Medical Breakthroughs
  • Mental Health
  • Pandemic Updates
  • Lifestyle
  • Fashion & Beauty
  • Food & Drink
  • Home & Living
  • Politics
  • Elections
  • Government Policies
  • International Relations
  • Legislative News
  • Political Parties
  • Africa
  • Asia
  • Europe
  • Middle East
  • Artificial Intelligence
  • Cybersecurity
  • Emerging Technologies
  • Gadgets & Devices
  • Industry Analysis
  • Basketball
  • Football
  • Motorsport
  • Olympics
  • Climate Change
  • Environmental Policies
  • Medical Research
  • Science & Environment
  • Space Exploration
  • Wildlife & Conservation
  • Sports
  • Tennis
  • Technology & Startups
  • Software & Apps
  • Startup Success Stories
  • Startups & Innovations
  • Tech Regulations
  • Venture Capital
  • Uncategorized
  • World News
  • Us & Canada
  • Public Health
  • Relationships & Family
  • Travel
  • Research & Innovation
  • Scholarships & Grants
  • School Reforms
  • Stock Market
  • TV & Streaming
  • Advertise with Us
  • Privacy & Policy
  • About us
  • Contact

© 2024 Todayheadline.co