• About Us
  • Contact Us
  • Today Headline
  • Write for us
Today Headline
No Result
View All Result
  • breaking news today
    • Politics news
    • Sports
    • Science News & Society
  • Entertainment News
    • Movie
    • Gaming
  • Technology News
    • Automotive
    • Software & IT
  • Health News
    • Lifestyle
    • Insurance
  • Finance News
    • Money
  • Enterprise
  • Contact Us
  • breaking news today
    • Politics news
    • Sports
    • Science News & Society
  • Entertainment News
    • Movie
    • Gaming
  • Technology News
    • Automotive
    • Software & IT
  • Health News
    • Lifestyle
    • Insurance
  • Finance News
    • Money
  • Enterprise
  • Contact Us
No Result
View All Result
TodayHeadline
No Result
View All Result

Machine-learning models that can help doctors more efficiently find information in a patient’s health record

July 16, 2022
in Technology News
Reading Time: 5 mins read
medicalrecor – TodayHeadline


medical records

Credit: CC0 Public Domain

Physicians often query a patient’s electronic health record for information that helps them make treatment decisions, but the cumbersome nature of these records hampers the process. Research has shown that even when a doctor has been trained to use an electronic health record (EHR), finding an answer to just one question can take, on average, more than eight minutes.

The more time physicians must spend navigating an oftentimes clunky EHR interface, the less time they have to interact with patients and provide treatment.

Researchers have begun developing machine-learning models that can streamline the process by automatically finding information physicians need in an EHR. However, training effective models requires huge datasets of relevant medical questions, which are often hard to come by due to privacy restrictions. Existing models struggle to generate authentic questions—those that would be asked by a human doctor—and are often unable to successfully find correct answers.

To overcome this data shortage, researchers at MIT partnered with medical experts to study the questions physicians ask when reviewing EHRs. Then, they built a publicly available dataset of more than 2,000 clinically relevant questions written by these medical experts.

When they used their dataset to train a machine-learning model to generate clinical questions, they found that the model asked high-quality and authentic questions, as compared to real questions from medical experts, more than 60% of the time.

With this dataset, they plan to generate vast numbers of authentic medical questions and then use those questions to train a machine-learning model which would help doctors find sought-after information in a patient’s record more efficiently.

“Two thousand questions may sound like a lot, but when you look at machine-learning models being trained nowadays, they have so much data, maybe billions of data points. When you train machine-learning models to work in health care settings, you have to be really creative because there is such a lack of data,” says lead author Eric Lehman, a graduate student in the Computer Science and Artificial Intelligence Laboratory (CSAIL).

The senior author is Peter Szolovits, a professor in the Department of Electrical Engineering and Computer Science (EECS) who heads the Clinical Decision-Making Group in CSAIL and is also a member of the MIT-IBM Watson AI Lab. The research paper, a collaboration between co-authors at MIT, the MIT-IBM Watson AI Lab, IBM Research, and the doctors and medical experts who helped create questions and participated in the study, will be presented at the annual conference of the North American Chapter of the Association for Computational Linguistics.

“Realistic data is critical for training models that are relevant to the task yet difficult to find or create,” Szolovits says. “The value of this work is in carefully collecting questions asked by clinicians about patient cases, from which we are able to develop methods that use these data and general language models to ask further plausible questions.”

Data deficiency

The few large datasets of clinical questions the researchers were able to find had a host of issues, Lehman explains. Some were composed of medical questions asked by patients on web forums, which are a far cry from physician questions. Other datasets contained questions produced from templates, so they are mostly identical in structure, making many questions unrealistic.

“Collecting high-quality data is really important for doing machine-learning tasks, especially in a health care context, and we’ve shown that it can be done,” Lehman says.

To build their dataset, the MIT researchers worked with practicing physicians and medical students in their last year of training. They gave these medical experts more than 100 EHR discharge summaries and told them to read through a summary and ask any questions they might have. The researchers didn’t put any restrictions on question types or structures in an effort to gather natural questions. They also asked the medical experts to identify the “trigger text” in the EHR that led them to ask each question.

For instance, a medical expert might read a note in the EHR that says a patient’s past medical history is significant for prostate cancer and hypothyroidism. The trigger text “prostate cancer” could lead the expert to ask questions like “date of diagnosis?” or “any interventions done?”

They found that most questions focused on symptoms, treatments, or the patient’s test results. While these findings weren’t unexpected, quantifying the number of questions about each broad topic will help them build an effective dataset for use in a real, clinical setting, says Lehman.

Once they had compiled their dataset of questions and accompanying trigger text, they used it to train machine-learning models to ask new questions based on the trigger text.

Then the medical experts determined whether those questions were “good” using four metrics: understandability (Does the question make sense to a human physician?), triviality (Is the question too easily answerable from the trigger text?), medical relevance (Does it makes sense to ask this question based on the context?), and relevancy to the trigger (Is the trigger related to the question?).

Cause for concern

The researchers found that when a model was given trigger text, it was able to generate a good question 63% of the time, whereas a human physician would ask a good question 80% of the time.

They also trained models to recover answers to clinical questions using the publicly available datasets they had found at the outset of this project. Then they tested these trained models to see if they could find answers to “good” questions asked by human medical experts.

The models were only able to recover about 25% of answers to physician-generated questions.

“That result is really concerning. What people thought were good-performing models were, in practice, just awful because the evaluation questions they were testing on were not good to begin with,” Lehman says.

The team is now applying this work toward their initial goal: building a model that can automatically answer physicians’ questions in an EHR. For the next step, they will use their dataset to train a machine-learning model that can automatically generate thousands or millions of good clinical questions, which can then be used to train a new model for automatic question answering.

While there is still much work to do before that model could be a reality, Lehman is encouraged by the strong initial results the team demonstrated with this dataset.


When it comes to AI, can we ditch the datasets?


More information:
Eric Lehman et al, Learning to Ask Like a Physician. arXiv:2206.02696v1 [cs.CL]arxiv.org/abs/2206.02696

Provided by
Massachusetts Institute of Technology

This story is republished courtesy of MIT News (web.mit.edu/newsoffice/), a popular site that covers news about MIT research, innovation and teaching.

Citation:
Machine-learning models that can help doctors more efficiently find information in a patient’s health record (2022, July 14)
retrieved 16 July 2022
from https://techxplore.com/news/2022-07-machine-learning-doctors-efficiently-patient-health.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

  • Trending
  • Comments
  • Latest
Mortgage Insurers Have Friends In High Places On Both Sides – TodayHeadline

Mortgage Insurers Have Friends In High Places, On Both Sides Of The Aisle

Stuttgart vs Hoffenheim LIVE: Bundesliga team news and latest build-up

Stuttgart vs Hoffenheim LIVE: Bundesliga team news and latest build-up

Antibiotic Destroying Bacteria Concept Illustration – TodayHeadline

Helps Find New Antibiotic Drug To Combat Drug-Resistant Infections

9ef8d273 72f0 4378 a62f 88aec75c013a little sleepies – TodayHeadline

Little Sleepies Is Having A Rare Sale — & Tons Of Adorable, Celeb-Loved Styles Are Up To 65% Off

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

9d602197d81a98f94c25f223c90058e1Y29udGVudHNlYXJjaGFwaSwxNjg1MzIxNzU2 2.72360763 – TodayHeadline

Bike crash victims were ‘chased to their death by South Wales Police’, aunt says

newsupermariobroswii1280jpg ed620b 1685214917711 – TodayHeadline

Dolphin Emulator Steam Release ‘Indefinitely Postponed’ After Cease and Desist From Nintendo

XRP 2 – TodayHeadline

Whales Flock to XRP, Accumulating 52 Million Tokens In Just 3 Weeks

PopularStories

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit
Politics news

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

9d602197d81a98f94c25f223c90058e1Y29udGVudHNlYXJjaGFwaSwxNjg1MzIxNzU2 2.72360763 – TodayHeadline
breaking news today

Bike crash victims were ‘chased to their death by South Wales Police’, aunt says

newsupermariobroswii1280jpg ed620b 1685214917711 – TodayHeadline
Gaming

Dolphin Emulator Steam Release ‘Indefinitely Postponed’ After Cease and Desist From Nintendo

XRP 2 – TodayHeadline
Money

Whales Flock to XRP, Accumulating 52 Million Tokens In Just 3 Weeks

About Us

Todayheadline the independent news and topics discovery
A home-grown and independent news and topic aggregation . displays breaking news linking to news websites all around the world.

Follow Us

Latest News

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

9d602197d81a98f94c25f223c90058e1Y29udGVudHNlYXJjaGFwaSwxNjg1MzIxNzU2 2.72360763 – TodayHeadline

Bike crash victims were ‘chased to their death by South Wales Police’, aunt says

newsupermariobroswii1280jpg ed620b 1685214917711 – TodayHeadline

Dolphin Emulator Steam Release ‘Indefinitely Postponed’ After Cease and Desist From Nintendo

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

Holly Willoughby Speaks Out After Phillip Schofield ITV Exit

9d602197d81a98f94c25f223c90058e1Y29udGVudHNlYXJjaGFwaSwxNjg1MzIxNzU2 2.72360763 – TodayHeadline

Bike crash victims were ‘chased to their death by South Wales Police’, aunt says

newsupermariobroswii1280jpg ed620b 1685214917711 – TodayHeadline

Dolphin Emulator Steam Release ‘Indefinitely Postponed’ After Cease and Desist From Nintendo

  • Real Estate
  • Parenting
  • Cooking
  • NFL Games On TV Today
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2023 All rights are reserved Today headline

No Result
View All Result
  • Real Estate
  • Parenting
  • Cooking
  • NFL Games On TV Today
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2023 All rights are reserved Today headline