• About Us
  • Contact Us
  • Cookie policy (EU)
  • Home
  • Privacy Policy
  • Video
  • Write for us
Today Headline
  • HOME
  • NEWS
    • POLITICS
    • News for today
    • Borisov news
  • FINANCE
    • Business
    • Insurance
  • Video
  • TECHNOLOGY
  • ENTERPRISE
  • LIFESTYLE
    • TRAVEL
    • HEALTH
    • ENTERTAINMENT
  • AUTOMOTIVE
  • SPORTS
  • Travel and Tourism
  • HOME
  • NEWS
    • POLITICS
    • News for today
    • Borisov news
  • FINANCE
    • Business
    • Insurance
  • Video
  • TECHNOLOGY
  • ENTERPRISE
  • LIFESTYLE
    • TRAVEL
    • HEALTH
    • ENTERTAINMENT
  • AUTOMOTIVE
  • SPORTS
  • Travel and Tourism
No Result
View All Result
TodayHeadline
No Result
View All Result

A method to automatically generate radar-camera datasets for deep learning applications

February 25, 2022
in Technology
0
A method to automatically generate radar-camera datasets for deep learning applications
0
SHARES
1
VIEWS
Share on FacebookShare on Twitter


February 25, 2022
feature

A method to automatically generate radar-camera datasets for deep learning applications

Scenario where the Inter-Frame Hungarian Algorithm ensures that radar reflections across consecutive frames from the same object(s) are still labeled, even if YOLO fails intermittently. Credit: Sengupta, Yoshizawa & Cao.

In recent years, roboticists and computer scientists have been developing a wide range of systems that can detect objects in their environment and navigate it accordingly. Most of these systems are based on machine learning and deep learning algorithms trained on large image datasets.

While there are now numerous image datasets for training machine learning models, those containing data collected using radar sensors are still scarce, despite the significant advantages of radars over optical sensors. Moreover, many of the available open-source radar datasets are not easy to use for different user applications.

Researchers at University of Arizona have recently developed a new approach to automatically generate datasets containing labeled radar data-camera images. This approach, presented in a paper published in IEEE Robotics and Automation Lettersuses a highly accurate object detection algorithm on the camera image-stream (called YOLO) and an association technique (known as the Hungarian algorithm) to label radar point-cloud.

“Deep-learning applications using radar require a lot of labeled training data, and labeling radar data is non-trivial, an extremely time and labor-intensive process, mostly carried out by manually comparing it with a parallelly obtained image data-stream,” Arindam Sengupta, a Ph.D. student at the University of Arizona and primary researcher for the study, told TechXplore. “Our idea here was that if the camera and radar are looking at the same object, then instead of looking at images manually, we can leverage an image-based object detection framework (YOLO in our case) to automatically label the radar data.”







The auto-labeling algorithm at work on real camera-radar data acquired at a traffic intersection in Tucson, Arizona. Credit: Sengupta, Yoshizawa & Cao.

Three characterizing features of the approach introduced by Sengupta and his colleagues are its co-calibration, clustering and association capabilities. The approach co-calibrates a radar and its camera to determine how an object’s location detected by the radar would translate in terms of a camera’s digital pixels.

“We used a density-based clustering scheme (DBSCAN) to a) detect and remove noise/stray radar returns; and b) segregate radar returns in clusters to distinguish between distinct objects,” Sengupta said. “Finally, an intra-frame and an inter-frame Hungarian algorithm (HA) is used for association. The intra-frame HA associated the YOLO predictions to the co-calibrated radar clusters in a given frame, while the inter-frame HA associated the radar clusters pertaining to the same object over consecutive frames to account for labeling radar data in frames even when optical sensors fail intermittently.”

In the future, the new approach introduced by this team of researchers could help to automate the generation of radar-camera and radar-only datasets. In addition, in their paper the team explored both proof-of-concept classification schemes based on a radar-camera sensor-fusion approach and on data collected only by radars.

“We also suggested the use of an effective 12-dimensional radar feature vector, constructed using a combination of spatial, Doppler and RCS statistics, rather than the traditional use of either just the point-cloud distribution or just the micro-doppler data,” Sengupta said.

Ultimately, the recent study carried out by Sengupta and his colleagues could open new possibilities for the rapid investigation and training of deep learning-based models for classifying or tracking objects using sensor-fusion. These models could help to enhance the performance of numerous robotic systems, ranging from autonomous vehicles to small robots.

A method to automatically generate radar-camera datasets for deep learning applications

Steps leading up to the intra-frame YOLO-radar association, which then results in the radar clusters getting labeled. Credit: Sengupta, Yoshizawa & Cao.

“Our lab at the University of Arizona conducts research on data-driven mmWave radar research targeting autonomous, healthcare, defense and transportation domains,” Dr. Siyang Cao, an Assistant Professor at the University of Arizona and Principal Investigator for the study, told TechXplore. “Some of our ongoing research include investigating robust sensor-fusion based tracking schemes and further improving stand-alone mmWave radar perception using classical signal processing and deep learning.”


A new look at quantum radar suggests it might boost accuracy more than thought


More information:
Automatic radar-camera dataset generation for sensor-fusion applications. IEEE Robotics and Automation Letters(2022). DOI: 10.1109/LRA.2022.3144524.

© 2022 Science X Network

Citation:
A method to automatically generate radar-camera datasets for deep learning applications (2022, February 25)
retrieved 25 February 2022
from https://techxplore.com/news/2022-02-method-automatically-radar-camera-datasets-deep.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Tags: ApplicationsautomaticallydatasetsdeepgenerateLearningmethodradarcamera
Previous Post

NHS Trust accused of passing up on a former LGBT role model for her gender critical views

Next Post

Sunrise Birthdays for Friday 2-25-22

Related Posts

Using a semi-autonomous robot to understand the psychological connections between machine and user
Technology

Using a semi-autonomous robot to understand the psychological connections between machine and user

Changes in attitude by the...

Read more
A new, faster way to browse physics-based animations
Technology

A new, faster way to browse physics-based animations

A ball is launched with...

Read more
Artificial finger able to identify surface material with 90% accuracy
Technology

Artificial finger able to identify surface material with 90% accuracy

(A) Schematic diagram of the...

Read more
Researchers achieve world’s first international holographic teleportation
Technology

Researchers achieve world’s first international holographic teleportation

Credit: University of Western Ontario...

Read more
Open-source and open hardware autonomous quadrotor flies fast and avoids obstacles
Technology

Open-source and open hardware autonomous quadrotor flies fast and avoids obstacles

Credit: Robotics and Perception Group...

Read more
Load More
Next Post
Sunrise Birthdays for Friday 2-4-22

Sunrise Birthdays for Friday 2-25-22

  • Trending
  • Comments
  • Latest
Epic Systems campus, a fantasyland of gardens and architecture, Part 1

Epic Systems campus, a fantasyland of gardens and architecture, Part 1

How old is Simon Cowell’s son Eric and who is his mother?

How old is Simon Cowell’s son Eric and who is his mother?

Six times actors really romped in sex scenes that make 365 DNI look tame

Six times actors really romped in sex scenes that make 365 DNI look tame

Collapsed Doggy sex position promises clitoral stimulation for extra pleasure

Collapsed Doggy sex position promises clitoral stimulation for extra pleasure

KOONTA Delivers Post-‘Show Me The Money 10’ Single, ‘PROTO TYPE,’ Featuring BASICK And SAN E

AUTTA and Greasy Cafe Reveal Dramatic Visual For ‘Finally We Will’

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

‘You’re s***’ – Ben White claims ‘little kids’ mocked Arsenal for forking out £50m on him & that his dad HATES football

‘You’re s***’ – Ben White claims ‘little kids’ mocked Arsenal for forking out £50m on him & that his dad HATES football

How COVID Made the Situation Worse — Global Issues

How COVID Made the Situation Worse — Global Issues

About Us

Todayheadline the independent news and topics discovery
A home-grown and independent news and topic aggregation . displays breaking news linking to news websites all around the world.

Follow Us

Latest News

KOONTA Delivers Post-‘Show Me The Money 10’ Single, ‘PROTO TYPE,’ Featuring BASICK And SAN E

AUTTA and Greasy Cafe Reveal Dramatic Visual For ‘Finally We Will’

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

KOONTA Delivers Post-‘Show Me The Money 10’ Single, ‘PROTO TYPE,’ Featuring BASICK And SAN E

AUTTA and Greasy Cafe Reveal Dramatic Visual For ‘Finally We Will’

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

Londoners leaving capital to buy a house up 19% – with most heading to Epping and Slough

‘You’re s***’ – Ben White claims ‘little kids’ mocked Arsenal for forking out £50m on him & that his dad HATES football

‘You’re s***’ – Ben White claims ‘little kids’ mocked Arsenal for forking out £50m on him & that his dad HATES football

  • Real Estate
  • Education
  • Parenting
  • Cooking
  • NFL Games On TV Today
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2021 All rights are reserved Todayheadline

No Result
View All Result
  • Real Estate
  • Education
  • Parenting
  • Cooking
  • NFL Games On TV Today
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2021 All rights are reserved Todayheadline

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist