• About Us
  • Contact Us
  • Cookie policy (EU)
  • Home
  • Privacy Policy
  • Video
  • Write for us
Today Headline
  • HOME
  • NEWS
    • POLITICS
    • News for today
    • Borisov news
  • FINANCE
    • Business
    • Insurance
  • Video
  • TECHNOLOGY
  • ENTERPRISE
  • LIFESTYLE
    • TRAVEL
    • HEALTH
    • ENTERTAINMENT
  • AUTOMOTIVE
  • SPORTS
  • Travel and Tourism
  • HOME
  • NEWS
    • POLITICS
    • News for today
    • Borisov news
  • FINANCE
    • Business
    • Insurance
  • Video
  • TECHNOLOGY
  • ENTERPRISE
  • LIFESTYLE
    • TRAVEL
    • HEALTH
    • ENTERTAINMENT
  • AUTOMOTIVE
  • SPORTS
  • Travel and Tourism
No Result
View All Result
TodayHeadline
No Result
View All Result

Newly developed optical microphone sees sound like never before

June 22, 2022
in Technology
0
0
SHARES
3
VIEWS
Share on FacebookShare on Twitter


Optical microphone developed by CMU researchers sees sound like never before

Mark Sheinin (left) and Dorian Chan were part of a CMU research team that developed a camera system that can see sound vibrations with such precision that it can capture isolated audio of separate guitars playing at the same time. Credit: Carnegie Mellon University

A camera system developed by Carnegie Mellon University researchers can see sound vibrations with such precision and detail that it can reconstruct the music of a single instrument in a band or orchestra.

Even the most high-powered and directed microphones can’t eliminate nearby sounds, ambient noise and the effect of acoustics when they capture audio. The novel system developed in the School of Computer Science’s Robotics Institute (RI) uses two cameras and a laser to sense high-speed, low-amplitude surface vibrations. These vibrations can be used to reconstruct sound, capturing isolated audio without inference or a microphone.

“We’ve invented a new way to see sound,” said Mark Sheinin, a post-doctoral research associate at the Illumination and Imaging Laboratory (ILIM) in the RI. “It’s a new type of camera system, a new imaging device, that is able to see something invisible to the naked eye.”

The team completed several successful demos of their system’s effectiveness in sensing vibrations and the quality of the sound reconstruction. They captured isolated audio of separate guitars playing at the same time and individual speakers playing different music simultaneously. They analyzed the vibrations of a tuning fork, and used the vibrations of a bag of Doritos near a speaker to capture the sound coming from a speaker. This demo pays tribute to prior work done by MIT researchers who developed one of the first visual microphones in 2014.






The CMU system dramatically improves upon past attempts to capture sound using computer vision. The team’s work uses ordinary cameras that cost a fraction of the high-speed versions employed in past research while producing a higher quality recording. The dual-camera system can capture vibrations from objects in motion, such as the movements of a guitar while a musician plays it, and simultaneously sense individual sounds from multiple points.

“We’ve made the optical microphone much more practical and usable,” said Srinivasa Narasimhan, a professor in the RI and head of the ILIM. “We’ve made the quality better while bringing the cost down.”

The system works by analyzing the differences in speckle patterns from images captured with a rolling shutter and a global shutter. An algorithm computes the difference in the speckle patterns from the two video streams and converts those differences into vibrations to reconstruct the sound.

A speckle pattern refers to the way coherent light behaves in space after it is reflected off a rough surface. The team creates the speckle pattern by aiming a laser at the surface of the object producing the vibrations, like the body of a guitar. That speckle pattern changes as the surface vibrates. A rolling shutter captures an image by rapidly scanning it, usually from top to bottom, producing the image by stacking one row of pixels on top of another. A global shutter captures an image in a single instance all at once.

Joining Sheinin and Narasimhan on the research were Dorian Chan, a Ph.D. student in computer science, and Matthew O’Toole, an assistant professor in the RI and Computer Science Department.

“This system pushes the boundary of what can be done with computer vision,” O’Toole said. “This is a new mechanism to capture high speed and tiny vibrations, and presents a new area of research.”

Most work in computer vision focuses on training systems to recognize objects or track them through space—research important to advancing technologies like autonomous vehicles. That this work enables systems to better see imperceptible, high-frequency vibrations opens new applications for computer vision.

The team’s dual-shutter, optical vibration-sensing system could allow sound engineers to monitor the music of individual instruments free from the interference of the rest of the ensemble to fine tune the overall mix. Manufacturers could use the system to monitor the vibrations of individual machines on a factory floor to spot early signs of needed maintenance.

“If your car starts to make a weird sound, you know it is time to have it looked at,” Sheinin said. “Now imagine a factory floor full of machines. Our system allows you to monitor the health of each one by sensing their vibrations with a single stationary camera.”


Sketching a shape based on its sound


More information:
Mark Sheinin et al, Dual-Shutter Optical Vibration Sensing, (2022)

Provided by
Carnegie Mellon University

Citation:
Newly developed optical microphone sees sound like never before (2022, June 21)
retrieved 22 June 2022
from https://techxplore.com/news/2022-06-newly-optical-microphone.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Previous Post

‘Surfer Magazine: 1960-2020’ Celebrates a Surfing Icon

Next Post

Damian Lillard pays tribute to Caleb Swanigan after defending him from trolls last year

Related Posts

Technology

To beat the summer heat, passive cooling really works

Credit: Pixabay/CC0 Public Domain Opening...

Read more
Technology

Using electric signals from human brains, new software can perform computerized image editing

Brain responses being used as...

Read more
Technology

Creating a drag-friendly garment that changes in real time

Nathan Straub, a rising senior...

Read more
Technology

Versatile, flexible, and economical sensors

A versatile, flexible sensor sheet...

Read more
Technology

Salt and a battery – smashing the limits of power storage

Thanks to the renewables’ boom,...

Read more
Load More
Next Post

Damian Lillard pays tribute to Caleb Swanigan after defending him from trolls last year

  • Trending
  • Comments
  • Latest

Dog Groomer Opened Shop In ‘Middle Of Night’ To Give Stray Dog Haircut & Found Beauty Beneath Matted Fur

Brazilian pilots meet ‘11, 500mph craft’ during ‘Night of the UFOs’

Lost Dog Held Hostage By Suspicious Elderly Women

Haunted Alexa? Man Claims He Spoke To A Ghost Through His Amazon Device – WATCH!

Thai market recovery continues in May

British stag party stranded in Amsterdam when easyJet cancel their flight buy bikes to get home

London Underground workers vote for more strike action | London Underground

Some PS Plus games already have an expiration date

About Us

Todayheadline the independent news and topics discovery
A home-grown and independent news and topic aggregation . displays breaking news linking to news websites all around the world.

Follow Us

Latest News

Thai market recovery continues in May

British stag party stranded in Amsterdam when easyJet cancel their flight buy bikes to get home

Thai market recovery continues in May

British stag party stranded in Amsterdam when easyJet cancel their flight buy bikes to get home

London Underground workers vote for more strike action | London Underground

  • Real Estate
  • Education
  • Parenting
  • Cooking
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2021 All rights are reserved Todayheadline

No Result
View All Result
  • Real Estate
  • Education
  • Parenting
  • Cooking
  • Travel and Tourism
  • Home & Garden
  • Pets
  • Privacy & Policy
  • Contact
  • About

© 2021 All rights are reserved Todayheadline

Welcome Back!

Login to your account below

Forgotten Password?

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist