Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
The microphones and loudspeakers of modern compact electronic devices such as smartphones and tablets typically require case penetrations that leave the device vulnerable to environmental damage. To address this, the authors propose a surface-based audio interface that employs force actuators for reproduction and structural vibration sensors to record the vibrations of the display panel induced by incident acoustic waves. This paper reports experimental results showing that recorded speech signals are of sufficient quality to enable high-reliability automatic speech recognition despite degradation by the panel`s resonant properties. The authors report the results of experiments in which acoustic waves containing speech were directed to several panels, and the subsequent vibrations of the panels` surfaces were recorded using structural sensors. The recording quality was characterized by measuring the speech transmission index, and the recordings were transcribed to text using an automatic speech recognition system from which the resulting word error rate was determined. Experiments showed that the word error rate (10%--13%) achieved for the audio signals recorded by the method described in this paper was comparable to that for audio captured by a high-quality studio microphone (10%). The authors also demonstrated a crosstalk cancellation method that enables the system to simultaneously record and play audio signals.
Author (s): Dipassio, Tre; Heilemann, Michael C.; Bocko, Mark F.
Affiliation:
University of Rochester, Rochester, NY
(See document for exact affiliation information.)
Publication Date:
2022-12-06
Import into BibTeX
Permalink: https://aes2.org/publications/elibrary-page/?id=22024
(970KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
Dipassio, Tre; Heilemann, Michael C.; Bocko, Mark F.; 2022; Audio Capture Using Structural Sensors on Vibrating Panel Surfaces [PDF]; University of Rochester, Rochester, NY; Paper ; Available from: https://aes2.org/publications/elibrary-page/?id=22024
Dipassio, Tre; Heilemann, Michael C.; Bocko, Mark F.; Audio Capture Using Structural Sensors on Vibrating Panel Surfaces [PDF]; University of Rochester, Rochester, NY; Paper ; 2022 Available: https://aes2.org/publications/elibrary-page/?id=22024
@article{dipassio2022audio,
author={dipassio tre and heilemann michael c. and bocko mark f.},
journal={journal of the audio engineering society},
title={audio capture using structural sensors on vibrating panel surfaces},
year={2022},
volume={70},
issue={12},
pages={1027-1037},
month={december},}