research-article

Open access

Embracing Distributed Acoustic Sensing in Car Cabin for Children Presence Detection

Authors:

Jie XiongAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 8, Issue 1

Article No.: 16, Pages 1 - 28

https://doi.org/10.1145/3643548

Published: 06 March 2024 Publication History

Abstract

Contactless acoustic sensing has been actively exploited in the past few years to enable a large range of applications, ranging from fine-grained vital sign monitoring to coarse-grained human tracking. However, existing acoustic sensing systems mainly work on smartphone or smart speaker platforms. In this paper, we envision an exciting new acoustic sensing platform, i.e., car cabin which is inherently embedded with a large number of speakers and microphones. We propose the new concept of distributed acoustic sensing and develop novel designs leveraging the unique characteristics of rich multi-path in car cabin to enable fine-grained sensing even when the primary reflection is totally blocked. By using child presence detection as the application example, we show that child presence can be detected through body motions or even subtle breath (when the child is sleeping or in coma) at all locations in the cabin without any blind spots. We further show that the proposed system can robustly work in different car cabins, achieving an average detection accuracy of 97% and a false alarm rate always below 2% under different scenarios including those challenging ones such as rear-facing seat blockage. We believe the proposed distributed sensing modality in car cabin pushes acoustic sensing one big step towards real-life adoption.

References

[1]

2018. IWR1443 Single-Chip 76- to 81-GHz mmWave Sensor. https://www.ti.com/product/IWR1443.

[2]

2019. Auto Industry Agrees to Put Rear-Seat Reminder Systems in Most New Cars by 2025. https://www.consumerreports.org/car-safety/auto-industry-agrees-to-put-rear-seat-reminder-systems-in-most-new-cars-by-2025/.

[3]

2020. AS TEMPERATURES REACH DEADLY LEVELS, SAFETY ADVOCATES JOIN TOGETHER TO WARN ABOUT DANGERS OF CHILDREN DYING IN HOT CARS. https://www.safekids.org/press-release/temperatures-reach-deadly-levels-safety-advocates-join-together-warn-about-dangers.

[4]

2021. Infineon. Infineon in-cabin monitoring. https://www.infineon.com/cms/en/tools/aurix-embedded-sw/AURIX-Applications-software/in-cabin-monitoring/.

[5]

2022. Audio Systems for the Tesla Model S and Model X. https://teslatap.com/articles/audio-systems-for-the-tesla-model-s-and-model-x/.

[6]

2022. How you can help prevent hot car deaths as temperatures continue to rise. https://www.wafb.com/2023/06/14/how-you-can-help-prevent-hot-car-deaths-temperatures-continue-rise/.

[7]

2022. TEST AND ASSESSMENT PROTOCOL -- CHILD PRESENCE DETECTION. https://cdn.euroncap.com/media/75474/euro-ncap-cpd-test-and-assessment-protocol-v11.pdf.

[8]

2022. Texas Instruments. Vehicle occupant detection reference design. https://www.ti.com/lit/ug/tidue95a/tidue95a.pdf.

[9]

2022. What You Need to Know About Infant and Children's Vital Signs. https://health.clevelandclinic.org/pediatric-vital-signs/.

[10]

2023. Global child presence detection system market grows tremendously at a CAGR. https://straitsresearch.com/press-release/global-child-presence-detection-system-market-analysis.

[11]

2023. in-cabin-experiences. https://automotive.bose.com/road-ahead/in-cabin-experiences

[12]

2023. Mercedes-Benz S-Class Burmester Sound System: Are 31 Speakers Enough? https://thedailymotor.com/sound-systems/2021-mercedes-benz-s-class-burmester-sound-system-are-31-speakers-enough/.

[13]

2023. SimNewB. https://laerdal.com/us/products/simulation-training/obstetrics-pediatrics/simnewb/.

[14]

2023. Xethru impulse uwb radar chip. Xethruimpulseuwbradarchip, https://www.xethru.com/x4-radarchip.html/.

[15]

Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D tracking via body radio reflections. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14). 317--329.

Digital Library

[16]

AKG. 2021. 2021 Cadillac Escalade with AKG Studio Reference System. https://www.akg.com/ForCadillac.html.

[17]

Joan Albesa and Manel Gasulla. 2015. Occupancy and Belt Detection in Removable Vehicle Seats Via Inductive Power Transmission. IEEE Transactions on Vehicular Technology 64, 8 (2015), 3392--3401. https://doi.org/10.1109/TVT.2014.2356443

[18]

Takashi Amesaka, Hiroki Watanabe, Masanori Sugimoto, and Buntarou Shizuki. 2022. Gesture Recognition Method Using Acoustic Sensing on Usual Garment. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 41 (jul 2022), 27 pages. https://doi.org/10.1145/3534579

Digital Library

[19]

Haibin Cai, Donghee Lee, Hwang Joonkoo, Yinfeng Fang, Song Li, and Honghai Liu. 2017. Embedded vision based automotive interior intrusion detection system. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC). 2909--2914. https://doi.org/10.1109/SMC.2017.8123069

Digital Library

[20]

Shirui Cao, Dong Li, Sunghoon Ivan Lee, and Jie Xiong. 2023. PowerPhone: Unleashing the Acoustic Sensing Capability of Smartphones. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3570361.3613270

Digital Library

[21]

CodeTD. 2019. Market car stereo microphone placement and noise reduction solutions. https://www.codetd.com/en/article/7713766.

[22]

R.C. Coetzer and G.P. Hancke. 2011. Eye detection for a real-time vehicle driver fatigue monitoring system. In 2011 IEEE Intelligent Vehicles Symposium (IV). 66--71. https://doi.org/10.1109/IVS.2011.5940406

[23]

Electric Vehicle Database. 2023. Useable battery capacity of full electric vehicles. https://ev-database.org/cheatsheet/useable-battery-capacity-electric-car.

[24]

Konstantin Dragomiretskiy, Dominique Zosso, Luminita Vese, and Andrea Bertozzi. [n. d.]. Variational Mode Decomposition. ([n. d.]).

[25]

Gert Freiberger and Helmut Schreiber. 2022. Modelling Child Life Presence Detection with Ultra-Wideband Radars for an Automotive Environment. In 2022 International Conference on Broadband Communications for Next Generation Networks and Multimedia Applications (CoBCom). 1--5. https://doi.org/10.1109/CoBCom55489.2022.9880618

[26]

Jacob Green. 2022. Dolby Atmos Best Speaker Setup Practices In the Home. https://www.audioholics.com/audio-technologies/dolby-atmos-best-setup-practices.

[27]

NMZ Hashim, HH Basri, A Jaafar, MZAA Aziz, A Salleh, and AS Ja. 2014. Child in car alarm system using various sensors. ARPN Journal of Engineering and Applied Sciences 9, 9 (2014), 1653--1658.

[28]

Emmarie Huetteman. 2022. Heat Waves Affect Children More Severely. https://www.scientificamerican.com/article/heat-waves-affect-children-more-severely/.

[29]

Sakila S Jayaweera, Beibei Wang, Xiaolu Zeng, Wei-Hsiang Wang, and KJ Ray Liu. 2023. WIFI-Based Robust Child Presence Detection for Smart Cars. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1--5.

[30]

Sakila S. Jayaweera, Beibei Wang, Xiaolu Zeng, Wei-Hsiang Wang, and K. J. Ray Liu. 2023. WIFI-Based Robust Child Presence Detection for Smart Cars. In ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 1--5. https://doi.org/10.1109/ICASSP49357.2023.10096908

[31]

Dietmar Ruwisch Ken Waurin and Yu Du. 2021. How A2B Technology and Digital Microphones Enable Superior Performance in Emerging Automotive Applications. https://www.analog.com/media/en/analog-dialogue/volume-55/number-2/how-a2b-technology-and-digital-microphones-enable-superior-performance-in-emerging-automotive-applications.pdf.

[32]

J.C. Kluyver. 1905. A local probability problem. https://dwc.knaw.nl/DL/publications/PU00013859.pdf.

[33]

Dong Li, Shirui Cao, Sunghoon Ivan Lee, and Jie Xiong. 2022. Experience: Practical Problems for Acoustic Sensing. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (Sydney NSW, Australia) (MobiCom '22). Association for Computing Machinery, New York, NY, USA, 381--390. https://doi.org/10.1145/3495243.3560527

Digital Library

[34]

Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2023. Room-Scale Hand Gesture Recognition Using Smart Speakers. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (Boston, Massachusetts) (SenSys '22). Association for Computing Machinery, New York, NY, USA, 462--475. https://doi.org/10.1145/3560905.3568528

Digital Library

[35]

Jie Lian, Xu Yuan, Ming Li, and Nian-Feng Tzeng. 2021. Fall Detection via Inaudible Acoustic Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 114 (sep 2021), 21 pages. https://doi.org/10.1145/3478094

Digital Library

[36]

Jialin Liu, Dong Li, Lei Wang, and Jie Xiong. 2021. BlinkListener: "Listen" to Your Eye Blink Using Your Smartphone. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 2, Article 73 (jun 2021), 27 pages. https://doi.org/10.1145/3463521

Digital Library

[37]

Jialin Liu, Dong Li, Lei Wang, Fusang Zhang, and Jie Xiong. 2022. Enabling Contact-free Acoustic Sensing under Device Motion. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 128 (sep 2022), 27 pages. https://doi.org/10.1145/3550329

Digital Library

[38]

Wenguang Mao, Mei Wang, Wei Sun, Lili Qiu, Swadhin Pradhan, and Yi-Chao Chen. 2019. RNN-Based Room Scale Hand Motion Tracking. In The 25th Annual International Conference on Mobile Computing and Networking (Los Cabos, Mexico) (MobiCom '19). Association for Computing Machinery, New York, NY, USA, Article 38, 16 pages. https://doi.org/10.1145/3300061.3345439

Digital Library

[39]

Martin. 2023. How to Install Car Surround Sound System? https://improvecaraudio.com/car-surround-sound-system/.

[40]

Rahul Murmuria, Jeffrey Medsger, Angelos Stavrou, and Jeffrey M. Voas. 2012. Mobile Application and Device Power Usage Measurements. In 2012 IEEE Sixth International Conference on Software Security and Reliability. 147--156. https://doi.org/10.1109/SERE.2012.19

Digital Library

[41]

Branislav M Popovic. 1992. Generalized chirp-like polyphase sequences with optimum correlation properties. IEEE Transactions on Information Theory 38, 4 (1992), 1406--1409.

Digital Library

[42]

Friedrich Pukelsheim. 1994. The Three Sigma Rule. The American Statistician 48, 2 (1994), 88--91. https://doi.org/10.1080/00031305.1994.10476030 arXiv:https://www.tandfonline.com/doi/pdf/10.1080/00031305.1994.10476030

[43]

Kun Qian, Chenshu Wu, Fu Xiao, Yue Zheng, Yi Zhang, Zheng Yang, and Yunhao Liu. 2018. Acousticcardiogram: Monitoring Heartbeats using Acoustic Signals on Smart Devices. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1574--1582. https://doi.org/10.1109/INFOCOM.2018.8485978

Digital Library

[44]

1 sixty8 media. 2022. How Much Power Does a Car Radio Really Make? https://www.bestcaraudio.com/how-much-power-does-a-car-radio-really-make/.

[45]

Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. 2020. SpiroSonic: Monitoring Human Lung Function via Acoustic Sensing on Commodity Smartphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (London, United Kingdom) (MobiCom '20). Association for Computing Machinery, New York, NY, USA, Article 52, 14 pages. https://doi.org/10.1145/3372224.3419209

Digital Library

[46]

King State. 2023. Hands free car mic module design. https://www.kingstate.com.tw/index.php?do=technology&id=62.

[47]

Ke Sun, Ting Zhao, Wei Wang, and Lei Xie. 2018. VSkin: Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (MobiCom '18). Association for Computing Machinery, New York, NY, USA, 591--605. https://doi.org/10.1145/3241539.3241568

Digital Library

[48]

Yimiao Sun, Weiguo Wang, Luca Mottola, Ruijin Wang, and Yuan He. 2023. AIM: Acoustic Inertial Measurement for Indoor Drone Localization and Tracking. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems (Boston, Massachusetts) (SenSys '22). Association for Computing Machinery, New York, NY, USA, 476--488. https://doi.org/10.1145/3560905.3568499

Digital Library

[49]

David Tse and Pramod Viswanath. 2005. Fundamentals of wireless communication. Cambridge university press.

[50]

Haoran Wan, Shuyu Shi, Wenyu Cao, Wei Wang, and Guihai Chen. 2021. RespTracker: Multi-user room-scale respiration tracking with commercial acoustic devices. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1--10.

Digital Library

[51]

Haoran Wan, Shuyu Shi, Wenyu Cao, Wei Wang, and Guihai Chen. 2023. Multi-User Room-Scale Respiration Tracking Using COTS Acoustic Devices. ACM Trans. Sen. Netw. 19, 4, Article 85 (jun 2023), 28 pages. https://doi.org/10.1145/3594220

Digital Library

[52]

Anran Wang and Shyamnath Gollakota. 2019. MilliSonic: Pushing the Limits of Acoustic Motion Tracking. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI'19). Association for Computing Machinery, New York, NY, USA, 1--11. https://doi.org/10.1145/3290605.3300248

Digital Library

[53]

Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article 170 (jan 2018), 20 pages. https://doi.org/10.1145/3161188

Digital Library

[54]

Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait Recognition Using Wifi Signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany) (UbiComp '16). Association for Computing Machinery, New York, NY, USA, 363--373. https://doi.org/10.1145/2971648.2971670

Digital Library

[55]

Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-Free Gesture Tracking Using Acoustic Signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (New York City, New York) (MobiCom 16). Association for Computing Machinery, New York, NY, USA, 82--94. https://doi.org/10.1145/2973750.2973764

Digital Library

[56]

Zhi Wang, Beihong Jin, Siheng Li, Fusang Zhang, and Wenbo Zhang. 2023. ECG-Grained Cardiac Monitoring Using UWB Signals. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 186 (jan 2023), 25 pages. https://doi.org/10.1145/3569503

Digital Library

[57]

James Williams. 2023. Where Is The Microphones In My Car? https://techpenny.com/microphones-cars/#Where_is_the_Microphone_Located_in_my_Mercedes-Benz.

[58]

TI Staff Writer. 2020. 4 audio trends transforming the automotive industry. https://e2e.ti.com/blogs_/b/behind_the_wheel/posts/automotive-audio-design-trends.

[59]

Yue Wu, Fan Li, Yadong Xie, Yu Wang, and Zheng Yang. 2023. SymListener: Detecting Respiratory Symptoms via Acoustic Sensing in Driving Environments. ACM Trans. Sen. Netw. 19, 1, Article 3 (jan 2023), 21 pages. https://doi.org/10.1145/3517014

Digital Library

[60]

Hee Jung Yoon, Ho-Kyeong RA, Can Basaran, Sang Hyuk Son, Taejoon Park, and Jeonggil Ko. 2017. Fuzzy Bin-Based Classification for Detecting Children's Presence with 3D Depth Cameras. ACM Trans. Sen. Netw. 13, 3, Article 21 (aug 2017), 28 pages. https://doi.org/10.1145/3079764

Digital Library

[61]

Xiaolu Zeng, Beibei Wang, Chenshu Wu, Sai Deepika Regani, and KJ Ray Liu. 2022. Intelligent Wi-Fi based child presence detection system. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 11--15.

[62]

Xiaolu Zeng, Beibei Wang, Chenshu Wu, Sai Deepika Regani, and KJ Ray Liu. 2022. WiCPD: Wireless child presence detection system for smart cars. IEEE Internet of Things Journal 9, 24 (2022), 24866--24881.

[63]

Fusang Zhang, Kai Niu, Jie Xiong, Beihong Jin, Tao Gu, Yuhang Jiang, and Daqing Zhang. 2019. Towards a Diffraction-Based Sensing Approach on Human Activity Recognition. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 1, Article 33 (March 2019), 25 pages.

Digital Library

[64]

Fusang Zhang, Zhi Wang, Beihong Jin, Jie Xiong, and Daqing Zhang. 2020. Your Smart Speaker Can "Hear" Your Heartbeat! Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 161 (dec 2020), 24 pages.

[65]

Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-Grained Human Respiration Sensing with Commodity Wi-Fi Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 53 (March 2018), 23 pages.

Digital Library

[66]

Yi Zhang, Weiying Hou, Zheng Yang, and Chenshu Wu. 2023. VeCare: Statistical Acoustic Sensing for Automotive In-Cabin Monitoring. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). 1185--1200.

Cited By

Fu YZhang YPan HLu YLi XChen LRen JLi XZhang XZhang Y(2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659583

Recommendations

A self-calibrating distributed acoustic sensing platform
SenSys '06: Proceedings of the 4th international conference on Embedded networked sensor systems

We will demonstrate the operation of the Acoustic Embedded Networked Sensing Box (ENSBox), a platform for prototyping rapid-deployable distributed acoustic sensing systems. The ENSBox is a Linux-based acoustic sensing system with and integrated, high ...
The design and implementation of a self-calibrating distributed acoustic sensing platform
SenSys '06: Proceedings of the 4th international conference on Embedded networked sensor systems

We present the design, implementation, and evaluation of the Acoustic Embedded Networked Sensing Box (ENSBox), a platform for prototyping rapid-deployable distributed acoustic sensing systems, particularly distributed source localization. Each ENSBox ...
Dynamic detection of anomalous regions within distributed acoustic sensing data streams using locally stationary wavelet time series

Distributed acoustic sensing technology is increasingly being used to support production and well management within the oil and gas sector, for example to improve flow monitoring and production profiling. This sensing technology is capable of recording ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 8, Issue 1

March 2024

1182 pages

EISSN:2474-9567

DOI:10.1145/3651875

Issue’s Table of Contents

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2024

Published in IMWUT Volume 8, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Beijing Natural Science Foundation
National Natural Science Foundation of China
National Natural Science Foundation of China A3 Foresight Program
Youth Innovation Promotion Association, Chinese Academy of Sciences
Beijing Nova Program

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
912
Total Downloads

Downloads (Last 12 months)912
Downloads (Last 6 weeks)190

Reflects downloads up to 21 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fu YZhang YPan HLu YLi XChen LRen JLi XZhang XZhang Y(2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659583

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents