research-article

Multi-User Room-Scale Respiration Tracking Using COTS Acoustic Devices

Authors:

Guihai ChenAuthors Info & Claims

ACM Transactions on Sensor Networks, Volume 19, Issue 4

Article No.: 85, Pages 1 - 28

https://doi.org/10.1145/3594220

Published: 09 June 2023 Publication History

Abstract

Continuous domestic respiration monitoring provides vital information for diagnosing assorted diseases. In this article, we introduce RespTracker, the first continuous, multiple-person respiration tracking system in domestic settings using acoustic-based COTS devices. RespTracker uses a multi-stage algorithm to separate and recombine respiration signals from multiple paths so that it can track the respiration rate of multiple moving subjects. And it leverages features from multiple dimensions to separate different users in the same area. Our experimental results show that our two-stage algorithm can distinguish the respiration of at least four subjects and cover a distance of three meters.

References

[1]

Wan Haoran, Shi Shuyu, Cao Wenyu, Wang Wei, and Chen Guihai. 2021. RespTracker: Multi-user room-scale respirationtracking with commercial acoustic devices. In Proceedings of the IEEE INFOCOM. 1–10.

[2]

Niki Fens, Aeilko H. Zwinderman, Marc P. van der Schee, Selma B. de Nijs, Erica Dijkers, Albert C. Roldaan, David Cheung, Elisabeth H. Bel, and Peter J. Sterk. 2009. Exhaled breath profiling enables discrimination of chronic obstructive pulmonary disease and asthma. American Journal of Respiratory and Critical Care Medicine 180, 11 (2009), 1076–1082.

[3]

S. Javaheri, T. J. Parker, J. D. Liming, W. S. Corbett, H. Nishiyama, L. Wexler, and GAl Roselle. 1998. Sleep apnea in 81 ambulatory male patients with stable heart failure. Circulation 97, 21 (1998), 2154–2159.

[4]

Frank H. Wilhelm, Walton T. Roth, and Marvin A. Sackner. 2003. The lifeshirt: An advanced system for ambulatory measurement of respiratory and cardiac function. Behavior Modification 27, 5 (2003), 671–691.

[5]

Christian Guilleminault, Rafael Pelayo, Damien Leger, Alex Clerk, and Robert C. Z. Bocian. 1996. Recognition of sleep-disordered breathing in children. Pediatrics 98, 5 (1996), 871–882.

[6]

Hao-Yu Wu, Michael Rubinstein, Eugene Shih, John Guttag, Frédo Durand, and William Freeman. 2012. Eulerian video magnification for revealing subtle changes in the world. ACM Transactions on Graphics 31, 4 (2012), 1–8.

Digital Library

[7]

Carey R. Merritt, H. Troy Nagle, and Edward Grant. 2009. Textile-based capacitive sensors for respiration monitoring. IEEE Sensors Journal 9, 1 (2009), 71–78.

[8]

Mark B. Norman, Sally Middleton, Odette Erskine, Peter G. Middleton, John R. Wheatley, and Colin E. Sullivan. 2014. Validation of the sonomat: A contactless monitoring system used for the diagnosis of sleep disordered breathing. Sleep 37, 9 (2014), 1477–1487.

[9]

Chia-Wen Lin and Zhi-Hong Ling. 2007. Automatic fall incident detection in compressed video for intelligent homecare. In Proceedings of the IEEE ICCCN. 1172–1177.

[10]

Shichao Yue, Hao He, Hao Wang, Hariharan Rahul, and Dina Katabi. 2018. Extracting multi-person respiration from entangled RF signals. ACM IMWUT 2, 2 (2018), 1–22.

Digital Library

[11]

Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless Sleep apnea detection on smartphones. In Proceedings of the ACM MobiSys. 45–57. DOI:

Digital Library

[12]

Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity WiFi devices: Do user location and body orientation matter? In Proceedings of the ACM UbiComp. 25–36.

Digital Library

[13]

Shuyu Shi, Yaxiong Xie, Mo Li, Alex X Liu, and Jun Zhao. 2019. Synthesizing wider WiFi bandwidth for respiration rate monitoring in dynamic environments. In Proceedings of the IEEE INFOCOM. 181–189.

Digital Library

[14]

Anran Wang, Jacob E. Sunshine, and Shyamnath Gollakota. 2019. Contactless infant monitoring using white noise. In Proceedings of the ACM MobiCom. 1–16.

Digital Library

[15]

Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW based contactless respiration detection using acoustic signal. In Proceedings of the ACM UbiComp. 1–20.

Digital Library

[16]

Nacer Khalil, Omprakash Gnawali, Driss Benhaddou, and Jaspal Subhlok. 2018. SonicDoor: A person identification system based on modeling of shape, behavior, and walking patterns. ACM Transactions on Sensor Networks 14, 3–4, Article 27 (Dec.2018), 21 pages. DOI:

Digital Library

[17]

B. M. Popovic. 2006. Generalized chirp-like polyphase sequences with optimum correlation properties. IEEE Transactions on Information Theory 38, 4 (2006), 1406–1409. DOI:

Digital Library

[18]

Neal Patwari, Joey Wilson, Sai Ananthanarayanan, Sneha K. Kasera, and Dwayne R. Westenskow. 2014. Monitoring breathing via signal strength in wireless networks. IEEE TMC 13, 8 (2014), 1774–1786.

[19]

Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking vital signs during sleep leveraging off-the-shelf WiFi. In Proceedings of the ACM MobiHoc. 267–276.

Digital Library

[20]

Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. Fullbreathe: Full human respiration detection exploiting complementarity of CSI phase and amplitude of WiFi signals. ACM IMWUT 2, 3 (2018), 1–19.

[21]

Youwei Zeng, Dan Wu, Jie Xiong, Enze Yi, Ruiyang Gao, and Daqing Zhang. 2019. FarSense: Pushing the range limit of WiFi-based respiration sensing with CSI ratio of two antennas. ACM IMWUT 3, 3, Article 121 (2019), 26 pages. DOI:

Digital Library

[22]

Yanni Yang, Jiannong Cao, Xiulong Liu, and Xuefeng Liu. 2019. Multi-breath: Separate respiration monitoring for multiple persons with UWB radar. In Proceedings of the IEEE COMPSAC. 840–849.

[23]

Fengyu Wang, Feng Zhang, Chenshu Wu, Beibei Wang, and K. J. Ray Liu. 2021. ViMo: Multiperson vital sign monitoring using commodity millimeter-wave radio. IEEE Internet of Things Journal 8, 3 (2021), 1294–1307.

[24]

Yuxiao Hou, Yanwen Wang, and Yuanqing Zheng. 2017. TagBreathe: Monitor breathing with commodity RFID systems. In Proceedings of the ICDCS. 404–413. DOI:

[25]

Jinyi Liu, Youwei Zeng, Tao Gu, Leye Wang, and Daqing Zhang. 2021. WiPhone: Smartphone-based respiration monitoring using ambient reflected WiFi signals. ACM IMWUT 5, 1, Article 23 (2021), 19 pages. DOI:

Digital Library

[26]

Fusang Zhang, Zhaoxin Chang, Jie Xiong, Rong Zheng, Junqi Ma, Kai Niu, Beihong Jin, and Daqing Zhang. 2021. Unlocking the beamforming potential of lora for long-range multi-target respiration sensing. ACM IMWUT 5, 2, Article 85 (2021), 25 pages. DOI:

Digital Library

[27]

Tianyue Zheng, Zhe Chen, Shujie Zhang, Chao Cai, and Jun Luo. 2021. MoRe-Fi: Motion-robust and fine-grained respiration monitoring via deep-learning UWB radar. In Proceedings of the ACM SenSys (SenSys’21). 111–124. DOI:

Digital Library

[28]

Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Linghe Kong, and Minglu Li. 2019. BreathListener: Fine-grained breathing monitoring in driving environments utilizing acoustic signals. In Proceedings of the ACM MobiSys. 54–66. DOI:

Digital Library

[29]

Jagmohan Chauhan, Yining Hu, Suranga Seneviratne, Archan Misra, Aruna Seneviratne, and Youngki Lee. 2017. BreathPrint: Breathing acoustics-based user authentication. In Proceedings of the ACM MobiSys. 278–291. DOI:

Digital Library

[30]

Jon Gjengset, Jie Xiong, Graeme McPhillips, and Kyle Jamieson. 2014. Phaser: Enabling phased array signal processing on commodity WiFi access points. In Proceedings of the ACM MobiCom. 153–164.

Digital Library

[31]

Jingxian Wang, Junbo Zhang, Rajarshi Saha, Haojian Jin, and Swarun Kumar. 2019. Pushing the range limits of commercial passive RFIDs. In Proceedings of the Usenix NSDI. 301–316.

[32]

Yaxiong Xie, Jie Xiong, Mo Li, and Kyle Jamieson. 2019. mD-Track: Leveraging multi-dimensionality for passive indoor Wi-Fi tracking. In Proceedings of the ACM MobiCom. 1–16.

Digital Library

[33]

Deepak Vasisht, Swarun Kumar, and Dina Katabi. 2016. Decimeter-level localization with a single WiFi access point. In Proceedings of the Usenix NSDI.

[34]

Kun Qian, Chenshu Wu, Yi Zhang, Guidong Zhang, Zheng Yang, and Yunhao Liu. 2018. Widar2. 0: Passive human tracking with a single Wi-Fi link. In Proceedings of the ACM MobiSys. 350–361.

[35]

Tong Xin, Bin Guo, Zhu Wang, Pei Wang, Jacqueline Chi Kei Lam, Victor Li, and Zhiwen Yu. 2018. Freesense: A robust approach for indoor human detection using Wi-Fi signals. ACM IMWUT 2, 3 (2018), 1–23.

[36]

Venkat Arun and Hari Balakrishnan. 2020. RFocus: Beamforming using thousands of passive antennas. In Proceedings of the Usenix NSDI. 1047–1061. https://www.usenix.org/conference/nsdi20/presentation/arun.

[37]

Nirupam Roy, Sheng Shen, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Inaudible voice commands: The long-range attack and defense. In Proceedings of the Usenix NSDI. 547–560.

[38]

J. N. Moutinho, R. E. Araújo, and D. Freitas. 2016. Indoor localization with audible sound - towards practical imple-mentation. Pervasive and Mobile Computing 29, 25–33 (2016), 1–16. DOI:

Digital Library

[39]

Sheng Shen, Daguan Chen, Yu-Lin Wei, Zhijian Yang, and Romit Roy Choudhury. 2020. Voice localization using nearby wall reflections. In Proceedings of the ACM MobiCom. 1–14.

Digital Library

[40]

Song Wang, Jingqi Huang, Xinyu Zhang, Hyoil Kim, and Sujit Dey. 2020. X-Array: Approximating omnidirectional millimeter-wave coverage using an array of phased arrays. In Proceedings of the ACM MobiCom. Article 5, 14 pages. DOI:

Digital Library

[41]

Xiangmao Chang, Cheng Peng, Guoliang Xing, Tian Hao, and Gang Zhou. 2020. ISleep: A smartphone system for unobtrusive sleep quality monitoring. ACM Transactions on Sensor Networks 16, 3, Article 27 (2020), 32 pages. DOI:

Digital Library

[42]

Ke Sun, Ting Zhao, Wei Wang, and Lei Xie. 2018. VSkin: Sensing touch gestures on surfaces of mobile devices using acoustic signals. In Proceedings of the ACM MobiCom. 591–605.

Digital Library

[43]

Haoran Wan, Lei Wang, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, and Wei Wang. 2022. VECTOR: Velocity based temperature-field monitoring with distributed acoustic devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–28.

Digital Library

[44]

Lei Wang, Haoran Wan, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, and Wei Wang. 2023. SCALAR: Self-calibrated acoustic ranging for distributed mobile devices. IEEE Transactions on Mobile Computing (2023), 1–15.

Digital Library

[45]

Ronald Schafer Alan Oppenheim. 2009. Discrete-Time Signal Processing. Pearsom.

Digital Library

[46]

B. M. Popovic. 1992. Generalized chirp-like polyphase sequences with optimum correlation properties. IEEE TIT 38, 4 (1992), 1406–1409.

Digital Library

[47]

Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision acoustic motion tracking. In Proceedings of the ACM MobiCom. 69–81.

Digital Library

[48]

Anran Wang and Shyamnath Gollakota. 2019. MilliSonic: Pushing the limits of acoustic motion tracking. In Proceedings of the ACM CHI. 1–11.

Digital Library

[49]

Yuzhou Zhuang, Yuntao Wang, Yukang Yan, Xuhai Xu, and Yuanchun Shi. 2021. ReflecTrack: Enabling 3D acoustic position tracking using commodity dual-microphone smartphones. In Proceedings of the ACM UIST. 1050–1062. DOI:

Digital Library

[50]

Wulf-Dieter Wirth. 2013. Radar Techniques Using Array Antennas. Institution of Engineering and Technology. Retrieved from https://digital-library.theiet.org/content/books/ra/pbra026e.

[51]

Marvin H. J. Gruber. 1997. Statistical digital signal processing and modeling. Technometrics 39, 3 (1997), 335–336.

[52]

R. Dwyer. 1983. Detection of non-gaussian signals by frequency domain kurtosis estimation. In Proceedings of the IEEE ICASSP, Vol. 8. 607–610. DOI:

[53]

K. V. Mardia. 1970. Measures of multivariate skewness and kurtosis with applications. Biometrika 57, 3 (1970), 519–530. Retrieved fromhttp://www.jstor.org/stable/2334770.

[54]

Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the ACM MobiCom. 82–94. DOI:

Digital Library

[55]

Raspberry Pi Foundation. 2023. Raspberry Pi 3 Model B+. https://www.raspberrypi.org/products/raspberry-pi-3-model-b-plus/.

[56]

Seeed Studio. 2023. ReSpeaker 6-Mic Circular Array Kit for Raspberry Pi. https://wiki.seeedstudio.com/ReSpeaker_6-Mic_Circular_Array_kit_for_Raspberry_Pi/.

[57]

Vernier Science Education. 2023. Go Direct Respiration Belt. https://www.vernier.com/product/go-direct-respiration-belt/.

[58]

Seeed Studio. 2023. ReSpeaker Mic Array. https://wiki.seeedstudio.com/ReSpeaker_Mic_Array/.

Cited By

Su YZhang FNiu KWang TJin BWang ZJiang YZhang DQiu LXiong J(2024)Embracing Distributed Acoustic Sensing in Car Cabin for Children Presence DetectionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435488:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643548

Index Terms

Multi-User Room-Scale Respiration Tracking Using COTS Acoustic Devices
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

An Animal Respiration Monitoring System Based on Channel State Information of Wi-Fi Network
ICIT '19: Proceedings of the 2019 7th International Conference on Information Technology: IoT and Smart City

Monitoring respiratory rate of animals is critical in Precesion Animal Hunsbandry. In this paper, a novel non-contact respiration monitoring system using off-the-shelf Wi-Fi devices is proposed based on Channel State Information(CSI) of Wi-Fi network. ...
RespTracker: Multi-user Room-scale Respiration Tracking with Commercial Acoustic Devices
IEEE INFOCOM 2021 - IEEE Conference on Computer Communications
Continuous domestic respiration monitoring provides vital information for diagnosing assorted diseases. In this paper, we introduce RESPTRACKER, the first continuous, multiple-person respiration tracking system in domestic settings using acoustic-based ...
Breath Timing Monitoring Using Spring Coil
IACSIT-SC '09: Proceedings of the 2009 International Association of Computer Science and Information Technology - Spring Conference

We describe a non-invasive breath monitoring method using spring coil which is used to detect the movement of the body surface due to breathing. In this method, subjectwares a vest with the spring coil on the inner side. Therefore, it is compressed by ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Sensor Networks

ACM Transactions on Sensor Networks Volume 19, Issue 4

November 2023

622 pages

ISSN:1550-4859

EISSN:1550-4867

DOI:10.1145/3593034

Editor:
Yunhao Liu
Tsinghua University, China

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 09 June 2023

Online AM: 24 April 2023

Accepted: 13 April 2023

Revised: 20 March 2023

Received: 05 December 2021

Published in TOSN Volume 19, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
Natural Science Foundation of Jiangsu Province of China
Collaborative Innovation Center of Novel Software Technology

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
398
Total Downloads

Downloads (Last 12 months)215
Downloads (Last 6 weeks)18

Reflects downloads up to 21 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Su YZhang FNiu KWang TJin BWang ZJiang YZhang DQiu LXiong J(2024)Embracing Distributed Acoustic Sensing in Car Cabin for Children Presence DetectionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435488:1(1-28)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643548

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents