research-article

Virtual visits: life-size immersive communication

Authors:

Sylvie Dijkstra-Soudarissanane,

Simon N. B. Gunkel,

V�ronne ReindersAuthors Info & Claims

MMSys '22: Proceedings of the 13th ACM Multimedia Systems Conference

Pages 310 - 314

https://doi.org/10.1145/3524273.3532903

Published: 05 August 2022 Publication History

Abstract

Elderly people in care homes face a great lack of contact with their families and loved ones. Social isolation and loneliness are detrimental factors for older people in their health condition, cognitive impairment and quality of life. We previously presented a communication system that facilitated high-quality mediated social contact through an Augmented Reality tool with 3D user capture and rendering on an iPad. We have further enhanced this system and propose a new demonstrator that provides a working communication system between the elderly and family members on a life-size display. A complete end-to-end chain architecture is presented, where capture, transmission, and rendering are enhanced to provide a tool for natural interaction and high social presence. Our system is technically ready and well-adapted to meet the needs of elderly users.

References

[1]

Sarah Abdi, Luc de Witte, and Mark Hawley. 2020. Emerging Technologies With Potential Care and Support Applications for Older People: Review of Gray Literature. JMIR Aging 3, 2 (11 Aug 2020), e17286.

[2]

Dohyun Ahn, Youngnam Seo, Minkyung Kim, Joung Huem Kwon, Younbo Jung, Jungsun Ahn, and Doohwang Lee. 2014. The effects of actual human size display and stereoscopic presentation on users' sense of being together with and of psychological immersion in a virtual character. Cyberpsychology, Behavior, and Social Networking 17, 7 (2014), 483--487.

[3]

Richard Atkinson and R.M. Shiffrin. 1968. Human Memory: A Proposed System and its Control Processes. The psychology of learning and motivation 2 (12 1968), 89--195.

[4]

Gunilla Berndtsson, Mats Folkesson, and Valentin Kulyk. 2012. Subjective quality assessment of video conferences and telemeetings. 2012 19th International Packet Video Workshop (PV) (2012), 25--30.

[5]

Anargyros Chatzitofis, Leonidas Saroglou, Prodromos Boutis, Petros Drakoulis, Nikolaos Zioulis, Shishir Subramanyam, Bart Kevelham, Caecilia Charbonnier, Pablo Cesar, Dimitrios Zarpalas, et al. 2020. Human4d: A human-centric multimodal dataset for motions and immersive media. IEEE Access 8 (2020), 176241--176262.

[6]

Sylvie Dijkstra-Soudarissanane, Tessa Klunder, Aschwin Brandt, and Omar Niamut. 2021. Towards XR Communication for Visiting Elderly at Nursing Homes. In ACM International Conference on Interactive Media Experiences (Virtual Event, USA) (IMX '21). Association for Computing Machinery, New York, NY, USA, 319--321.

Digital Library

[7]

Simon NB Gunkel, Rick Hindriks, Karim M El Assal, Hans M Stokking, Sylvie Dijkstra-Soudarissanane, Frank ter Haar, and Omar Niamut. 2021. VRComm: an end-to-end web system for real-time photorealistic social VR communication. In Proceedings of the 12th ACM Multimedia Systems Conference. 65--79.

Digital Library

[8]

�ric Jamet. 2014. An eye-tracking study of cueing effects in multimedia learning. Computers in Human Behavior 32 (03 2014), 47--53.

[9]

Alan B. Johnston and Daniel C. Burnett. 2013. WebRTC: APIs and RTCWEB Protocols of the HTML5 Real-Time Web. Digital Codex LLC.

[10]

Sasa Junuzovic, Kori Inkpen Quinn, Rajesh Hegde, and Zhengyou Zhang. 2011. Towards ideal window layouts for multi-party, gaze-aware desktop videoconferencing. In Graphics Interface.

[11]

Scott Kelby. 2013. Digital Photography Book, The: Part 1 (2 ed.). Peachpit Press.

[12]

Blanka Klimova. 2016. Elderly People and Their Use of Smart Technologies: Benefits and Limitations. 405--412.

[13]

Robert Kooima. 2009. Generalized perspective projection. J. Sch. Electron. Eng. Comput. Sci 6 (2009).

[14]

Jason Lawrence, Dan B Goldman, Supreeth Achar, Gregory Major Blascovich, Joseph G. Desloge, Tommy Fortes, Eric M. Gomez, Sascha H�berling, Hugues Hoppe, Andy Huibers, Claude Knaus, Brian Kuschak, Ricardo Martin-Brualla, Harris Nover, Andrew Ian Russell, Steven M. Seitz, and Kevin Tong. 2021. Project Starline: A high-fidelity telepresence system. ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 40(6) (2021).

[15]

Meg Morris, Brooke Adair, Kimberly Miller, Elizabeth Ozanne, Ralph Hampson, Alan Pearce, Nick Santamaria, L Viegas, Maureen Long, and Catherine Said. 2013. Smart-Home Technologies to Assist Older People to Live Well at Home. Journal of Aging Science 1 (01 2013), 101.

[16]

Meg Morris, Elizabeth Ozanne, Kimberly Miller, Nick Santamaria, Alan Pearce, Catherine Said, and Brooke Adair. 2012. Smart technologies for older people. The University of Melbourne.

[17]

Ignacio Reimat, Evangelos Alexiou, Jack Jansen, Irene Viola, Shishir Subramanyam, and Pablo Cesar. 2021. CWIPC-SXR: Point Cloud dynamic human dataset for Social XR. In Proceedings of the 12th ACM Multimedia Systems Conference. 300--306.

Digital Library

[18]

Dunja Vucic, Lea Skorin-Kapov, and Mirko Suznjevic. 2016. The impact of bandwidth limitations and video resolution size on QoE for WebRTC-based mobile multi-party video conferencing. 59--63.

[19]

Yang Xu, Chenguang Yu, Jingjiang Li, and Yong J. Liu. 2014. Video Telephony for End-Consumers: Measurement Study of Google+, iChat, and Skype. IEEE/ACM Transactions on Networking 22 (2014), 826--839.

Digital Library

Cited By

Barzon PGunkel SAlexiou EDijkstra-Soudarissanane S(2023)The Value of Immersive Communication Systems in Online Meetings: A Problem Statement and Literature Review2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE58569.2023.10405623(610-615)Online publication date: 25-Oct-2023
https://doi.org/10.1109/MetroXRAINE58569.2023.10405623
Singh SDijkstra-Soudarissanane SGunkel SAmirpour HViola IVega M(2022)Engagement and Quality of Experience in Remote Business MeetingsProceedings of the 1st Workshop on Interactive eXtended Reality10.1145/3552483.3556457(77-82)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.1145/3552483.3556457

Index Terms

Virtual visits: life-size immersive communication

Recommendations

Towards XR Communication for Visiting Elderly at Nursing Homes
IMX '21: Proceedings of the 2021 ACM International Conference on Interactive Media Experiences

Due to the current pandemic, the elderly in care homes are greatly affected by the lack of contact with their families, resulting in various mental conditions (e.g., depression, feelings of loneliness) and deterioration of mental health for dementia ...
"You AR' right in front of me": RGBD-based capture and rendering for remote training
MMSys '23: Proceedings of the 14th ACM Multimedia Systems Conference

Immersive technologies such as virtual reality have enabled novel forms of education and training, where students can learn new skills in simulated environments. But some specialized training procedures, e.g. ESA-certified soldering, still involve real-...
Haptic and Auditory Feedback on Immersive Media in Virtual Reality
VRST '24: Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology

In Virtual Reality (VR), visual and auditory sensations are effectively leveraged to create immersive experiences. However, touch is significantly underutilized in immersive media. We enhance the VR image viewing experience by integrating haptic and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMSys '22: Proceedings of the 13th ACM Multimedia Systems Conference

June 2022

432 pages

ISBN:9781450392839

DOI:10.1145/3524273

General Chairs:
Niall Murray
Technological University of the Shannon: Midlands Midwest
,
Gwendal Simon
Synamedia
,
Mylene Farias
University of Brasilia
,
Program Chairs:
Irene Viola
Centrum Wiskunde & Informatica
,
Mario Montagud
i2CAT Foundation & University of Valencia

Copyright � 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 August 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MMSys '22

Sponsor:

SIGMM

MMSys '22: 13th ACM Multimedia Systems Conference

June 14 - 17, 2022

Athlone, Ireland

Acceptance Rates

Overall Acceptance Rate 176 of 530 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
218
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)3

Reflects downloads up to 21 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Barzon PGunkel SAlexiou EDijkstra-Soudarissanane S(2023)The Value of Immersive Communication Systems in Online Meetings: A Problem Statement and Literature Review2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)10.1109/MetroXRAINE58569.2023.10405623(610-615)Online publication date: 25-Oct-2023
https://doi.org/10.1109/MetroXRAINE58569.2023.10405623
Singh SDijkstra-Soudarissanane SGunkel SAmirpour HViola IVega M(2022)Engagement and Quality of Experience in Remote Business MeetingsProceedings of the 1st Workshop on Interactive eXtended Reality10.1145/3552483.3556457(77-82)Online publication date: 14-Oct-2022
https://dl.acm.org/doi/10.1145/3552483.3556457

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents