Interaction with Physical Referents In and Around the Field of View of Optical See-Through Augmented-Reality Headsets: Interaction avec des R�f�rents Physiques Dans et Autour du Champ D'Affichage des Casques Semi-Transparents de R�alit� Augment�e
Article No.: 4, Pages 1 - 15
Abstract
Combining digital and physical worlds is today largely simplified thanks to many advances in the capabilities of optical see through AR head mounted displays. In many scenarios such as augmented maintenance, the implementation of AR is now based on the use of physical referents associated with digital information. Although the display space with optical see-through Head-Mounted Displays (HMDs) is almost unlimited, its field of view (FoV) is still small: overlapping the FoV with all these physical referents is therefore very constraining. This raises the challenge of pointing physical referents around the HMD FoV, where the feedback cannot be displayed. To this end, our work characterizes the pointing of physical referents inside and outside the HMD FoV to establish the differences. Our studies focus specifically the nature of the target and the form of feedback used during pointing.
La combinaison des mondes numérique et physiques est aujourd'hui largement simplifiée grâce aux nombreux progrès réalisés dans le domaine des casques de réalité augmentée (RA). Dans de nombreux scenarios, tels que la maintenance augmentée, la mise en œuvre de la RA s'appuie désormais sur l'utilisation de référents physiques associés à des données numériques. Bien que l'espace d'interaction d'un casque de RA soit presque illimité, son champ d'affichage reste limité. Par conséquent la question du pointage des référents physiques autour du champ d'affichage du casque, où le feedback ne peut être affiché, devient cruciale. A cette fin, nos travaux caractérisent le pointage d'un référent physique dans, puis autour, du champ d'affichage du casque pour établir les différences. Nos études se focalisent sur la nature de la cible et du feedback mis en œuvre au cours du pointage.
References
[1]
Tilley Alvin R. and Henry Dreyfuss Associates. 2001. The Measure of Man and Woman: Human Factors in Design, Revised Edition. Wiley. Retrieved from https://www.wiley.com/en-sg/The+Measure+of+Man+and+Woman%3A+Human+Factors+in+Design%2C+Revised+Edition-p-9780471099550
[2]
Ambre Assor, Arnaud Prouzeau, Martin Hachet, and Pierre Dragicevic. Handling Non-Visible Referents in Situated Visualizations.
[3]
Marc Baloup, Thomas Pietrzak, and Géry Casiez. 2019. Amélioration du Raycasting par utilisation de la sélection par proximité et du filtrage. 8, (2019), 61–83.
[4]
Marc Baloup, Thomas Pietrzak, and Géry Casiez. 2019. RayCursor: A 3D Pointing Facilitation Technique based on Raycasting. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19), May 02, 2019, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–12. . https://doi.org/10.1145/3290605.3300331
[5]
Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: a technique for visualizing off-screen objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03), April 05, 2003, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 481–488. . https://doi.org/10.1145/642611.642695
[6]
Joanna Bergström, Tor-Salve Dalsgaard, Jason Alexander, and Kasper Hornbæk. 2021. How to Evaluate Object Selection and Manipulation in VR? Guidelines from 20 Years of Studies. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), May 07, 2021, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–20. . https://doi.org/10.1145/3411764.3445193
[7]
Doug Bowman, Donald Johnson, and Larry Hodges. 2001. Testbed Evaluation of Virtual Environment Interaction Techniques. Presence Teleoperators Virtual Environ. 10, (August 2001). https://doi.org/10.1162/105474601750182333
[8]
Stefano Burigat, Luca Chittaro, and Silvia Gabrielli. 2006. Visualizing locations of off-screen objects on mobile devices: a comparative evaluation of three approaches. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services (MobileHCI ’06), September 12, 2006, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 239–246. . https://doi.org/10.1145/1152215.1152266
[9]
Florent Cabric, Emmanuel Dubois, Pourang Irani, and Marcos Serrano. 2019. TouchGlass: Raycasting from a Glass Surface to Point at Physical Objects in Public Exhibits. In Human-Computer Interaction – INTERACT 2019 (Lecture Notes in Computer Science), 2019, Cham. Springer International Publishing, Cham, 249–269. . https://doi.org/10.1007/978-3-030-29387-1_15
[10]
Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12), May 05, 2012, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 2527–2530. . https://doi.org/10.1145/2207676.2208639
[11]
Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, and David Lindlbauer. 2021. SemanticAdapt: Optimization-based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections. In The 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21), October 12, 2021, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 282–297. . https://doi.org/10.1145/3472749.3474750
[12]
Euan Freeman, Julie Williamson, Sriram Subramanian, and Stephen Brewster. 2018. Point-and-Shake: Selecting from Levitating Object Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18), April 19, 2018, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–10. . https://doi.org/10.1145/3173574.3173592
[13]
Renaud Gervais, Jérémy Frey, and Martin Hachet. 2015. Pointing in Spatial Augmented Reality from 2D Pointing Devices. In Human-Computer Interaction – INTERACT 2015 (Lecture Notes in Computer Science), 2015, Cham. Springer International Publishing, Cham, 381–389. . https://doi.org/10.1007/978-3-319-22723-8_30
[14]
Tovi Grossman and Ravin Balakrishnan. 2006. The design and evaluation of selection techniques for 3D volumetric displays. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST ’06), October 15, 2006, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 3–12. . https://doi.org/10.1145/1166253.1166257
[15]
Uwe Gruenefeld, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. Beyond Halo and Wedge: visualizing out-of-view objects on head-mounted virtual and augmented reality devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’18), September 03, 2018, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–11. . https://doi.org/10.1145/3229434.3229438
[16]
Uwe Gruenefeld, Tim Claudius Stratmann, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. RadialLight: exploring radial peripheral LEDs for directional cues in head-mounted displays. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’18), September 03, 2018, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–6. . https://doi.org/10.1145/3229434.3229437
[17]
Uwe Gruenefeld, Tim Claudius Stratmann, Lars Prädel, and Wilko Heuten. 2018. MonoculAR: a radial light display to point towards out-of-view objects on augmented reality devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI ’18), September 03, 2018, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 16–22. . https://doi.org/10.1145/3236112.3236115
[18]
Sean Gustafson, Patrick Baudisch, Carl Gutwin, and Pourang Irani. 2008. Wedge: clutter-free visualization of off-screen locations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08), April 06, 2008, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 787–796. . https://doi.org/10.1145/1357054.1357179
[19]
Sean G. Gustafson and Pourang P. Irani. 2007. Comparing visualizations for tracking off-screen moving targets. In CHI ’07 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’07), April 28, 2007, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 2399–2404. . https://doi.org/10.1145/1240866.1241014
[20]
Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. A survey of design issues in spatial input. In Proceedings of the 7th annual ACM symposium on User interface software and technology - UIST ’94, 1994, Marina del Rey, California, United States. ACM Press, Marina del Rey, California, United States, 213–222. . https://doi.org/10.1145/192426.192501
[21]
Martin Krzywinski and Naomi Altman. 2013. Error bars. Nat. Methods 10, 10 (October 2013), 921–922. https://doi.org/10.1038/nmeth.2659
[22]
Jiandong Liang and Mark Green. 1994. JDCAD: A highly interactive 3D modeling system. Comput. Graph. 18, 4 (July 1994), 499–506. https://doi.org/10.1016/0097-8493(94)90062-0
[23]
Jiazhou Liu, Barrett Ens, Arnaud Prouzeau, Jim Smiley, Isobel Kara Nixon, Sarah Goodwin, and Tim Dwyer. 2023. DataDancing: An Exploration of the Design Space For Visualisation View Management for 3D Surfaces and Spaces. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 19, 2023, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–17. . https://doi.org/10.1145/3544548.3580827
[24]
Paul Lubos, Gerd Bruder, Oscar Ariza, and Frank Steinicke. 2016. Ambiculus: LED-based low-resolution peripheral display extension for immersive head-mounted displays. In Proceedings of the 2016 Virtual Reality International Conference (VRIC ’16), March 23, 2016, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–4. . https://doi.org/10.1145/2927929.2927939
[25]
Mark R. Mine. 1995. Virtual environment interaction techniques. UNC Chap. Hill Comput. Sci. Tech. Rep. … (1995).
[26]
Patrick Perea, Denis Morand, and Laurence Nigay. 2017. [POSTER] Halo3D: A Technique for Visualizing Off-Screen Points of Interest in Mobile Augmented Reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), October 2017. 170–175. . https://doi.org/10.1109/ISMAR-Adjunct.2017.58
[27]
Patrick Perea, Denis Morand, and Laurence Nigay. 2019. Spotlight on Off-Screen Points of Interest in Handheld Augmented Reality: Halo-based techniques. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS ’19), November 10, 2019, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 43–54. . https://doi.org/10.1145/3343055.3359719
[28]
Gary Perelman, Emmanuel Dubois, Alice Probst, and Marcos Serrano. 2022. Visual Transitions around Tabletops in Mixed Reality: Study on a Visual Acquisition Task between Vertical Virtual Displays and Horizontal Tabletops. Proc. ACM Hum.-Comput. Interact. 6, ISS (November 2022), 585:660-585:679. https://doi.org/10.1145/3567738
[29]
Carole Plasson, Dominique Cunin, Yann Laurillau, and Laurence Nigay. 2021. A Lens-Based Extension of Raycasting for Accurate Selection in Dense 3D Environments. In Human-Computer Interaction – INTERACT 2021 (Lecture Notes in Computer Science), 2021, Cham. Springer International Publishing, Cham, 501–524. . https://doi.org/10.1007/978-3-030-85610-6_28
[30]
Ivan Poupyrev, Mark Billinghurst, Suzanne Weghorst, and Tadao Ichikawa. 1996. The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology (UIST ’96), November 01, 1996, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 79–80. . https://doi.org/10.1145/237091.237102
[31]
Hyocheol Ro, Seungho Chae, Inhwan Kim, Junghyun Byun, Yoonsik Yang, Yoonjung Park, and Tackdon Han. 2017. A dynamic depth-variable ray-casting interface for object manipulation in ar environments. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), October 2017, Banff, Canada. Banff, Canada, 2873–2878. . https://doi.org/10.1109/SMC.2017.8123063
[32]
Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: improving one-handed target acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces - AVI ’08, 2008, Napoli, Italy. ACM Press, Napoli, Italy, 146. . https://doi.org/10.1145/1385569.1385594
[33]
Houssem Saidi, Emmanuel Dubois, and Marcos Serrano. 2021. HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, May 06, 2021, Yokohama Japan. ACM, Yokohama Japan, 1–17. . https://doi.org/10.1145/3411764.3445255
[34]
Kadek Ananta Satriadi, Barrett Ens, Maxime Cordeil, Tobias Czauderna, and Bernhard Jenny. 2020. Maps Around Me: 3D Multiview Layouts in Immersive Spaces. Proc. ACM Hum.-Comput. Interact. 4, ISS (November 2020), 201:1-201:20. https://doi.org/10.1145/3427329
[35]
Jonas Schjerlund, Kasper Hornbæk, and Joanna Bergström. 2021. Ninja Hands: Using Many Hands to Improve Target Selection in VR. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), May 07, 2021, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–14. . https://doi.org/10.1145/3411764.3445759
[36]
Thomas Vincent, Laurence Nigay, and Takeshi Kurata. 2013. Precise pointing techniques for handheld Augmented Reality. 2013. Springer, 122. . https://doi.org/10.1007/978-3-642-40483-2_9
[37]
Matt Whitlock, Ethan Harnner, Jed R. Brubaker, Shaun Kane, and Danielle Albers Szafir. 2018. Interacting with Distant Objects in Augmented Reality. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), March 2018, Reutlingen. IEEE, Reutlingen, 41–48. . https://doi.org/10.1109/VR.2018.8446381
[38]
Wesley Willett, Yvonne Jansen, and Pierre Dragicevic. 2017. Embedded Data Representations. IEEE Trans. Vis. Comput. Graph. 23, 1 (January 2017), 461–470. https://doi.org/10.1109/TVCG.2016.2598608
[39]
H.P. Wyss, R. Blach, and M. Bues. 2006. iSith - Intersection-based Spatial Interaction for Two Hands. In 3D User Interfaces (3DUI’06), March 2006. 59–61. . https://doi.org/10.1109/VR.2006.93
[40]
Takatoshi Yoshida, Junichi Ogawa, Kyung Yun Choi, Sanad Bushnaq, Ken Nakagaki, and Hiroshi Ishii. 2021. inDepth: Force-based Interaction with Objects beyond A Physical Barrier. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’21), February 14, 2021, New York, NY, USA. Association for Computing Machinery, New York, NY, USA, 1–6. . https://doi.org/10.1145/3430524.3442447
[41]
Difeng Yu, Qiushi Zhou, Joshua Newn, Tilman Dingler, Eduardo Velloso, and Jorge Goncalves. 2020. Fully-Occluded Target Selection in Virtual Reality. IEEE Trans. Vis. Comput. Graph. 26, 12 (December 2020), 3402–3413. https://doi.org/10.1109/TVCG.2020.3023606
[42]
Futian Zhang, Keiko Katsuragawa, and Edward Lank. 2022. Conductor: intersection-based bimanual pointing in augmented and virtual reality. Proc. ACM Hum.-Comput. Interact. 6, ISS (November 2022), 560:103-560:117. https://doi.org/10.1145/3567713
[43]
Caijun Zhao, Kai Way Li, and Lu Peng. 2023. Movement Time for Pointing Tasks in Real and Augmented Reality Environments. Appl. Sci. 13, 2 (January 2023), 788. https://doi.org/10.3390/app13020788
[44]
2020. Publication manual of the American Psychological Association, 7th ed. American Psychological Association, Washington, DC, US. https://doi.org/10.1037/0000165-000
Index Terms
- Interaction with Physical Referents In and Around the Field of View of Optical See-Through Augmented-Reality Headsets: Interaction avec des Référents Physiques Dans et Autour du Champ D'Affichage des Casques Semi-Transparents de Réalité Augmentée
Recommendations
Interaction between lexicon and image: linguistic specifications of animation
COLING '92: Proceedings of the 14th conference on Computational linguistics - Volume 3Certains textes d'une langue peuvent �tre consid�r�s comme des sp�cifications linguistiques capables d'engendrer des animations qui simulent la compr�hension des textes d'entr�e. Pour r�aliser un tel programme, il nous semble indispensable de construire des ...
Comments
Information & Contributors
Information
Published In
March 2024
209 pages
ISBN:9798400718113
DOI:10.1145/3649792
Copyright � 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 May 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
IHM '24
IHM '24: 35th International Francophone Conference on Human-Computer Interaction
March 25 - 29, 2024
Paris, France
Acceptance Rates
Overall Acceptance Rate 103 of 199 submissions, 52%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 19Total Downloads
- Downloads (Last 12 months)19
- Downloads (Last 6 weeks)1
Reflects downloads up to 21 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format