skip to main content
10.1145/3473682.3480252acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
Work in Progress

Measuring Interaction-based Secondary Task Load: A Large-Scale Approach using Real-World Driving Data

Published: 22 September 2021 Publication History

Abstract

Center touchscreens are the main Human-Machine Interface (HMI) between the driver and the vehicle. They are becoming, larger, increasingly complex and replace functions that could previously be controlled using haptic interfaces. To ensure that touchscreen HMIs can be operated safely, they are subject to strict regulations and elaborate test protocols. Those methods and user trials require fully functional prototypes and are expensive and time-consuming. Therefore it is desirable to estimate the workload of specific interfaces or interaction sequences as early as possible in the development process. To address this problem, we envision a model-based approach that, based on the combination of user interactions and UI elements, can predict the secondary task load of the driver when interacting with the center screen. In this work, we present our current status, preliminary results, and our vision for a model-based system build upon large-scale natural driving data.

References

[1]
Amirhossein S. Aghaei, Birsen Donmez, Cheng Chen Liu, Dengbo He, George Liu, Konstantinos N. Plataniotis, Huei-Yen Winnie Chen, and Zohreh Sojoudi. 2016. Smart Driver Monitoring: When Signal Processing Meets Human Factors: In the driver's seat. IEEE Signal Processing Magazine 33, 6 (nov 2016), 35–48. https://doi.org/10.1109/msp.2016.2602379
[2]
Erwin Boer, Michael Rakauskas, Nicholas Ward, and Michael Goodrich. 2005. Steering entropy revisited. In Proceedings of the Third International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design. University of Iowa, Rockport, Maine, USA, 25–32.
[3]
J. Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, New York, USA.
[4]
Emmanuel de Salis, Dan Yvan Baumgartner, and Stefano Carrino. 2019. Can We Predict Driver Distraction without Driver Psychophysiological State? A Feasibility Study on Noninvasive Distraction Detection in Manual Driving. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings (Utrecht, Netherlands) (AutomotiveUI ’19). Association for Computing Machinery, New York, NY, USA, 194–198. https://doi.org/10.1145/3349263.3351514
[5]
Patrick Ebel, Florian Brokhausen, and Andreas Vogelsang. 2020. The Role and Potentials of Field User Interaction Data in the Automotive UX Development Lifecycle: An Industry Perspective. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 141–150. https://doi.org/10.1145/3409120.3410638
[6]
Patrick Ebel, Christoph Lingenfelder, and Andreas Vogelsang. 2021. Visualizing Event Sequence Data for User Behavior Evaluation of In-Vehicle Information Systems. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, Leeds, United Kingdom) (AutomotiveUI ’21). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/3409118.3475140
[7]
Johan Engström, Emma Johansson, and Joakim Östlund. 2005. Effects of visual and cognitive load in real and simulated motorway driving. Transportation Research Part F: Traffic Psychology and Behaviour 8, 2 (mar 2005), 97–120. https://doi.org/10.1016/j.trf.2005.04.012
[8]
Martin Gjoreski, Matja Z Gams, Mitja Lustrek, Pelin Genc, Jens-U. Garbas, and Teena Hassan. 2020. Machine Learning and End-to-End Deep Learning for Monitoring Driver Distractions From Physiological and Visual Signals. IEEE Access 8(2020), 70590–70603. https://doi.org/10.1109/access.2020.2986810
[9]
P. Green, T. Kang, and Brian Lin. 2015. Touch Screen Task Element Times for Improving SAE Recommended Practice J2365: First Proposal. Technical Report. University of Michigan Transportation Research Institute (UMTRI).
[10]
Katja Kircher and Christer Ahlstrom. 2010. Predicting Visual Distraction Using Driving Performance Data. Annals of advances in automotive medicine / Annual Scientific Conference... Association for the Advancement of Automotive Medicine. Association for the Advancement of Automotive Medicine. Scientific Conference 54 (01 2010), 333–42.
[11]
David R. Large, Gary Burnett, Elizabeth Crundall, Editha van Loon, Ayse L. Eren, and Lee Skrypchuk. 2017. Developing Predictive Equations to Model the Visual Demand of In-Vehicle Touchscreen HMIs. International Journal of Human–Computer Interaction 34, 1 (apr 2017), 1–14. https://doi.org/10.1080/10447318.2017.1306940
[12]
Zhaojian Li, Shan Bao, Ilya V. Kolmanovsky, and Xiang Yin. 2018. Visual-Manual Distraction Detection Using Driving Performance Indicators With Naturalistic Driving Data. IEEE Transactions on Intelligent Transportation Systems 19, 8 (aug 2018), 2528–2535. https://doi.org/10.1109/tits.2017.2754467
[13]
Gustav Markkula and J Engström. 2006. A Steering Wheel Reversal Rate Metric for Assessing Effects of Visual and Cognitive Secondary Task Load. In Proceedings of the 13th ITS World Congress. The University of Leeds, London, UK, 1–12.
[14]
Okihiko Nakayama, Tohru Futami, Tomokazu Nakamura, and Erwin R. Boer. 1999. Development of a Steering Entropy Method for Evaluating Driver Workload. In SAE Technical Paper Series. SAE International, United States, 1–12. https://doi.org/10.4271/1999-01-0892
[15]
National Center for Statistics and Analysis. 2021. Distracted driving 2019. Technical Report Report No. DOT HS 811 299. National Highway Traffic Safety Administration.
[16]
Oskar Palinko, Andrew L. Kun, Alexander Shyrokov, and Peter Heeman. 2010. Estimating Cognitive Load Using Remote Eye Tracking in a Driving Simulator. In Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications (Austin, Texas) (ETRA ’10). Association for Computing Machinery, New York, NY, USA, 141–144. https://doi.org/10.1145/1743666.1743701
[17]
Michael Pettitt and Gary Burnett. 2010. Visual Demand Evaluation Methods for In-Vehicle Interfaces. International Journal of Mobile Human Computer Interaction 2, 4 (oct 2010), 45–57. https://doi.org/10.4018/jmhci.2010100103
[18]
Martina Risteska, Joyita Chakraborty, and Birsen Donmez. 2018. Predicting Environmental Demand and Secondary Task Engagement Using Vehicle Kinematics from Naturalistic Driving Data. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 66–73. https://doi.org/10.1145/3239060.3239091
[19]
Stefan Schneegass, Bastian Pfleging, Nora Broy, Frederik Heinrich, and Albrecht Schmidt. 2013. A Data Set of Real World Driving to Assess Driver Workload. In Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Eindhoven, Netherlands) (AutomotiveUI ’13). Association for Computing Machinery, New York, NY, USA, 150–157. https://doi.org/10.1145/2516540.2516561
[20]
Erin T. Solovey, Marin Zec, Enrique Abdon Garcia Perez, Bryan Reimer, and Bruce Mehler. 2014. Classifying Driver Workload Using Physiological and Driving Performance Data: Two Field Studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 4057–4066. https://doi.org/10.1145/2556288.2557068

Cited By

View all
  1. Measuring Interaction-based Secondary Task Load: A Large-Scale Approach using Real-World Driving Data

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    AutomotiveUI '21 Adjunct: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
    September 2021
    234 pages
    ISBN:9781450386418
    DOI:10.1145/3473682
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 September 2021

    Check for updates

    Author Tags

    1. driver behavior analysis
    2. driver distraction
    3. in-vehicle information systems

    Qualifiers

    • Work in progress
    • Research
    • Refereed limited

    Conference

    AutomotiveUI '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 248 of 566 submissions, 44%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 130
      Total Downloads
    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media