skip to main content
research-article

On infusing reachability-based safety assurance within planning frameworks for human–robot vehicle interactions

Published: 01 September 2020 Publication History

Abstract

Action anticipation, intent prediction, and proactive behavior are all desirable characteristics for autonomous driving policies in interactive scenarios. Paramount, however, is ensuring safety on the road: a key challenge in doing so is accounting for uncertainty in human driver actions without unduly impacting planner performance. This article introduces a minimally interventional safety controller operating within an autonomous vehicle control stack with the role of ensuring collision-free interaction with an externally controlled (e.g., human-driven) counterpart while respecting static obstacles such as a road boundary wall. We leverage reachability analysis to construct a real-time (100 Hz) controller that serves the dual role of (i) tracking an input trajectory from a higher-level planning algorithm using model predictive control, and (ii) assuring safety by maintaining the availability of a collision-free escape maneuver as a persistent constraint regardless of whatever future actions the other car takes. A full-scale steer-by-wire platform is used to conduct traffic-weaving experiments wherein two cars, initially side-by-side, must swap lanes in a limited amount of time and distance, emulating cars merging onto/off of a highway. We demonstrate that, with our control stack, the autonomous vehicle is able to avoid collision even when the other car defies the planner’s expectations and takes dangerous actions, either carelessly or with the intent to collide, and otherwise deviates minimally from the planned trajectory to the extent required to maintain safety.

References

[1]
Althoff M and Dolan J (2014) Online verification of automated road vehicles using reachability analysis. IEEE Transactions on Robotics 30(4): 903–918.
[2]
Althoff M and Dolan JM (2011) Set-based computation of vehicle behaviors for the online verification of autonomous vehicles. In: Proceedings IEEE International Conference on Intelligent Transportation Systems.
[3]
Althoff M and Krogh BH (2014) Reachability analysis of nonlinear differential-algebraic systems. IEEE Transactions on Automatic Control 59(2): 371–383.
[4]
Arora S, Choudhury S, Althoff D, and Scherer S (2015) Emergency maneuver library – ensuring safe navigation in partially known environments. In: Proceedings IEEE Conference on Robotics and Automation.
[5]
Bajcsy A, Bansal S, Bronstein E, Tolani V, and Tomlin CJ (2019) An efficient reachability-based framework for provably safe autonomous navigation in unknown environments. In: Proceedings IEEE Conference on Decision and Control.
[6]
Bokanowski O, Forcadel N, and Zidani H (2010) Reachability and minimal times for state constrained nonlinear problems without any controllability assumption. SIAM Journal on Control and Optimization 48(7): 4292–4316.
[7]
Brown M, Funke J, Erlien S, and Gerdes JC (2017) Safe driving envelopes for path tracking in autonomous vehicles. Control Engineering Practice 61: 307–316.
[8]
Chen M, Hu Q, Fisac J, Akametalu K, Mackin C, and Tomlin C (2017) Reachability-based safety and goal satisfaction of unmanned aerial platoons on air highways. AIAA Journal of Guidance, Control, and Dynamics 40(6): 1360–1373.
[9]
Chen M, Tam Q, Livingston SC, and Pavone M (2018) Signal temporal logic meets Hamilton–Jacobi reachability: Connections and applications. In: Workshop on Algorithmic Foundations of Robotics.
[10]
Chen M and Tomlin CJ (2018) Hamilton–Jacobi reachability: Some recent theoretical advances and applications in unmanned airspace management. Annual Review of Control, Robotics, and Autonomous Systems 1(1): 333–358.
[11]
Dhinakaran A, Chen M, Chou G, Shih JC, and Tomlin CJ (2017) A hybrid framework for multi-vehicle collision avoidance. In: Proceedings IEEE Conference on Decision and Control.
[12]
Fisac JF, Akametalu AK, Zeilinger MN, Kaynama S, Gillula J, and Tomlin CJ (2018) A general safety framework for learning-based control in uncertain robotic systems. IEEE Transactions on Automatic Control 64(7): 2737–2752.
[13]
Fisac JF, Chen M, Tomlin CJ, and Sastry SS (2015) Reach-avoid problems with time-varying dynamics, targets and constraints. In: Hybrid Systems: Computation and Control.
[14]
Frehse G, Le Guernic C, and Donzé A, et al. (2011) SpaceEx: Scalable verification of hybrid systems. In: Proceedings International Conference Computer Aided Verification.
[15]
Funke J, Brown M, Erlien SM, and Gerdes JC (2017) Collision avoidance and stabilization for autonomous vehicles in emergency scenarios. IEEE Transactions on Control Systems Technology 25(4): 1204–1216.
[16]
Gattami A, Al Alam A, Johansson KH, and Tomlin CJ (2011) Establishing safety for heavy duty vehicle platooning: A game theoretical approach. IFAC World Congress 44(1): 3818–3823.
[17]
Gray A, Gao Y, Hedrick JK, and Borrelli F (2013) Robust predictive control for semi-autonomous vehicles with an uncertain driver model. In: IEEE Intelligent Vehicles Symposium.
[18]
Greenstreet MR and Mitchell I (1998) Integrating projections. In: Hybrid Systems: Computation and Control.
[19]
Koolen T contributors (2018) Parametron.jl: Efficiently solving instances of a parameterized family of optimization problems in Julia. Available at: https://github.com/tkoolen/Parametron.jl.
[20]
Kurzhanski A and Varaiya P (2000) Ellipsoidal techniques for reachability analysis: Internal approximation. System and Control Letters 41(3): 201–211.
[21]
Liu SB, Roehm H, Heinzemann C, Lütkebohle I, Oehlerking J, and Althoff M (2017) Provably safe motion of mobile robots in human environments. In: IEEE/RSJ International Conference on Intelligent Robots and Systems.
[22]
Lorenzetti J, Chen M, Landry B, and Pavone M (2018) Reach-avoid games via mixed-integer second-order cone programming. In: Proceedings IEEE Conference on Decision and Control.
[23]
Majumdar A, Vasudevan R, Tobenkin MM, and Tedrake R (2014) Convex optimization of nonlinear feedback controllers via occupation measures. The International Journal of Robotics Research 33(9): 1209–1230.
[24]
Margellos K and Lygeros J (2011) Hamilton–Jacobi formulation for reach-avoid differential games. IEEE Transactions on Automatic Control 56(8): 1849–1861.
[25]
Mattingley J and Boyd S (2012) CVXGEN: A code generator for embedded convex optimization. Optimization and Engineering 12(1): 1–27.
[26]
Mitchell IM, Bayen AM, and Tomlin CJ (2005) A time-dependent Hamilton–Jacobi formulation of reachable sets for continuous dynamic games. IEEE Transactions on Automatic Control 50(7): 947–957.
[27]
Pacejka H (2002) Tire and Vehicle Dynamics. Amsterdam: Elsevier.
[28]
Patterson V, Thornton S, and Gerdes JC (2018) Tire modeling to enable model predictive control of automated vehicles from standstill to the limits of handling. In: International Symposium on Advanced Vehicle Control.
[29]
Revels J, Lubin M, and Papamarkou T (2016) Forward-mode automatic differentiation in Julia. arXiv preprint arXiv:1607.07892.
[30]
Sadigh D, Sastry S, Seshia SA, and Dragan AD (2016) Planning for autonomous cars that leverage effects on human actions. In: Robotics: Science and Systems.
[31]
Schmerling E, Leung K, Vollprecht W, and Pavone M (2018) Multimodal probabilistic model-based planning for human–robot interaction. In: Proceedings IEEE Conference on Robotics and Automation.
[32]
Stellato B, Banjac G, Goulart P, Bemporad A, and Boyd S (2017) OSQP: An operator splitting solver for quadratic programs. arXiv preprint arXiv:1711.08013.
[33]
Tanabe K and Chen M (2018) BEACLS: Berkeley Efficient API in C++ for Level Set methods. Available at: https://github.com/HJReachability/beacls.
[34]
Wolf MT and Burdick JW (2008) Artificial potential functions for highway driving with collision avoidance. In: Proceedings IEEE Conference on Robotics and Automation.
[35]
Yoon S, Fern A, Givan R, and Kambhampati S (2008) Probabilistic planning via determinization in hindsight. In: Proceedings AAAI Conference on Artificial Intelligence.

Cited By

View all
  • (2024)What is Proactive Human-Robot Interaction? - A Review of a Progressive Field and Its DefinitionsACM Transactions on Human-Robot Interaction10.1145/365011713:4(1-30)Online publication date: 23-Apr-2024
  • (2024)Doxo-Physical Planning: A New Paradigm for Safe and Efficient Human-Robot Interaction under UncertaintyCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638361(106-108)Online publication date: 11-Mar-2024
  • (2024)Autonomous Drone Racing: A SurveyIEEE Transactions on Robotics10.1109/TRO.2024.340083840(3044-3067)Online publication date: 14-May-2024
  • Show More Cited By

Index Terms

  1. On infusing reachability-based safety assurance within planning frameworks for human–robot vehicle interactions
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image International Journal of Robotics Research
          International Journal of Robotics Research  Volume 39, Issue 10-11
          Sep 2020
          167 pages

          Publisher

          Sage Publications, Inc.

          United States

          Publication History

          Published: 01 September 2020

          Author Tags

          1. Probabilistic planning
          2. safety-preserving controller
          3. backward reachability analysis
          4. vehicle model predictive control
          5. human–robot interaction

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 21 Oct 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)What is Proactive Human-Robot Interaction? - A Review of a Progressive Field and Its DefinitionsACM Transactions on Human-Robot Interaction10.1145/365011713:4(1-30)Online publication date: 23-Apr-2024
          • (2024)Doxo-Physical Planning: A New Paradigm for Safe and Efficient Human-Robot Interaction under UncertaintyCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3638361(106-108)Online publication date: 11-Mar-2024
          • (2024)Autonomous Drone Racing: A SurveyIEEE Transactions on Robotics10.1109/TRO.2024.340083840(3044-3067)Online publication date: 14-May-2024
          • (2023)End-to-end Parking Behavior Recognition Based on Self-attention MechanismProceedings of the 2023 2nd Asia Conference on Algorithms, Computing and Machine Learning10.1145/3590003.3590072(371-376)Online publication date: 17-Mar-2023
          • (2023)Cooperation for Scalable Supervision of Autonomy in Mixed TrafficIEEE Transactions on Robotics10.1109/TRO.2023.326212039:4(2751-2769)Online publication date: 1-Aug-2023
          • (2022)Interaction-Dynamics-Aware Perception Zones for Obstacle Detection Safety Evaluation2022 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV51971.2022.9827409(1201-1210)Online publication date: 4-Jun-2022
          • (2022)Risk-Based Safety Envelopes for Autonomous Vehicles Under Perception Uncertainty2022 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV51971.2022.9827199(104-111)Online publication date: 4-Jun-2022
          • (2022)ParkPredict+: Multimodal Intent and Motion Prediction for Vehicles in Parking Lots with CNN and Transformer2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC)10.1109/ITSC55140.2022.9922162(3999-4004)Online publication date: 8-Oct-2022
          • (2022)Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Models2022 International Conference on Robotics and Automation (ICRA)10.1109/ICRA46639.2022.9812048(11229-11235)Online publication date: 23-May-2022
          • (2021)Game-Theoretic Planning for Self-Driving Cars in Multivehicle Competitive ScenariosIEEE Transactions on Robotics10.1109/TRO.2020.304752137:4(1313-1325)Online publication date: 1-Aug-2021
          • Show More Cited By

          View Options

          View options

          Get Access

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media