AVSC Publication Summary
Fallback Test Driver Training
WHY is it important?
WHAT is recommended?
- Qualifications and training for on-board human oversight of testing
- Criteria and processes for selecting and training test personnel
- Pre-work shift and post-work shift recommendations
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Operating Design Domain
April 2020 │ SAE J3206, July 2021 │ SAE J3259 in progress
WHY is it important?
WHAT is recommended?
- A conceptual framework and lexicon for describing the ODD
- A consistent list of variables with definitions for describing the ODD
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Passenger Initiated Emergency Trip Interruption
June 2020 │ SAE J3114 in progress
WHY is it important?
WHAT is recommended?
- Recommended processes for passenger-initiated emergency
- Criteria and processes for passenger initiation of the features from inside a vehicle
- Communication with passengers, fleet operations, enhanced diagnoses of situation
- Interaction outside the vehicle with other road users, and general post-stop actions
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Data Collection
Sept 2020 │ SAE J3197, July 2021
WHY is it important?
WHAT is recommended?
- Common data collection practices for the purpose of event analysis and producing lessons learned.
- Clarifies areas specific to ADS-DVs.
- Definition of data elements, considerations for data prioritization, retrievability, survivability, storage, and traceability.
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
First Responder Interactions
Dec 2020 │ SAE J3206, July 2021
WHY is it important?
WHAT is recommended?
- Defines common first responder roles, interactions, and use cases.
- Recommended protocols for ADS developers and manufacturers to use when interacting with first responders across multiple use cases.
- Provides a framework to promote consistency for ADS developers and manufacturers in creating, distributing, and maintaining a first responder interaction plan
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Metrics and Methods for Assessing Safety Performance
Mar 2021 │Under consideration for SAE J3237 and ISO 5083 working groups
WHY is it important?
WHAT is recommended?
- Foundational set of metrics to assess safety performance of the dynamic driving task.
- Recommends measuring safety outcomes (crashes and compliance with traffic regulations) and predictive metrics (maintaining a safety envelope, exhibit contextually safe vehicle motion control, and Object and event detection and response (OEDR).
- Methods for assessing dynamic driving task (DDT) focused on aggregate results of several metrics
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Adapting a Safety Management System (SMS) for ADS Testing and Evaluation
Nov 2021
WHY is it important?
WHAT is recommended?
- Clarity on lexicon and relationship between maneuvers, OEDR and behaviors.
- Glimpse into how AVSC members are using behavioral competencies within their organizations as part of a safety assurance framework.
- Elemental behavioral competency list can be used and customized by developers to demonstrate safety performance in whatever context they choose.
- Example of a repeatable method to tie in previous work of AVSC (ODD, Metrics) to develop application-specific metrics, using “Maintaining a Lane” to illustrate.
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
July 2021
WHY is it important?
WHAT is recommended?
- Information Report shares information on a Safety Management System (SMS) framework considering ADS testing and evaluation.
- Create awareness of sound and effective approaches. Leverage approaches and/or frameworks used by other industries.
- Promote a safety culture, a system to assess and manage safety risk, evaluate risk control strategy effectiveness, and support organizational safety policies and objectives.
Fallback Test Driver Training
SAE J3018, Dec 2020
Operating Design Domain
April 2020 SAE J3206
July 2021 SAE J3259 in progress
Passenger Initiated Emergency Trip Interruption
June 2020
SAE J3114 in progress
Data Collection
SAE J3197, July 2021
First Responder Interactions
SAE J3206, July 2021
Metrics and Methods for Assessing Safety Performance
Mar 2021 SAE J3206
Under consideration for SAE J3237 and ISO 5083 working groups
Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation
July 2021
Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)
AVSC Publication Summary
NAVIGATING TOWARD SAFER DEPLOYMENTS
The AVSC has identified a number of Principles that support the safe development of SAE Level 4 and 5 automated driving systems. The AVSC operationalizes these high-level statements in best practice documents available to the public.
We will continue to add new principles throughout 2022. Check back soon!
PUBLICATIONS
AVSC Best Practice for Evaluation of Behavioral Competencies for Automated Driving System Dedicated Vehicles (ADS-DVs)
Recommends an elemental list of behavioral competencies, lexicon, and framework for ADS developers to evaluate the safety performance of an ADS-DV. Linking behavioral competencies to a key set of scenarios for a given ODD provides relevant evidence for ADS safety performance and contributes to manufacturer’s case for safety.
AVSC Information Report for Adapting a Safety Management System (SMS) for Automated Driving System (ADS) SAE Level 4 and 5 Testing and Evaluation
Shares information on how a Safety Management System (SMS) framework can support ADS test operations. This information report highlights how an integrated organizational safety approach may help risk-based decision-making during SAE Level 4 and 5 ADS testing and evaluation.
AVSC Best Practice for Metrics and Methods for Assessing Safety Performance of Automated Driving Systems (ADS)
Recommends a set of metrics that may be used to assess ADS safety performance of the dynamic driving task (DDT). The metrics and methods described are principally designed to provide evidence of safety performance for deployment of fleet-operated/managed SAE level 4 and 5 ADS-dedicated vehicles (ride-hailing or product delivery).
AVSC Best Practice for First Responder Interactions with Fleet-Managed Automated Driving System-Dedicated Vehicles (ADS-DVs)
Recommends a common approach for ADS developers to describe the interactions, protocols, and vital information, to facilitate first responder interactions with SAE level 4/5 fleet operated vehicles.
AVSC Best Practice for Data Collection for Automated Driving System Dedicated Vehicles to Support Event Analysis
Recommendations for uniform collection, storage, and retrievability of onboard motor vehicle ADS event data to support analysis and learning from critical driving scenarios.
AVSC Best Practice for Passenger-Initiated Emergency Trip Interruption
As passengers take rides in fleet-managed automated driving system-dedicated vehicles (ADS-DVs), they may feel the need to interrupt the trip due to a perceived emergency. There is currently no industry consensus on the proper balance between ADS passenger agency and the potential for introducing unexpected outcomes in dynamic traffic environments.
AVSC Best Practice for Describing an Operational Design Domain: Conceptual Framework and Lexicon
The Operational Design Domain (ODD) describes the conditions under which an automated driving system (ADS) operated vehicle is designed to function. The ODD could include, but is not limited to, aspects of the environmental, geography, time-of-day, and the presence or absence of certain traffic or roadway characteristics.
AVSC Best Practice for safety operator selection, training, and oversight procedures for automated vehicles under test
This Best Practice addresses the qualifications and training for on-board human oversight of testing for automated driving system (ADS)-operated vehicles. The Best Practice applies to humans within the vehicle responsible for the safe oversight of development and testing SAE Level 4 and Level 5 automated driving systems on public roads.
Companion Papers
