AVSC Logo

ACCELERATING

SAFETY STANDARDS

Our industry members support the rapid creation of best practices for testing and development.

View Our Work
AVSC Partners

Overview

Founded in 2019, the Automated Vehicle Safety Consortium™ (AVSC) is an industry program of SAE Industry Technologies Consortia (SAE ITC®). We work to quickly publish best practices that will inform and lead to industry-wide standards advancing the safe deployment of Automated Driving Systems (ADS).  

The members of AVSC bring decades of combined experience focused on safe, reliable, and high-quality transportation. We collaborate to establish and share ADS-related safety principles, common terminology, and industry best practices for the safe development,  testing, and operation of SAE L4/L5 on-road vehicles.

Our goal: to build public trust and acceptance of automated vehicles as a safe and beneficial form of transportation. 

LEARN MORE

AVSC Publication Summary 

AVSC best practice documents are the result of information sharing and collaboration from industry members. They represent an agreement of the topics that are most relevant to the safe development and deployment of automated vehicles. AVSC members agree on why these topics are important and on the resulting recommendations while leaving to the individual developer how to implement these best practices within their organization. 

All best practices are free to download.

 Human handing FOB to Robot.

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Why is it important?

Automated driving system (ADS) developers need a way to describe safe and competent driving for automated driving system-dedicated vehicles (ADS-DVs) in a way that is relatable to how stakeholders interpret safe driving today. The safety performance of some ADS behaviors can be measured and compared to naturalistic driving studies (NDS) data from human drivers to help characterize the socially acceptable balance between safety, lawful driving, efficiency, and comfort. This process enables developers to enhance the safety performance of ADS fleets by aligning it with human-relative benchmarks and considerations.

What is recommended?

  • ADS developers and manufacturers should establish context-relevant reference values and their uncertainties for safety performance metrics.
  • Metrics employed in safety evaluations need to be complemented with reference values (and associated confidence intervals) that qualify the ADS performance as a comparison to such targets.
  • This best practice outlines a process that can be followed to establish such targets, which, in turn, enable a clear evaluation of potential violations.
  • Reference values should be commonly understandable to all stakeholders involved in the development and deployment of ADS systems, including regulatory bodies, developers, manufacturers, and end users.
  • Naturalistic Driving Study (NDS) data of human drivers can be one input used to set these reference values.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Woman in automated vehicle

Continuous Monitoring and Improvement after Deployment

July 2023

Why is it important?

Successful scaling of automated driving system (ADS) technology and realization of its full potential will require developers and service providers to continuously monitor performance of their fleet and enact prompt improvements should issues arise. ADS developers and manufacturers can use the data collected from vehicles in active deployments (e.g., safety performance data) to proactively confirm initial risk assumptions and feed other safety management processes. Continuous monitoring of the automated driving system-dedicated vehicles (ADS-DVs) makes it possible to identify and address new risks related to changes in the environment. This also means the validity of operational design domain (ODD) related assumptions is periodically assessed.

What is recommended?

  • ADS developers and manufacturers should strive to continuously improve upon safety performance over time by reducing or preventing irregularities and strengthening confidence in design assumptions.
  • Frameworks discussed in this document describe how to continuously monitor and potentially improve safety performance in the presence of known and unknown changes in the operating environment.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Woman in automated vehicle

Information Report for Change Risk Management

April 2023

Why is it important?

Making risk management decisions such as safety and change management, safety analysis, and safety assurance are especially applicable when moving from concept to production intent for the ADS-DV. Change Risk Management (CRM) does not replace best practices or other methods for managing safety anomalies or change management processes.

What is covered?

  • This AVSC information report provides a process for change risk management for fleet-operated ADS-DVs using level 4 or 5 automation.
  • The processes and tools outlined are intended to help developers and manufacturers make determinations about risks not captured in the initial risk assessment and decide if further design and/or operational safety measures could be applied.
  • Change risk management (CRM) is a process where ADS-DV manufacturers, developers, and fleet operators may evaluate if and how ADS-DV changes affect previously identified and managed safety risks. They may also identify, assess, and manage new safety risks resulting from those changes.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Automated vehicle at an intersection with illustration of sensors detecting a pedestrian and a cyclist

Interactions Between ADS-DVs and Vulnerable Road Users (VRU)

Aug 2022

Why is it important?

VRUs pose challenges for the safe operation of ADS-DVs. Pedestrians, cyclists, micromobility users, and other VRUs take on different forms, movements, and behaviors. It is critical that developers rigorously test for safe operation when sharing the road with other types of road users.

What is recommended?

  •  It outlines types of VRUs and the challenges associated with detecting and classifying them. 
  • This document also provides context for building behavioral competencies around safely responding to VRUs and applying metrics to evaluate those behavioral competencies.
  • Finally, communication and properly calibrated expectations on the part of both ADS and VRUs will help ensure safe interactions.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Person on a test track reviewing the driving performance of an AV

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Why is it important?

Managing the operational safety risks during testing is an important aspect of SAE Level 4 and 5 ADS development. A Safety Management System (SMS) is one approach designed to support organizational safety in a systematic and integrated way.

What is recommended?

  • Information Report shares information on a Safety Management System (SMS) framework considering ADS testing and evaluation.
  • Create awareness of sound and effective approaches. Leverage approaches and/or frameworks used by other industries.
  • Promote a safety culture, a system to assess and manage safety risk, evaluate risk control strategy effectiveness, and support organizational safety policies and objectives.
DOWNLOADOpens in a new window.

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Busy highway infrastructure with illustration of vehicles connected to one another

Adapting a Safety Management System (SMS) for ADS Testing and Evaluation

July 2021

Why is it important?

There is value in assessing a set of behavioral competencies as directional indication of safety performance. Elemental behaviors can be used as starting point for additional assessment.

What is recommended?

  • Clarity on lexicon and relationship between maneuvers, object and event detection and response (OEDR), and behaviors.
  • Glimpse into how AVSC members are using behavioral competencies within their organizations as part of a safety assurance framework.
  • Elemental behavioral competency list can be used and customized by developers to demonstrate safety performance in whatever context they choose.
  • Example of a repeatable method to tie in previous work of AVSC (ODD, Metrics) to develop application-specific metrics, using “Maintaining a Lane” to illustrate.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Group of people assessing metrics and methods

Metrics and Methods for Assessing Safety Performance 

Mar 2021

Why is it important?

Credible, practicable, and consistent ways to measure ADS performance are essential to garner public trust and confidence. Several ways have been put forward, but not widely adopted. Measuring safety outcomes is a complex task; requiring considerable time and exposure to achieve statistical significance.

What is recommended?

  • Foundational set of metrics to assess safety performance of the dynamic driving task.
  • Recommends measuring safety outcomes (crashes and compliance with traffic regulations) and predictive metrics: maintaining a safety envelope, exhibit contextually safe vehicle motion control, and object and event detection and response (OEDR).
  • Methods for assessing dynamic driving task (DDT) focused on aggregate results of several metrics
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
First responder speaking into a radio receiver

First Responder Interactions

Dec 2020

Why is it important?

Information for ADS developers on first responder awareness, understanding, standardized approach, and training for interacting with automated vehicles.

What is recommended?

  • Defines common first responder roles, interactions, and use cases.
  • Recommended protocols for ADS developers and manufacturers to use when interacting with first responders across multiple use cases.
  • Provides a framework to promote consistency for ADS developers and manufacturers in creating, distributing, and maintaining a first responder interaction plan
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Automated vehicle in traffic using sensors to collect data on the position of the vehicles around it

Data Collection

Sept 2020

Why is it important?

Addresses data collection for event analysis for lessons learned from critical driving scenarios (i.e., what an ADS “saw” and the actions it took). Efficiently and consistently identifying safety issues for deployed vehicles is important to gaining the trust and confidence of the public.

What is recommended?

  • Common data collection practices for the purpose of event analysis and producing lessons learned.
  • Clarifies areas specific to ADS-DVs.
  • Definition of data elements, considerations for data prioritization, retrievability, survivability, storage, and traceability.
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Passengers sitting face to face in an automated vehicle

Passenger Initiated Emergency Trip Interruption

June 2020

Why is it important?

No standards or industry guidance currently address passenger control (agency) for emergency reasons completely unrelated to the ADS’s ability to perform the Dynamic Driving Task (DDT).

What is recommended?

  • Recommended processes for passenger-initiated emergency
  • Criteria and processes for passenger initiation of the features from inside a vehicle
  • Communication with passengers, fleet operations, enhanced diagnoses of situation
  • Interaction outside the vehicle with other road users, and general post-stop actions
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Automated Vehicle Dash

Operating Design Domain

April 2020

Why is it important?

A description of an ADS Operational Design Domain (ODD), commonly defined terms and a framework in which to apply them are fundamental to promote consistent communication and help ensure that users’ ADS expectations are aligned with capabilities.

What is recommended?

  • A conceptual framework and lexicon for describing the ODD
  • A consistent list of variables with definitions for describing the ODD
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 
Woman in automated vehicle

Fallback Test Driver Training 

Nov 2019

Why is it important?

In-vehicle fallback test drivers (IFTDs) contribute to safety during testing and therefore must be thoroughly trained on the automated driving system, the intended operational design domain, and controlling the vehicle to minimize risk.

What is recommended?

  • Qualifications and training for on-board human oversight of testing 
  • Criteria and processes for selecting and training test personnel 
  • Pre-work shift and post-work shift recommendations
DOWNLOAD

Developing ADS Safety Performance Thresholds Based on Human Driving Behavior

Aug 2023

Continuous Monitoring and Improvement after Deployment

July 2023

Information Report for Change Risk Management

April 2023

Interactions Between ADS-DVs and Vulnerable Road Users (VRUs)

Aug 2022

Evaluation of Behavioral Competencies for Automated Driving Systems (ADS)

Nov 2021

Adapting a Safety Management
System (SMS) for ADS Testing and Evaluation

July 2021

Metrics and Methods for Assessing Safety Performance 

Mar 2021

First Responder Interactions

Dec 2020

Data Collection 

Sept 2020 

Passenger Initiated Emergency Trip Interruption

June 2020

Operating Design Domain

April 2020

Fallback Test Driver Training

Nov 2019 

MEMBERS SHARING A COMMITMENT

Aurora Logo
Daimler Logo
SAE international Logo
GM Logo
Lyft logo
Motional Logo
SAE international Logo
Volkswagen Logo
Daimler Logo
Legal
|
PrivacyOpens in a new window.
© {{currentyear}} AVSC. All Rights Reserved