scope:

This standard provides test specifications with a set of indicators for interference and adversarial attacks that can be used to evaluate the robustness of artificial intelligence (AI)-based image recognition services. This standard specifies robustness requirements and establishes an assessment framework to evaluate the robustness of AI-based image recognition services under various settings.

Purpose

The purpose of this standard is to guide individuals and organizations who provide, develop, or use AI-based image recognition services in testing and evaluating these services and in improving the robustness of these services. It is also applicable to guide third-party evaluation laboratories to test and evaluate the robustness of the service by applying standards-based testing to score individual algorithmic implementations.