7. GRVA recalled the purpose of GRVA-11-03, a document from the GRVA leadership gathering all positions expressed so far by GRVA regarding Artificial Intelligence (AI) in the context of vehicle regulations.

8. The experts from France, Germany, and CLEPA/OICA submitted comments to the document (GRVA-12-03, GRVA-12-06 and GRVA-12-32). The experts from Canada and the United States of America also provided comments. GRVA advised to inform the Administrative Committee for the Coordination of Work (AC.2) on the current activities.

9. The expert from FIA fully supported the developments on AI at GRVA. He committed to contribute to the discussions, stating the importance of transparency regarding the technology for the sake of clarity for consumers.

10. GRVA agreed to organize a technical workshop, possibly in March 2022 (before the May 2022 session of GRVA), primarily focusing on common definitions for AI relevant for GRVA activities, and, if possible i.e. if time is available, exploring more in detail the potential role of vehicle regulation(s) and guidance document(s) with regard to AI.

Comments on GRVA-11-03

7. GRVA recalled the purpose of GRVA-11-03, a document from the GRVA leadership gathering all positions expressed so far by GRVA regarding Artificial Intelligence (AI) in the context of vehicle regulations.

8. The experts from France, Germany, and CLEPA/OICA submitted comments to the document (GRVA-12-03, GRVA-12-06 and GRVA-12-32). The experts from Canada and the United States of America also provided comments. GRVA advised to inform the Administrative Committee for the Coordination of Work (AC.2) on the current activities.

9. The expert from FIA fully supported the developments on AI at GRVA. He committed to contribute to the discussions, stating the importance of transparency regarding the technology for the sake of clarity for consumers.

10. GRVA agreed to organize a technical workshop, possibly in March 2022 (before the May 2022 session of GRVA), primarily focusing on common definitions for AI relevant for GRVA activities, and, if possible i.e. if time is available, exploring more in detail the potential role of vehicle regulation(s) and guidance document(s) with regard to AI.

7. GRVA recalled the purpose of GRVA-11-03, a document from the GRVA leadership gathering all positions expressed so far by GRVA regarding Artificial Intelligence (AI) in the context of vehicle regulations.

8. The experts from France, Germany, and CLEPA/OICA submitted comments to the document (GRVA-12-03, GRVA-12-06 and GRVA-12-32). The experts from Canada and the United States of America also provided comments. GRVA advised to inform the Administrative Committee for the Coordination of Work (AC.2) on the current activities.

9. The expert from FIA fully supported the developments on AI at GRVA. He committed to contribute to the discussions, stating the importance of transparency regarding the technology for the sake of clarity for consumers.

10. GRVA agreed to organize a technical workshop, possibly in March 2022 (before the May 2022 session of GRVA), primarily focusing on common definitions for AI relevant for GRVA activities, and, if possible i.e. if time is available, exploring more in detail the potential role of vehicle regulation(s) and guidance document(s) with regard to AI.

7. GRVA recalled the purpose of GRVA-11-03, a document from the GRVA leadership gathering all positions expressed so far by GRVA regarding Artificial Intelligence (AI) in the context of vehicle regulations.

8. The experts from France, Germany, and CLEPA/OICA submitted comments to the document (GRVA-12-03, GRVA-12-06 and GRVA-12-32). The experts from Canada and the United States of America also provided comments. GRVA advised to inform the Administrative Committee for the Coordination of Work (AC.2) on the current activities.

9. The expert from FIA fully supported the developments on AI at GRVA. He committed to contribute to the discussions, stating the importance of transparency regarding the technology for the sake of clarity for consumers.

10. GRVA agreed to organize a technical workshop, possibly in March 2022 (before the May 2022 session of GRVA), primarily focusing on common definitions for AI relevant for GRVA activities, and, if possible i.e. if time is available, exploring more in detail the potential role of vehicle regulation(s) and guidance document(s) with regard to AI.

19. The expert from France introduced GRVA-11-38 with details about the “Grand Défi” Program on “Trustworthy & Industrial AI” taking place in its country. He detailed the three pillars of the programme: the technological pillar, the norm pillar and the applications conformity assessment pillar. He explained the activities under the technological pillar, he provided details on the project called PRISSMA, a first platform on New Autonomous Mobility under the applications conformity assessment Pillar (primarily focusing on distribution droids and shuttle buses without safety drivers) and he described the activities of the French standardization body (ANFNOR), aimed at setting up a standardization road map (and priorities) and international cooperation, to promote common vision on standardization for AI at EU and international levels.

7. The Secretary presented GRVA-11-30, summarizing GRVA-11-03, the document requested by GRVA at its tenth session. He explained that the document was summarizing the deliberations of GRVA, so far, on Artificial Intelligence (AI) in the context of vehicle regulations. He added that the document contained the list of statements made by the delegations on this topic. He continued that the document proposed possibilities, in terms of committees, to further discuss this topic and also in terms of documentation, on how to take stoke of the statements received so far. He went through the text of a draft guidance document drafted on the basis of the positions expressed. He asked for comments and input.

8. The expert from France welcomed the document. He stated that such document was necessary. He promised to provide input after the session to the secretariat.

9. The expert from FIA welcomed developments in the field of AI. He welcomed that GRVA took care of it but he noted that most AI were based on interactions with human beings. He wondered how GRVA should consider the involvement of humans in this context. GRVA invited the expert from FIA to provide input on this aspect at the next session, if desired.

10. The expert from Germany welcomed the document as an excellent summary. She added that the document was under review by the experts and that she would send comments to the secretariat.

11. The expert from UK highlighted that AI could have relevance for other WP.29 subsidiary bodies as AI could also impact e.g. emissions.

12. The expert from the USA sought for clarifications about the purpose of this exercise, and what would be delivered, a note, some reporting to WP.29, or a guidance document.

13. The expert from SAE International stressed that discussions in this area needs to stand with proper definitions.

14. The expert from Canada agreed with the expert from SAE International and stressed the importance of definitions before guidance is contemplated.

15. The expert from the Russian Federation advised, on definitions, to first focus on AI as a software that is implemented in an Automated Driving System (ADS), with specific features, affecting safety.

16. The expert from France suggested that a first output under this agenda item should be an information for WP.29 so that WP.29 can then decide on the outcome that should be delivered.

17. GRVA agreed that AI have applications beyond ADAS and ADS and that this should be reported to WP.29.

18. GRVA welcomed the informal document prepared by the secretariat and invited experts to provide input for the preparation of a revised version.

32. The exert from ISO introduced GRVA-11-13, presenting the activities of the ISO working group developing publicly available specification concerning safety and artificial intelligence for road vehicles. GRVA noted the link with the activities under agenda item 3 and agreed to receive updates at a next session.

Note by the secretariat to support GRVA discussions on this subject.

7. The Secretary presented GRVA-11-30, summarizing GRVA-11-03, the document requested by GRVA at its tenth session. He explained that the document was summarizing the deliberations of GRVA, so far, on Artificial Intelligence (AI) in the context of vehicle regulations. He added that the document contained the list of statements made by the delegations on this topic. He continued that the document proposed possibilities, in terms of committees, to further discuss this topic and also in terms of documentation, on how to take stoke of the statements received so far. He went through the text of a draft guidance document drafted on the basis of the positions expressed. He asked for comments and input.

8. The expert from France welcomed the document. He stated that such document was necessary. He promised to provide input after the session to the secretariat.

9. The expert from FIA welcomed developments in the field of AI. He welcomed that GRVA took care of it but he noted that most AI were based on interactions with human beings. He wondered how GRVA should consider the involvement of humans in this context. GRVA invited the expert from FIA to provide input on this aspect at the next session, if desired.

10. The expert from Germany welcomed the document as an excellent summary. She added that the document was under review by the experts and that she would send comments to the secretariat.

11. The expert from UK highlighted that AI could have relevance for other WP.29 subsidiary bodies as AI could also impact e.g. emissions.

12. The expert from the USA sought for clarifications about the purpose of this exercise, and what would be delivered, a note, some reporting to WP.29, or a guidance document.

13. The expert from SAE International stressed that discussions in this area needs to stand with proper definitions.

14. The expert from Canada agreed with the expert from SAE International and stressed the importance of definitions before guidance is contemplated.

15. The expert from the Russian Federation advised, on definitions, to first focus on AI as a software that is implemented in an Automated Driving System (ADS), with specific features, affecting safety.

16. The expert from France suggested that a first output under this agenda item should be an information for WP.29 so that WP.29 can then decide on the outcome that should be delivered.

17. GRVA agreed that AI have applications beyond ADAS and ADS and that this should be reported to WP.29.

18. GRVA welcomed the informal document prepared by the secretariat and invited experts to provide input for the preparation of a revised version.

7. GRVA recalled the purpose of GRVA-11-03, a document from the GRVA leadership gathering all positions expressed so far by GRVA regarding Artificial Intelligence (AI) in the context of vehicle regulations.

8. The experts from France, Germany, and CLEPA/OICA submitted comments to the document (GRVA-12-03, GRVA-12-06 and GRVA-12-32). The experts from Canada and the United States of America also provided comments. GRVA advised to inform the Administrative Committee for the Coordination of Work (AC.2) on the current activities.

9. The expert from FIA fully supported the developments on AI at GRVA. He committed to contribute to the discussions, stating the importance of transparency regarding the technology for the sake of clarity for consumers.

10. GRVA agreed to organize a technical workshop, possibly in March 2022 (before the May 2022 session of GRVA), primarily focusing on common definitions for AI relevant for GRVA activities, and, if possible i.e. if time is available, exploring more in detail the potential role of vehicle regulation(s) and guidance document(s) with regard to AI.

GRVA adopted the provisional agenda prepared for the session, ECE/TRANS/WP.29/GRVA/2021/18, with the following insertion: Item 12(d) “Arrangement of meetings” (See GRVA-10-20/Rev.1).

113. The expert from the Russian Federation introduced GRVA-09-23 suggesting definitions (taken from the International Standard Organization) for Artificial Intelligence (AI) with relevance for wheel vehicles, their subsystems and parts. He proposed to consider that AI is considered as a software i.e. a design feature of an automotive product and that therefore no design requirements should be developed. He mentioned the impossibility to verify the performance of AI systems. He also suggested that any risk mitigation may be part of the audit as defined in the NATM.

114. The expert from CLEPA explained that methods to validate the performance of AI agent were existing. He mentions methods such as blackbox testing, statistical approaches and therefore disputed the word “impossible” as GRVA could rely on methods developed by Institute of Electrical and Electronics Engineers (IEEE), ISO and International Electrotechnical Commission (IEC) for this purpose. He mentioned existing issues to be addressed at the regulatory level, such as the use of continuous learning features at “Vehicle Identification Number (VIN) level” (i.e. individual vehicle level, opposed to vehicle fleet level).

115. GRVA could not further discuss this proposal, due to time constraints, but agreed to prioritize this item at its May 2021 session.

GRVA completed the review of GRVA-09-23 “Artificial intelligence definition and specifics of its application for
automated road vehicles”, which was initially tabled by the expertfrom the Russian Federation at the ninth session of GRVA.

GRVA requested the secretariat, together with the GRVA officers, to draft a document based on the input received, containing definitions and some general best practices and recommendations related to Artificial Intelligence in the context of vehicle regulations, for review at the September 2021 session of GRVA.

List of decisions subject to the special “silence procedure” whereby parties may signal any reservations concerning the decisions following the session proper. This procedure was adopted due to the shortened and virtual sessions necessitated by current health and travel restrictions.