An academic Chair of Safe Artificial Intelligence
The SAFE IA chair focuses on the theme of safe AI, and more specifically on the robustness and reliability of artificial intelligence systems.

La chaire SAFE IA est financée par la Fondation UTC pour l'innovation.
Presentation
The academic in charge of the Chair: Prof. Sébastien Destercke
Partners: SOPRA STERIA, founding patron of the UTC Foundation for Innovation, SCAI (The Sorbonne Centre for Artificial Intelligence), the CNRS and the University of Technology of Compiègne (UTC).
Insuring robustness and reliability is essential in many industrial and other applications, such as detecting manufacturing defects, obstacles in the path of autonomous transportation, a patient's medical condition, robot control, and more.
The objective of the SAFE AI Chair is to propose new methods to guarantee the robustness of AI models and to test these methods in case studies from the industrial world or other applications where reliability guarantees are essential.
The chair brings together members of five UTC laboratories currently working on AI themes and in fields where AI is due to play an increasingly important role in the future. These are the CID team (of which the chair is a member) at the Heudiasyc laboratory and the LMAC laboratory, part of whose work is at the heart of AI, and the UTC’s Roberval, BMBI, Heudiasyc, and Avenues laboratories, which cover areas in which AI is set to play a key role. It is also associated with Sopra Steria.
Scientific focus
The chair will combine upstream research to develop new AI tools capable of responding to existing or future problems encountered in their application, with implementation and innovation actions based on case studies. To this end, it will mainly explore three scientific areas or issues:
Reliable, safe and trustworthy predictions
The challenge of this research area is to be able to make predictions with a guaranteed error rate, with the aim of increasing confidence in models and moving towards their certification. In particular, this area will focus on the problems of providing such guarantees for each individual, rather than on average, and of producing them in complex prediction spaces (problems involving a time dimension, images, etc.).
Keywords: calibration, statistical guarantees, uncertainty quantification, conformable prediction, learning with abstention
Application areas explored: Industry 4.0 (fault prediction), autonomous transportation (obstacle recognition), so-called “smart” cities and energy (future consumption prediction), healthcare (medical diagnosis).
Robust models
The challenge of this research area is to obtain models that are robust to imperfections in the available data (“small and bad” data rather than “big” data) or to the fact that the deployment environment differs from the model's learning environment, for example when moving from simulation (in silico) or a controlled environment (in vitro) to a real environment (in vivo), or when new classes not present in the learning process appear.
Keywords: transfer learning, robust optimization, self-learning, optimal transport, missing or partial data, anomaly/novelty detection.
Application areas explored: autonomous vehicle driving and drones (real-world control simulation), healthcare (patient models), Industry 4.0 (detection of new faults).
Collaborative learning
The challenge of this area is to improve the quality of models, either through model-model collaboration (e.g., models based on different modalities or measurements) or through model-human collaboration (by soliciting the expert in a relevant and limited manner).
Keywords: co-learning, self-learning, active learning, classifier fusion.
Application areas explored: e‑health (“smart” homes), “smart” cities and transportation (multiple sensors with possible failure/absence).
Resources
This is a large-scale project, mainly funded by the UTC Foundation for Innovation and its members, with human resources provided by all partners. At its launch, the chair includes and plans for:
- 5 laboratories, 2 academic partners, 1 industrial partner, for a total of more than 15 people (researchers, engineers, etc.) involved.
- 1 research engineer for 3 years
- 6 PhDs
- More than 10 internships
- Invitations to foreign professors and research scientists and/or engineers.
Contacts de la recherche à l'UTC
