54

Simulation and Reinforcement Learning for AMR

Contact Person: Andreina Chietera


Technology

This solution consists of a Reinforcement Learning (RL) based Automatic Mobile Robots (AMRs) Fleet Management System (FMS). The use of such technology comes from the need to adapt to an always-evolving environment, in particular because of human presence. By leveraging video analytics deployed in the factory, the FMS will be able to take into account areas to avoid when dispatching AMRs, at a planning level. AMRs will still embed integrated collision avoidance mechanisms for last second avoidance. The focus of the solution is to improve collision avoidance with increased anticipation: the avoidance should now be seen as a part of planning level and not only to a reactive level anymore. In this component, simulation of the factory is key. It is an essential component for the following reasons: i) It allows to produce an annotated data set to a train Machine Learning Techniques to anticipate the evolution of human presence in the factory; ii) It allows demonstrating our solution on a large-scale scenario; ii) It brings technical primitives such as pathfinding that can be used as a high-level action in the RL FMS; and iv) It allows to train a Reinforcement Learning agent to act as an FMS.


Organisation

Thales employs 83,000 employees in 68 countries with €17 billion in revenues of which around 20% invested in R&D. Thales is a leading international electronics and systems group, addressing defense, transport & security markets. Thales provides high-grade security solutions for both the public and private sector. As a European global leader in data protection, Thales contributes to ensuring a secure digital transformation for its customers. Thales supports its customers (government and public services, banking & insurance, industry, public transportation …) to address their specific concerns and develop solutions that meet the needs of their stakeholders. The Thales’ entity involved in the STAR project is ThereSIS, one of Thales research and innovation laboratory. It aims at identifying disruptive technological challenges, and at derisking relevant technologies for Thales inner Product Lines, through advanced prototyping and demonstrations.

Technology showroom