The METRICS project

Metrological Evaluation and Testing of Robots in International Competitions

The METRICS project, led by the National Metrology and Testing Laboratory (LNE), will organize robotics competitions in four priority areas identified by the European Commission: health, agri-food, inspection and maintenance of infrastructure and agile production.

4 competitions in 4 priority areas

Healthcare:
HEART-MET competition

Inspection & Maintenance:
RAMI competition

Agri-Food:
ACRE competition

Agile Production:
ADAPT competition

Development of the Evaluation Framework

METRICS is designed to organise competitions as reproducible and objective evaluation campaigns and aims to structure in a sustainable way the European robotics and Artificial Intelligence (AI) community around the four priority areas.

Consolidation of the European Robotics Community

Bringing together Unique European Competences in robotics and systems testing, METRICS also intends to build a sustainable structure to address the critical needs for evaluation of intelligent systems, which is an essential condition for their adoption.

WHAT’S NEW?

Upcoming Events

HEART-MET CASCADE CAMPAIGN 2022

The METRICS HEART-MET Assistive Robot Challenge at ICSR 2022 will be conducted entirely online based on datasets. The activity recognition datasets comprise of short video clips of persons performing different activities in domestic environments.

More info...

ACRE 2nd CASCADE CAMPAIGN 2023

The ACRE 2nd Cascade Evaluation Campaign 2023 is planned to be held in March 2023 (remotely). Participants will be provided with labelled images to train their models and asked to submit their hypothesis (segmented images) of a test dataset.

More info...

ACRE 2nd FIELD CAMPAIGN 2023

ACRE 2nd Filed Evaluation Campaign will run in Cornaredo (Milan, Italy). The Campaign will include various Task and Functional Benchmarks. To join the 2023 Field Evaluation Campaign, fill the registration form at forms.gle/bu2VVzgx5tAnMK4h9