2nd RAMI
Field Campaign for Aerial Robots Results
The second edition of RAMI evaluation campaigns for aerial robots, held in conjunction with the International Conference on Unmanned Aircraft Systems (ICUAS) 2023. The competition is taking place in two subsequent stages. First, the cascade evaluation campaign run from January to April 2023, where teams have developed and tested their algorithms on datasets provided by CATEC.
The Cascade evaluation campaign allowed us to select the best performing teams to participate in the field evaluation campaign (second stage), which took place at the ICUAS conference venue in June 2023 in Warsaw, Poland.
Results
TBM1 – Punctual inspection in difficult access areas
Rank | Team | RMSE [m] |
1 | CVAR | 36 A, 0 PB |
2 | AiRo lab | 34 A, 0 PB |
3 | SDCN lab | 24 A, 0 PB |
4 | Carrot | 18 A, 0 PB |
5 | UMIC | 17 A, 1 PB |
FBM1 – Precise navigation without GNSS (RMSE in meters)
Rank | Team | RMSE [m] |
1 | RAS-lab | 0.302268 |
2 | CVAR | 0.591235 |
3 | UMIC | 0.652285 |
4 | Carrot | 0.707598 |
5 | AiRo lab | 0.992005 |
6 | SDCNlab | 1.398521 |
FBM2 – Automatic detection of defects (CSI)
Rank | Team | CSI |
1 | AiRo lab | 0.897436 |
2 | UMIC | 0.590909 |
3 | CVAR | 0.565217 |
4 | Carrot | 0.552632 |
5 | SDCN lab | 0.521739 |
6 | RAS lab | 0.183673 |
More information:
- RAMI’s Evaluation Plan
- Competition Description document
- Docker user guide document
- ICUAS’23 UAV Competition registration
Contact us at im(a)metricsproject.eu