2nd RAMI

Cascade Campaign for Aerial Robots Results

The second edition of RAMI evaluation campaigns for aerial robots, held in conjunction with the International Conference on Unmanned Aircraft Systems (ICUAS) 2023. The competition is taking place in two subsequent stages. First, the cascade evaluation campaign run from January to April 2023, where teams have developed and tested their algorithms on datasets provided by CATEC.

The Cascade evaluation campaign allowed us to select the best performing teams to participate in the field evaluation campaign (second stage), which will take place at the ICUAS conference venue in June 2023 in Warsaw, Poland. The teams will be notified about details.

Results

FBM1 – Precise navigation without GNSS

Rank Team RMSE [m]
1 RAS-lab 1.047130
2 CVAR 3.083009
3 PAIRlab 3.610801
4 UAS-DTU 4.012093
5 Carrot 5.493141
6 SDCNlab 6.859361
7 UMIC 7.723799
8 Avant-UFMG 10.088815
9 Purple Bee 47.980188

 

FBM2 – Automatic detection of defects

Rank Team CSI
1 Carrot 0.615385
2 UMIC 0.6
3 RAS-lab 0.571429
4 CVAR 0.47619
5 SDCNlab 0.347826
6 DMA 0.333333
6 UAS-DTU 0.333333
8 PAIRlab 0.133333
9 Avant-UFMG 0.0285714
10 Purple Bee 0