2nd RAMI

Field Campaign for Aerial Robots Results

The second edition of RAMI evaluation campaigns for aerial robots, held in conjunction with the International Conference on Unmanned Aircraft Systems (ICUAS) 2023. The competition is taking place in two subsequent stages. First, the cascade evaluation campaign run from January to April 2023, where teams have developed and tested their algorithms on datasets provided by CATEC.

The Cascade evaluation campaign allowed us to select the best performing teams to participate in the field evaluation campaign (second stage), which took place at the ICUAS conference venue in June 2023 in Warsaw, Poland.

Results

TBM1 – Punctual inspection in difficult access areas

Rank	Team	RMSE [m]
1	CVAR	36 A, 0 PB
2	AiRo lab	34 A, 0 PB
3	SDCN lab	24 A, 0 PB
4	Carrot	18 A, 0 PB
5	UMIC	17 A, 1 PB

 

FBM1 – Precise navigation without GNSS (RMSE in meters)

Rank	Team	RMSE [m]
1	RAS-lab	0.302268
2	CVAR	0.591235
3	UMIC	0.652285
4	Carrot	0.707598
5	AiRo lab	0.992005
6	SDCNlab	1.398521

 

FBM2 – Automatic detection of defects (CSI)

Rank	Team	CSI
1	AiRo lab	0.897436
2	UMIC	0.590909
3	CVAR	0.565217
4	Carrot	0.552632
5	SDCN lab	0.521739
6	RAS lab	0.183673