|
Freek Stulp, Suat Gedikli, and Michael Beetz. Evaluating Multi-Agent Robotic Systems Using Ground Truth. In Proceedings
of the Workshop on Methods and Technology for Empirical Evaluation of Multi-agent Systems and Multi-robot Teams (MTEE),
2004.
|
|
|
[PDF]286.6kB
|
|
|
A thorough empirical evaluation of multi-agent robotic systems is greatly facilitated if the \em true state of the world over
time can be obtained. The accuracy of the beliefs as well as the overall performance can then be measured objectively and
efficiently. In this paper we present a system for determining the \em ground truth state of the world, similar to the ceiling
cameras used in RoboCup small-size league. We have used this ground truth data to evaluate the accuracy of the self- and object-localization
of the robots in our RoboCup mid-size league team, the Agilo RoboCuppers. More complex models of the state estimation module
have also been learned. These models provide insight into the workings and shortcomings of this module, and can be used to
improve it.
|
|
|
@InProceedings{stulp04evaluating,
title = {Evaluating Multi-Agent Robotic Systems Using Ground Truth},
author = {Freek Stulp and Suat Gedikli and Michael Beetz},
booktitle = {Proceedings of the Workshop on Methods and Technology for Empirical Evaluation of Multi-agent Systems and Multi-robot Teams (MTEE)},
year = {2004},
abstract = {A thorough empirical evaluation of multi-agent robotic systems is greatly facilitated if the {\em true} state of the world over time can be obtained. The accuracy of the beliefs as well as the overall performance can then be measured objectively and efficiently. In this paper we present a system for determining the {\em ground truth} state of the world, similar to the ceiling cameras used in RoboCup small-size league. We have used this ground truth data to evaluate the accuracy of the self- and object-localization of the robots in our RoboCup mid-size league team, the Agilo RoboCuppers. More complex models of the state estimation module have also been learned. These models provide insight into the workings and shortcomings of this module, and can be used to improve it.},
bib2html_pubtype = {Refereed Workshop Paper},
bib2html_rescat = {RoboCup},
file = {KI-04-Stulp-etal.pdf:http\://www9.in.tum.de/publications/2004/KI-04-Stulp-etal.pdf:PDF}
}
|
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein
are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the
terms and constraints.
Generated by
bib2html.pl
(written by Patrick Riley
) on
Mon Jul 20, 2015 21:50:11 |