Venue and Dates:
September 14-18, 2015, Intur Bonaire Hotel , Benicàssim, Castellón, Spain
This Summer School is organized by the IEEE-RAS Technical Committee on Performance Evaluation & Benchmarking of Robotic and Automation Systems (TC PEBRAS) as part of the IEEE RAS Technical Education Program. Partial funding is provided by the IEEE Robotics & Automation Society
As the complexity of current robotic and embodied intelligent systems grows, it is more and more necessary to adhere to sound experimental approaches and benchmarking procedures. It is of fundamental importance that the next generation learns good experimental, performance evaluation and benchmarking methods as part of their technical education. We capitalize on our experience on organizing workshops on these topics and on the tradition of organizing robotics summer schools at the same venue.
Participants will get in touch with other young researchers in robotics and will have the opportunity to improve their education through the interaction with experts. IEEE graduate students in robotics will have a unique training opportunity in these important topics. Students will closely interact for one week with some of the top-level researchers in the world relevant to this domain. They will also have the opportunity to discuss their research work with them, as well as with other students.
- Participants will learn how to implement approaches with exhaustive experimental methodology and apply appropriate benchmarking procedures to compare the actual practical results with reference to standard accepted procedures; how experimental results can be replicable and refutable on the one hand, and quantitatively comparable according to community-endorsed metrics, on the other hand. At the end, a student should be able to provide an educated response to the following questions:
- How research should be performed and reported in order to allow result replications.
- How should competitions be designed in order to maximize their contribution to robotics research and the industrial exploitation of results.
- To which extent and for measuring which functionalities and capabilities are benchmarks useful and possible.
- Which balance of result replication, benchmarking, challenges and competitions would allow a more objective evaluation of results and consequent objective assessment of the state of the art in the various subfields of theis domain of research
About the author: