Venue and Dates:

September 14-18, 2015, Intur Bonaire Hotel , Benicàssim, Castellón, Spain


This Summer School is organized by the IEEE-RAS Technical Committee on Performance Evaluation & Benchmarking of Robotic and Automation Systems (TC PEBRAS) as part of the IEEE RAS Technical Education Program. Partial funding is provided by the IEEE Robotics & Automation Society

As the complexity of current robotic and embodied intelligent systems grows, it is more and more necessary to adhere to sound experimental approaches and benchmarking procedures. It is of fundamental importance that the next generation learns good experimental, performance evaluation and benchmarking methods as part of their technical education. We capitalize on our experience on organizing workshops on these topics and on the tradition of organizing robotics summer schools at the same venue.

Participants will get in touch with other young researchers in robotics and will have the opportunity to improve their education through the interaction with experts. IEEE graduate students in robotics will have a unique training opportunity in these important topics. Students will closely interact for one week with some of the top-level researchers in the world relevant to this domain. They will also have the opportunity to discuss their research work with them, as well as with other students.



  • Participants will learn how to implement approaches with exhaustive experimental methodology and apply appropriate benchmarking procedures to compare the actual practical results with reference to standard accepted procedures; how experimental results can be replicable and refutable on the one hand, and quantitatively comparable according to community-endorsed metrics, on the other hand. At the end, a student should be able to provide an educated response to the following questions:
    •  How research should be performed and reported in order to allow result replications.
    •  How should competitions be designed in order to maximize their contribution to robotics research and the industrial exploitation of results.
    •  To which extent and for measuring which functionalities and capabilities are benchmarks useful and possible.
    •  Which balance of result replication, benchmarking, challenges and competitions would allow a more objective evaluation of results and consequent objective assessment of the state of the art in the various subfields of theis domain of research


About the author:

Neural Rehabilitation Group, Cajal Institute
Spanish National Research Council (CSIC), Spain

Twitter LinkedIn Vimeo 

IEEE-RAS Summer School on Experimental Methodology, Performance Evaluation and Benchmarking in Robotics

Related Posts