The lack of performance assessment procedures is a prominent problem in robotic manipulation preventing researchers to compare their results against a common basis. In this workshop, well- developed and experimentally-demonstrated benchmarking protocols will be presented for various manipulation problems including robotic grasping, dexterous manipulation, aerial manipulation, non-prehensile manipulation, end-effector design among many others. The benchmarks explain step-by-step execution of the experimental procedure along with performance evaluation metrics, and baseline results obtained by state-of-the-art methods. These benchmarks are composed via close collaboration of experts in the related sub-fields. The experiences gained in the development process will also be discussed in panels for providing guidelines and inspiration for upcoming benchmarks in robotics.

Please email to bcalli@wpi.edu for any questions or comments.