Evaluating Human-Robot Skill Gaps in Electrical Circuit Inspection: A New Electronic Task Board for Benchmarking Manipulation
So, Peter Swikir, Abdalla Abu-Dakka, Fares J. Haddadin, Sami
So, Peter
Swikir, Abdalla
Abu-Dakka, Fares J.
Haddadin, Sami
Supervisor
Department
Robotics
Embargo End Date
Type
Conference proceeding
Date
2025
License
Language
English
Collections
Research Projects
Organizational Units
Journal Issue
Abstract
Robot manipulation researchers reference human performance as a goal for their work, however, human data is seldom present in robotics benchmarks. We introduce a real-world benchmark targeting manipulation skills for performing electrical circuit inspection with a multimeter using an Internet-connected electronic task board. We present timing study results and an exemplary robot solution across six different tasks from the Robothon Grand Challenge at the automatica conference in 2023. Contributions from 16 robot teams were collected using task boards we manufactured and distributed as part of the 30-day international competition as an initial performance database. Our work systematically highlights the skill gap between the winning robot solution and the best human performance from a group of 30 subjects. Our goal is to chronicle progress over time in robot manipulation skills and provide a standardized, physical benchmark across the global community. Videos of the team submissions, the exemplary robot solution, as well as the project reproduction code are provided in the included repository.
Citation
P. So, A. Swikir, F. J. Abu-Dakka and S. Haddadin, "Evaluating Human-Robot Skill Gaps in Electrical Circuit Inspection: A New Electronic Task Board for Benchmarking Manipulation," 2025 IEEE International Conference on Robotics and Automation (ICRA), Atlanta, GA, USA, 2025, pp. 15292-15298, doi: 10.1109/ICRA55743.2025.11128714.
Source
International Conference on Robotics and Automation (ICRA)
Conference
2025 IEEE International Conference on Robotics and Automation (ICRA)
Keywords
Power Cables, Electric Variables Measurement, Standardization, Benchmark Testing, Inspection, Timing, Wrapping, Robots, Videos, Videoconferences
Subjects
Source
2025 IEEE International Conference on Robotics and Automation (ICRA)
Publisher
IEEE