Extended Reality System for Robotic Learning from Human Demonstration
The Robot Action Demonstration in Extended Reality (RADER) system is a generic extended reality interface for learning from demonstration.
Related Publications
Extended Reality System for Robotic Learning from Human Demonstration, Isaac Ngui, Courtney McBeth, Grace He, André Corrêa Santos, Luciano Soares, Marco Morales, Nancy M. Amato, ArXiv Preprint, Sep 2024. @misc{ngui2024extendedrealityroboticlearning, Many real-world tasks are intuitive for a human to perform, but difficult to encode algorithmically when utilizing a robot to perform the tasks. In these scenarios, robotic systems can benefit from expert demonstrations to learn how to perform each task. In many settings, it may be difficult or unsafe to use a physical robot to provide these demonstrations, for example, considering cooking tasks such as slicing with a knife. Extended reality provides a natural setting for demonstrating robotic trajectories while bypassing safety concerns and providing a broader range of interaction modalities. We propose the Robot Action Demonstration in Extended Reality (RADER) system, a generic extended reality interface for learning from demonstration. We additionally present its application to an existing state-of-the-art learning from demonstration approach and show comparable results between demonstrations given on a physical robot and those given using our extended reality system.
Keywords: Extended Reality, Learning from Demonstration, Robotics
Links : [ArXiv] BibTex
title={Extended Reality System for Robotic Learning from Human Demonstration},
author={Isaac Ngui and Courtney McBeth and Grace He and André Corrêa Santos and Luciano Soares and Marco Morales and Nancy M. Amato},
year={2024},
eprint={2409.12862},
archivePrefix={arXiv},
primaryClass={cs.RO},
url={https://arxiv.org/abs/2409.12862},
}Abstract