Automatic Dataset Generation From CAD for Vision-Based Grasping

Tutkimustuotos: KonferenssiartikkeliScientificvertaisarvioitu

2 Lataukset (Pure)


Recent developments in robotics and deep learning enable the training of models for a wide variety of tasks, from large amounts of collected data. Visual and robotic tasks, such as pose estimation or grasping, are trained from image data (RGB-D) or point clouds that need to be representative for the actual objects, to acquire accurate and robust results. This implies either generalized object models or large datasets that include all object and environment variability, for training. However, data collection is often a bottleneck in the fast development of learning-based models. In fact, data collection might be impossible or even undesirable, as physical objects are unavailable or the physical recording of data is too time-consuming and expensive. For example, when building a data recording setup with cameras and robotic hardware. CAD tools, in combination with robot simulation, offer a solution for the generation of training data that can be easily automated and that can be just as realistic as real world data. In this work, we propose a data generation pipeline that takes as input a CAD model of an object and automatically generates the required training data for object pose estimation and object grasp detection. The object data generated are: RGB and depth image, object binary mask, class label and ground truth pose in camera- and world frame. We demonstrate the dataset generation of several sets of industrial object assemblies and evaluate the trained models on state of the art pose estimation and grasp detection approaches. Code and video are available at:
Otsikko2021 20th International Conference on Advanced Robotics (ICAR)
ISBN (elektroninen)978-1-6654-3684-7
ISBN (painettu)978-1-6654-3685-4
DOI - pysyväislinkit
TilaJulkaistu - 2021
OKM-julkaisutyyppiA4 Artikkeli konferenssijulkaisussa
TapahtumaInternational Conference on Advanced Robotics - Ljubljana, Slovenia
Kesto: 6 jouluk. 202110 jouluk. 2021


ConferenceInternational Conference on Advanced Robotics


  • Jufo-taso 1


Sukella tutkimusaiheisiin 'Automatic Dataset Generation From CAD for Vision-Based Grasping'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

Siteeraa tätä