Download PDFOpen PDF in browser

Teaching Robot End Effectors to Grasp Construction Tools Based on Deep Reinforcement Learning

13 pagesPublished: August 28, 2025

Abstract

In onsite construction, however, there are numerous delicate tasks that require skilled workers to perform. A key challenge in automating these tasks is developing motor skills in robots trained through RL, as manipulating irregular and delicate objects like hammers, scaffolding, and drills remains difficult. To address this issue, this paper proposes an RL-based approach for performing delicate tasks using a robotic arm with grippers. We present a simulation-based policy learning framework utilizing the Critic-Actor algorithm in Pybullet to control the robotic arm. In experimental trials, the learned policy was used to grasp six different types of construction tools, and the results demonstrated the feasibility of training with randomly shaped objects to manipulate the construction tools with a reasonable success rate. This method provides a foundation for enhancing the manipulative skills of construction robots, potentially reducing labor costs in the industry.

Keyphrases: construction robot, construction tools, grasping, reinforcement learning

In: Jack Cheng and Yu Yantao (editors). Proceedings of The Sixth International Conference on Civil and Building Engineering Informatics, vol 22, pages 486-498.

BibTeX entry
@inproceedings{ICCBEI2025:Teaching_Robot_End_Effectors,
  author    = {Xiaohu Yu and Yantao Yu and Zaolin Pan},
  title     = {Teaching Robot End Effectors to Grasp Construction Tools Based on Deep Reinforcement Learning},
  booktitle = {Proceedings of The Sixth International Conference on Civil and Building Engineering Informatics},
  editor    = {Jack Cheng and Yu Yantao},
  series    = {Kalpa Publications in Computing},
  volume    = {22},
  publisher = {EasyChair},
  bibsource = {EasyChair, https://easychair.org},
  issn      = {2515-1762},
  url       = {/publications/paper/2D1b},
  doi       = {10.29007/ft8h},
  pages     = {486-498},
  year      = {2025}}
Download PDFOpen PDF in browser