Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach

Hanbin Luo, Jianxin Wu, Jiajing Liu*, Maxwell Fordjour Antwi-Afari

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques? This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.

Original languageEnglish
Article number100488
Number of pages18
JournalDevelopments in the Built Environment
Volume19
Early online date20 Jun 2024
DOIs
Publication statusPublished - 1 Oct 2024

Bibliographical note

© 2024 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Keywords

  • ChatGPT
  • Code generation
  • Construction assembly robot
  • Human–robot collaboration
  • Large language model

Fingerprint

Dive into the research topics of 'Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach'. Together they form a unique fingerprint.

Cite this