Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach

Hanbin Luo, Jianxin Wu, Jiajing Liu*, Maxwell Fordjour Antwi-Afari

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

20 Citations (SciVal)
6 Downloads (Pure)

Abstract

Offline programming (OLP) is a mainstream approach for controlling assembly robots at construction sites. However, existing methods are tailored to specific assembly tasks and workflows, and thus lack flexibility. Additionally, the emerging large language model (LLM)-based OLP cannot effectively handle the code logic of robot programming. Thus, this paper addresses the question: How can robot control programs be generated effectively and accurately for diverse construction assembly tasks using LLM techniques? This paper describes a closed user-on-the-loop control framework for construction assembly robots based on LLM techniques. A hierarchical strategy to generate robot control programs is proposed to logically integrate code generation at high and low levels. Additionally, customized application programming interfaces and a chain of action are combined to enhance the LLM's understanding of assembly action logic. An assembly task set was designed to evaluate the feasibility and reliability of the proposed approach. The results show that the proposed approach (1) is widely applicable to diverse assembly tasks, and (2) can improve the quality of the generated code by decreasing the number of errors. Our approach facilitates the automation of construction assembly tasks by simplifying the robot control process.

Original languageEnglish
Article number100488
Number of pages18
JournalDevelopments in the Built Environment
Volume19
Early online date20 Jun 2024
DOIs
Publication statusPublished - 1 Oct 2024

Bibliographical note

© 2024 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

Funding

The authors acknowledge the financial support of the National Key R&D Program of China (No. 2023YFC3806605), the National Natural Science Foundation of China (Grant Nos. 72301114 and U21A20151) and China Postdoctoral Science Foundation (Grant No. 2023M731187) toward conducting the research presented in this paper. Access to the code used in this study will be made available upon request from the corresponding author.

FundersFunder number
National Key Research and Development Program of China2023YFC3806605
National Key Research and Development Program of China
National Natural Science Foundation of China72301114, U21A20151
National Natural Science Foundation of China
China Postdoctoral Science Foundation2023M731187
China Postdoctoral Science Foundation

    Keywords

    • ChatGPT
    • Code generation
    • Construction assembly robot
    • Human–robot collaboration
    • Large language model

    Fingerprint

    Dive into the research topics of 'Large language model-based code generation for the control of construction assembly robots: A hierarchical generation approach'. Together they form a unique fingerprint.

    Cite this