GitHub
ICRA 2025

HBTP: Heuristic Behavior Tree Planning with Large Language Model Reasoning

Yishuai Cai, Xinglin Chen, Yunxin Mao, Minglong Li, Shaowu Yang, Wenjing Yang, Ji Wang

College of Computer Science and Technology · National University of Defense Technology

Corresponding author

ICRA 2025 Presentation

Video Overview

Abstract

Heuristic Behavior Tree Planning with LLM Reasoning

Behavior Trees (BTs) are increasingly becoming a popular control structure in robotics due to their modularity, reactivity, and robustness. In terms of BT generation methods, BT planning shows promise for generating reliable BTs. However, the scalability of BT planning is often constrained by prolonged planning times in complex scenarios, largely due to a lack of domain knowledge. In contrast, pre-trained Large Language Models (LLMs) have demonstrated task reasoning capabilities across various domains, though the correctness and safety of their planning remain uncertain.

This paper proposes integrating BT planning with LLM reasoning, introducing Heuristic Behavior Tree Planning (HBTP) — a reliable and efficient framework for BT generation. The key idea in HBTP is to leverage LLMs for task-specific reasoning to generate a heuristic path, which BT planning can then follow to expand efficiently. We first introduce the heuristic BT expansion process, along with two heuristic variants designed for optimal planning and satisficing planning, respectively. Then, we propose methods to address the inaccuracies of LLM reasoning, including action space pruning and reflective feedback, to further enhance both reasoning accuracy and planning efficiency. Experiments demonstrate the theoretical bounds of HBTP, and results from four datasets confirm its practical effectiveness in everyday service robot applications.

Framework

An overview of HBTP

HBTP framework overview.
(1) Before HBTP, a heuristic path reasoned by the LLM constructs a heuristic action indicator. During HBTP, condition nodes in the BT are ranked and expanded based on their heuristic values until the initial state is reached. (2) For LLM reasoning, scene and task are input to the LLM, which outputs task-relevant predicates and objects to prune the action space; if planning fails or times out, BT summaries refine the heuristics. (3) After HBTP, the produced BT is implemented on the robot to perform the task reactively and robustly.
Real-world deployment

RoboWaiter

Three difficulty tiers — from a single goal to compositional logical objectives.

Easy Level

IsClean(Table1) On(Yogurt, Table1)

Relevant Predicates
Clean, PickUp, PutDown, Walk
Relevant Objects
Table1, Yogurt
Heuristic Path
Walk(Yogurt) → PickUp(Yogurt) → Walk(Table1) → PutDown(Yogurt) → Walk(Table1) → Clean(Table1)
Planned Behavior Tree
Planned BT for the easy level.
Citation

BibTeX

@article{cai2024hbtp,
  title   = {HBTP: Heuristic Behavior Tree Planning
             with Large Language Model Reasoning},
  author  = {Yishuai Cai and Xinglin Chen and Yunxin Mao and
             Minglong Li and Shaowu Yang and Wenjing Yang and Ji Wang},
  year    = {2024},
  url     = {https://arxiv.org/abs/2406.00965},
  journal = {arXiv preprint arXiv:2406.00965},
}