Skip to main navigation Skip to search Skip to main content

A Survey on Large Language Model-Powered Autonomous Driving

  • Yuxuan Zhu
  • , Shiyi Wang
  • , Wenqing Zhong
  • , Nianchen Shen
  • , Yunqi Li
  • , Siqi Wang
  • , Zhiheng Li
  • , Cathy Wu
  • , Zhengbing He*
  • , Li Li
  • *Corresponding author for this work

Research output: Journal PublicationReview articlepeer-review

Abstract

Artificial intelligence (AI) plays a crucial role in autonomous driving (AD), advancing its development toward greater intelligence and efficiency. In response to persistent challenges in current AD algorithms, many researchers believe that large language models (LLMs), with their powerful reasoning capabilities and extensive knowledge, may offer promising solutions, enabling AD systems to achieve deeper understanding and more informed decision-making. Both industry and academia have actively explored the application of LLMs in AD tasks, showing early signs of progress in addressing issues such as the long-tail problem. To examine whether and how LLMs can enhance AD, this paper provides a comprehensive analysis of their potential applications, including their optimization strategies in both modular and end-to-end approaches, with a particular focus on how LLMs can address existing problems and challenges in current solutions. Furthermore, we explore an important question: Can LLM-based artificial general intelligence (AGI) serve as a key for achieving high-level AD? We also analyze the potential limitations and challenges LLMs may face in advancing AD technology and extend the discussion to societal considerations, including critical safety and security concerns. This survey aims to provide a foundational reference for cross-disciplinary researchers and help guide future research directions.

Original languageEnglish
JournalEngineering
DOIs
Publication statusAccepted/In press - 2025
Externally publishedYes

Free Keywords

  • Artificial general intelligence
  • Autonomous driving
  • ChatGPT
  • End-to-end
  • Large language models

ASJC Scopus subject areas

  • Environmental Engineering
  • General Computer Science
  • Materials Science (miscellaneous)
  • General Chemical Engineering
  • Energy Engineering and Power Technology
  • General Engineering

Fingerprint

Dive into the research topics of 'A Survey on Large Language Model-Powered Autonomous Driving'. Together they form a unique fingerprint.

Cite this