Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF¶
Arxiv Link - 2024-06-06 20:10:34
Abstract¶
Reinforcement Learning from Human Feedback (RLHF) is popular in large language models (LLMs), whereas traditional Reinforcement Learning (RL) often falls short. Current autonomous driving methods typically utilize either human feedback in machine learning, including RL, or LLMs. Most feedback guides the car agent's learning process (e.g., controlling the car). RLHF is usually applied in the fine-tuning step, requiring direct human "preferences," which are not commonly used in optimizing autonomous driving models. In this research, we innovatively combine RLHF and LLMs to enhance autonomous driving safety. Training a model with human guidance from scratch is inefficient. Our framework starts with a pre-trained autonomous car agent model and implements multiple human-controlled agents, such as cars and pedestrians, to simulate real-life road environments. The autonomous car model is not directly controlled by humans. We integrate both physical and physiological feedback to fine-tune the model, optimizing this process using LLMs. This multi-agent interactive environment ensures safe, realistic interactions before real-world application. Finally, we will validate our model using data gathered from real-life testbeds located in New Jersey and New York City.
Socials¶
| X | |
|---|---|
| 🚗 Exciting news in autonomous driving tech! 🚗 Interested in the latest research on enhancing autonomous driving safety using Reinforcement Learning from Human Feedback (RLHF) and Large Language Models (LLMs)? Check out this innovative approach that combines RLHF and LLMs to optimize autonomous driving models. Want to learn more about this cutting-edge research and how it can revolutionize autonomous driving technology? Dive into the details here: http://arxiv.org/abs/2406.04481v1 #AutonomousDriving #RLHF #LLMs #Innovation #AI #TechResearch |
🚗🤖 Exciting research combining Reinforcement Learning from Human Feedback (RLHF) and Large Language Models (LLMs) to enhance autonomous driving safety! Learn how this innovative approach optimizes the learning process and ensures realistic interactions: http://arxiv.org/abs/2406.04481v1 #AI #RLHF #LLMs #AutonomousDriving 🛣️🔬 |