Reinforcement Learning Enabled Intelligent Energy Management For Hybrid Electric Vehicles

Author : Teng Liu
Publisher : Morgan & Claypool Publishers
Page : 99 pages
File Size : 50,6 Mb
Release : 2019-09-03
Category : Technology & Engineering
ISBN : 9781681736198

Get Book

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles by Teng Liu Pdf

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Author : Teng Liu
Publisher : Synthesis Lectures on Advances
Page : 99 pages
File Size : 44,8 Mb
Release : 2019-09-03
Category : Computers
ISBN : 1681736187

Get Book

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles by Teng Liu Pdf

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Author : Li Yeuching,He Hongwen
Publisher : Springer Nature
Page : 123 pages
File Size : 54,8 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031792069

Get Book

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles by Li Yeuching,He Hongwen Pdf

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Author : Teng Liu
Publisher : Springer Nature
Page : 90 pages
File Size : 48,7 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031015038

Get Book

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles by Teng Liu Pdf

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Author : Yeuching Li,Hongwen He
Publisher : Morgan & Claypool Publishers
Page : 135 pages
File Size : 48,8 Mb
Release : 2022-02-14
Category : Computers
ISBN : 9781636393025

Get Book

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles by Yeuching Li,Hongwen He Pdf

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Author : Clara Marina Martinez,Dongpu Cao
Publisher : Butterworth-Heinemann
Page : 431 pages
File Size : 52,7 Mb
Release : 2018-09-11
Category : Technology & Engineering
ISBN : 9780128150115

Get Book

iHorizon-Enabled Energy Management for Electrified Vehicles by Clara Marina Martinez,Dongpu Cao Pdf

iHorizon-Enabled Energy Management for Electrified Vehicles proposes a realistic solution that assumes only scarce information is available prior to the start of a journey and that limited computational capability can be allocated for energy management. This type of framework exploits the available resources and closely emulates optimal results that are generated with an offline global optimal algorithm. In addition, the authors consider the present and future of the automotive industry and the move towards increasing levels of automation. Driver vehicle-infrastructure is integrated to address the high level of interdependence of hybrid powertrains and to comply with connected vehicle infrastructure. This book targets upper-division undergraduate students and graduate students interested in control applied to the automotive sector, including electrified powertrains, ADAS features, and vehicle automation. Addresses the level of integration of electrified powertrains Presents the state-of-the-art of electrified vehicle energy control Offers a novel concept able to perform dynamic speed profile and energy demand prediction

Author : Arunesh Kumar Singh,Bhavnesh Kumar,Ibraheem,Asheesh Kumar Singh,Shahida Khatoon
Publisher : CRC Press
Page : 203 pages
File Size : 40,6 Mb
Release : 2023-10-16
Category : Technology & Engineering
ISBN : 9781000963465

Get Book

Intelligent Control for Modern Transportation Systems by Arunesh Kumar Singh,Bhavnesh Kumar,Ibraheem,Asheesh Kumar Singh,Shahida Khatoon Pdf

The book comprehensively discusses concepts of artificial intelligence in green transportation systems. It further covers intelligent techniques for precise modeling of complex transportation infrastructure, forecasting and predicting traffic congestion, and intelligent control techniques for maximizing performance and safety. It further provides MATLAB® programs for artificial intelligence techniques. It discusses artificial intelligence-based approaches and technologies in controlling and operating solar photovoltaic systems to generate power for electric vehicles. Highlights how different technological advancements have revolutionized the transportation system. Presents core concepts and principles of soft computing techniques in the control and management of modern transportation systems. Discusses important topics such as speed control, fuel control challenges, transport infrastructure modeling, and safety analysis. Showcases MATLAB® programs for artificial intelligence techniques. Discusses roles, implementation, and approaches of different intelligent techniques in the field of transportation systems. It will serve as an ideal text for professionals, graduate students, and academicians in the fields of electrical engineering, electronics and communication engineering, civil engineering, and computer engineering.

Author : Simona Onori,Lorenzo Serrao,Giorgio Rizzoni
Publisher : Springer
Page : 112 pages
File Size : 54,5 Mb
Release : 2015-12-16
Category : Technology & Engineering
ISBN : 9781447167815

Get Book

Hybrid Electric Vehicles by Simona Onori,Lorenzo Serrao,Giorgio Rizzoni Pdf

This SpringerBrief deals with the control and optimization problem in hybrid electric vehicles. Given that there are two (or more) energy sources (i.e., battery and fuel) in hybrid vehicles, it shows the reader how to implement an energy-management strategy that decides how much of the vehicle’s power is provided by each source instant by instant. Hybrid Electric Vehicles: •introduces methods for modeling energy flow in hybrid electric vehicles; •presents a standard mathematical formulation of the optimal control problem; •discusses different optimization and control strategies for energy management, integrating the most recent research results; and •carries out an overall comparison of the different control strategies presented. Chapter by chapter, a case study is thoroughly developed, providing illustrative numerical examples that show the basic principles applied to real-world situations. The brief is intended as a straightforward tool for learning quickly about state-of-the-art energy-management strategies. It is particularly well-suited to the needs of graduate students and engineers already familiar with the basics of hybrid vehicles but who wish to learn more about their control strategies.

Author : Rashad Mustafa
Publisher : Unknown
Page : 151 pages
File Size : 54,7 Mb
Release : 2014
Category : Electronic
ISBN : 3844033408

Get Book

Intelligent Energy Management for a Parallel Hybrid Electric Vehicle in Customer Use by Rashad Mustafa Pdf

Author : Shuvra Das
Publisher : Springer Nature
Page : 208 pages
File Size : 49,9 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031015083

Get Book

Modeling for Hybrid and Electric Vehicles Using Simscape by Shuvra Das Pdf

Automobiles have played an important role in the shaping of the human civilization for over a century and continue to play a crucial role today. The design, construction, and performance of automobiles have evolved over the years. For many years, there has been a strong shift toward electrification of automobiles. It started with the by-wire systems where more efficient electro-mechanical subsystems started replacing purely mechanical devices, e.g., anti-lock brakes, drive-by-wire, and cruise control. Over the last decade, driven by a strong push for fuel efficiency, pollution reduction, and environmental stewardship, electric and hybrid electric vehicles have become quite popular. In fact, almost all the automobile manufacturers have adopted strategies and launched vehicle models that are electric and/or hybrid. With this shift in technology, employers have growing needs for new talent in areas such as energy storage and battery technology, power electronics, electric motor drives, embedded control systems, and integration of multi-disciplinary systems. To support these needs, universities are adjusting their programs to train students in these new areas of expertise. For electric and hybrid technology to deliver superior performance and efficiency, all sub-systems have to work seamlessly and in unison every time and all the time. To ensure this level of precision and reliability, modeling and simulation play crucial roles during the design and development cycle of electric and hybrid vehicles. Simscape, a Matlab/Simulink toolbox for modeling physical systems, is an ideally suited platform for developing and deploying models for systems and sub-systems that are critical for hybrid and electric vehicles. This text will focus on guiding the reader in the development of models for all critical areas of hybrid and electric vehicles. There are numerous texts on electric and hybrid vehicles in the market right now. A majority of these texts focus on the relevant technology and the physics and engineering of their operation. In contrast, this text focuses on the application of some of the theories in developing models of physical systems that are at the core of hybrid and electric vehicles. Simscape is the tool of choice for the development of these models. Relevant background and appropriate theory are referenced and summarized in the context of model development with significantly more emphasis on the model development procedure and obtaining usable and accurate results.

Author : Haotian Cao,Mingjun Li,Song Zhao,Xiaolin Song
Publisher : Springer Nature
Page : 128 pages
File Size : 43,6 Mb
Release : 2022-05-31
Category : Technology & Engineering
ISBN : 9783031015069

Get Book

Decision Making, Planning, and Control Strategies for Intelligent Vehicles by Haotian Cao,Mingjun Li,Song Zhao,Xiaolin Song Pdf

The intelligent vehicle will play a crucial and essential role in the development of the future intelligent transportation system, which is developing toward the connected driving environment, ultimate driving safety, and comforts, as well as green efficiency. While the decision making, planning, and control are extremely vital components of the intelligent vehicle, these modules act as a bridge, connecting the subsystem of the environmental perception and the bottom-level control execution of the vehicle as well. This short book covers various strategies of designing the decision making, trajectory planning, and tracking control, as well as share driving, of the human-automation to adapt to different levels of the automated driving system. More specifically, we introduce an end-to-end decision-making module based on the deep Q-learning, and improved path-planning methods based on artificial potentials and elastic bands which are designed for obstacle avoidance. Then, the optimal method based on the convex optimization and the natural cubic spline is presented. As for the speed planning, planning methods based on the multi-object optimization and high-order polynomials, and a method with convex optimization and natural cubic splines, are proposed for the non-vehicle-following scenario (e.g., free driving, lane change, obstacle avoidance), while the planning method based on vehicle-following kinematics and the model predictive control (MPC) is adopted for the car-following scenario. We introduce two robust tracking methods for the trajectory following. The first one, based on nonlinear vehicle longitudinal or path-preview dynamic systems, utilizes the adaptive sliding mode control (SMC) law which can compensate for uncertainties to follow the speed or path profiles. The second one is based on the five-degrees-of-freedom nonlinear vehicle dynamical system that utilizes the linearized time-varying MPC to track the speed and path profile simultaneously. Toward human-automation cooperative driving systems, we introduce two control strategies to address the control authority and conflict management problems between the human driver and the automated driving systems. Driving safety field and game theory are utilized to propose a game-based strategy, which is used to deal with path conflicts during obstacle avoidance. Driver's driving intention, situation assessment, and performance index are employed for the development of the fuzzy-based strategy. Multiple case studies and demos are included in each chapter to show the effectiveness of the proposed approach. We sincerely hope the contents of this short book provide certain theoretical guidance and technical supports for the development of intelligent vehicle technology.

Author : Xiaolin Song,Haotian Cao
Publisher : Springer Nature
Page : 160 pages
File Size : 49,7 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031015090

Get Book

Behavior Analysis and Modeling of Traffic Participants by Xiaolin Song,Haotian Cao Pdf

A road traffic participant is a person who directly participates in road traffic, such as vehicle drivers, passengers, pedestrians, or cyclists, however, traffic accidents cause numerous property losses, bodily injuries, and even deaths to them. To bring down the rate of traffic fatalities, the development of the intelligent vehicle is a much-valued technology nowadays. It is of great significance to the decision making and planning of a vehicle if the pedestrians' intentions and future trajectories, as well as those of surrounding vehicles, could be predicted, all in an effort to increase driving safety. Based on the image sequence collected by onboard monocular cameras, we use the Long Short-Term Memory (LSTM) based network with an enhanced attention mechanism to realize the intention and trajectory prediction of pedestrians and surrounding vehicles. However, although the fully automatic driving era still seems far away, human drivers are still a crucial part of the road‒driver‒vehicle system under current circumstances, even dealing with low levels of automatic driving vehicles. Considering that more than 90 percent of fatal traffic accidents were caused by human errors, thus it is meaningful to recognize the secondary task while driving, as well as the driving style recognition, to develop a more personalized advanced driver assistance system (ADAS) or intelligent vehicle. We use the graph convolutional networks for spatial feature reasoning and the LSTM networks with the attention mechanism for temporal motion feature learning within the image sequence to realize the driving secondary-task recognition. Moreover, aggressive drivers are more likely to be involved in traffic accidents, and the driving risk level of drivers could be affected by many potential factors, such as demographics and personality traits. Thus, we will focus on the driving style classification for the longitudinal car-following scenario. Also, based on the Structural Equation Model (SEM) and Strategic Highway Research Program 2 (SHRP 2) naturalistic driving database, the relationships among drivers' demographic characteristics, sensation seeking, risk perception, and risky driving behaviors are fully discussed. Results and conclusions from this short book are expected to offer potential guidance and benefits for promoting the development of intelligent vehicle technology and driving safety.

Author : Ayse Buke Hiziroglu
Publisher : Springer Nature
Page : 52 pages
File Size : 48,8 Mb
Release : 2022-05-31
Category : Technology & Engineering
ISBN : 9783031015052

Get Book

Autonomous Vehicles and the Law by Ayse Buke Hiziroglu Pdf

Disciplines can no longer be isolated. Technology has rapidly evolved to the point that driverless vehicles have truly become a reality and are not something out of a futuristic exhibition from the 1950s. However, engineers and researchers working on the development of autonomous vehicles cannot ignore the policy implications and policymakers as well as attorneys cannot ignore the technology. We are at a point where cross-disciplinary collaboration is vital in order to produce a technology that will immensely benefit society. This is the goal of this book: to educate autonomous vehicle developers on legal theory at the most basic level. Both policymakers and lawyers may also find the book helpful in gaining a basic understanding of the technology the developers are working on.

Author : Jie Ji,Hong Wang,Yue Ren
Publisher : Springer Nature
Page : 144 pages
File Size : 46,8 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031015076

Get Book

Path Planning and Tracking for Vehicle Collision Avoidance in Lateral and Longitudinal Motion Directions by Jie Ji,Hong Wang,Yue Ren Pdf

In recent years, the control of Connected and Automated Vehicles (CAVs) has attracted strong attention for various automotive applications. One of the important features demanded of CAVs is collision avoidance, whether it is a stationary or a moving obstacle. Due to complex traffic conditions and various vehicle dynamics, the collision avoidance system should ensure that the vehicle can avoid collision with other vehicles or obstacles in longitudinal and lateral directions simultaneously. The longitudinal collision avoidance controller can avoid or mitigate vehicle collision accidents effectively via Forward Collision Warning (FCW), Brake Assist System (BAS), and Autonomous Emergency Braking (AEB), which has been commercially applied in many new vehicles launched by automobile enterprises. But in lateral motion direction, it is necessary to determine a flexible collision avoidance path in real time in case of detecting any obstacle. Then, a path-tracking algorithm is designed to assure that the vehicle will follow the predetermined path precisely, while guaranteeing certain comfort and vehicle stability over a wide range of velocities. In recent years, the rapid development of sensor, control, and communication technology has brought both possibilities and challenges to the improvement of vehicle collision avoidance capability, so collision avoidance system still needs to be further studied based on the emerging technologies. In this book, we provide a comprehensive overview of the current collision avoidance strategies for traditional vehicles and CAVs. First, the book introduces some emergency path planning methods that can be applied in global route design and local path generation situations which are the most common scenarios in driving. A comparison is made in the path-planning problem in both timing and performance between the conventional algorithms and emergency methods. In addition, this book introduces and designs an up-to-date path-planning method based on artificial potential field methods for collision avoidance, and verifies the effectiveness of this method in complex road environment. Next, in order to accurately track the predetermined path for collision avoidance, traditional control methods, humanlike control strategies, and intelligent approaches are discussed to solve the path-tracking problem and ensure the vehicle successfully avoids the collisions. In addition, this book designs and applies robust control to solve the path-tracking problem and verify its tracking effect in different scenarios. Finally, this book introduces the basic principles and test methods of AEB system for collision avoidance of a single vehicle. Meanwhile, by taking advantage of data sharing between vehicles based on V2X (vehicle-to-vehicle or vehicle-to-infrastructure) communication, pile-up accidents in longitudinal direction are effectively avoided through cooperative motion control of multiple vehicles.

Author : Chen Lv,Yang Xing,Junzhi Zhang,Dongpu Cao
Publisher : Springer Nature
Page : 78 pages
File Size : 50,7 Mb
Release : 2022-06-01
Category : Technology & Engineering
ISBN : 9783031015045

Get Book

Cyber-Physical Vehicle Systems by Chen Lv,Yang Xing,Junzhi Zhang,Dongpu Cao Pdf

This book studies the design optimization, state estimation, and advanced control methods for cyber-physical vehicle systems (CPVS) and their applications in real-world automotive systems. First, in Chapter 1, key challenges and state-of-the-art of vehicle design and control in the context of cyber-physical systems are introduced. In Chapter 2, a cyber-physical system (CPS) based framework is proposed for high-level co-design optimization of the plant and controller parameters for CPVS, in view of vehicle's dynamic performance, drivability, and energy along with different driving styles. System description, requirements, constraints, optimization objectives, and methodology are investigated. In Chapter 3, an Artificial-Neural-Network-based estimation method is studied for accurate state estimation of CPVS. In Chapter 4, a high-precision controller is designed for a safety-critical CPVS. The detailed control synthesis and experimental validation are presented. The application results presented throughout the book validate the feasibility and effectiveness of the proposed theoretical methods of design, estimation, control, and optimization for cyber-physical vehicle systems.