Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles PDF

Author: Yeuching Li

Publisher: Morgan & Claypool Publishers

Published: 2022-02-14

Total Pages: 135

ISBN-13: 1636393020

DOWNLOAD EBOOK →

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles PDF

Author: Teng Liu

Publisher: Morgan & Claypool Publishers

Published: 2019-09-03

Total Pages: 99

ISBN-13: 1681736195

DOWNLOAD EBOOK →

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Hybrid Electric Vehicles

Hybrid Electric Vehicles PDF

Author: Simona Onori

Publisher: Springer

Published: 2015-12-16

Total Pages: 112

ISBN-13: 1447167813

DOWNLOAD EBOOK →

This SpringerBrief deals with the control and optimization problem in hybrid electric vehicles. Given that there are two (or more) energy sources (i.e., battery and fuel) in hybrid vehicles, it shows the reader how to implement an energy-management strategy that decides how much of the vehicle’s power is provided by each source instant by instant. Hybrid Electric Vehicles: •introduces methods for modeling energy flow in hybrid electric vehicles; •presents a standard mathematical formulation of the optimal control problem; •discusses different optimization and control strategies for energy management, integrating the most recent research results; and •carries out an overall comparison of the different control strategies presented. Chapter by chapter, a case study is thoroughly developed, providing illustrative numerical examples that show the basic principles applied to real-world situations. The brief is intended as a straightforward tool for learning quickly about state-of-the-art energy-management strategies. It is particularly well-suited to the needs of graduate students and engineers already familiar with the basics of hybrid vehicles but who wish to learn more about their control strategies.

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles

Reinforcement Learning-Enabled Intelligent Energy Management for Hybrid Electric Vehicles PDF

Author: Teng Liu

Publisher: Synthesis Lectures on Advances

Published: 2019-09-03

Total Pages: 99

ISBN-13: 9781681736204

DOWNLOAD EBOOK →

Powertrain electrification, fuel decarburization, and energy diversification are techniques that are spreading all over the world, leading to cleaner and more efficient vehicles. Hybrid electric vehicles (HEVs) are considered a promising technology today to address growing air pollution and energy deprivation. To realize these gains and still maintain good performance, it is critical for HEVs to have sophisticated energy management systems. Supervised by such a system, HEVs could operate in different modes, such as full electric mode and power split mode. Hence, researching and constructing advanced energy management strategies (EMSs) is important for HEVs performance. There are a few books about rule- and optimization-based approaches for formulating energy management systems. Most of them concern traditional techniques and their efforts focus on searching for optimal control policies offline. There is still much room to introduce learning-enabled energy management systems founded in artificial intelligence and their real-time evaluation and application. In this book, a series hybrid electric vehicle was considered as the powertrain model, to describe and analyze a reinforcement learning (RL)-enabled intelligent energy management system. The proposed system can not only integrate predictive road information but also achieve online learning and updating. Detailed powertrain modeling, predictive algorithms, and online updating technology are involved, and evaluation and verification of the presented energy management system is conducted and executed.

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles

Deep Reinforcement Learning-based Energy Management for Hybrid Electric Vehicles PDF

Author: Li Yeuching

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 123

ISBN-13: 3031792068

DOWNLOAD EBOOK →

The urgent need for vehicle electrification and improvement in fuel efficiency has gained increasing attention worldwide. Regarding this concern, the solution of hybrid vehicle systems has proven its value from academic research and industry applications, where energy management plays a key role in taking full advantage of hybrid electric vehicles (HEVs). There are many well-established energy management approaches, ranging from rules-based strategies to optimization-based methods, that can provide diverse options to achieve higher fuel economy performance. However, the research scope for energy management is still expanding with the development of intelligent transportation systems and the improvement in onboard sensing and computing resources. Owing to the boom in machine learning, especially deep learning and deep reinforcement learning (DRL), research on learning-based energy management strategies (EMSs) is gradually gaining more momentum. They have shown great promise in not only being capable of dealing with big data, but also in generalizing previously learned rules to new scenarios without complex manually tunning. Focusing on learning-based energy management with DRL as the core, this book begins with an introduction to the background of DRL in HEV energy management. The strengths and limitations of typical DRL-based EMSs are identified according to the types of state space and action space in energy management. Accordingly, value-based, policy gradient-based, and hybrid action space-oriented energy management methods via DRL are discussed, respectively. Finally, a general online integration scheme for DRL-based EMS is described to bridge the gap between strategy learning in the simulator and strategy deployment on the vehicle controller.

Proceedings of China SAE Congress 2020: Selected Papers

Proceedings of China SAE Congress 2020: Selected Papers PDF

Author: China Society of Automotive Engineers

Publisher: Springer Nature

Published: 2022-01-13

Total Pages: 1670

ISBN-13: 9811620903

DOWNLOAD EBOOK →

These proceedings gather outstanding papers presented at the China SAE Congress 2020, held on Oct. 27-29, Shanghai, China. Featuring contributions mainly from China, the biggest carmaker as well as most dynamic car market in the world, the book covers a wide range of automotive-related topics and the latest technical advances in the industry. Many of the approaches in the book will help technicians to solve practical problems that affect their daily work. In addition, the book offers valuable technical support to engineers, researchers and postgraduate students in the field of automotive engineering.

Application of Artificial Intelligence in Hybrid Electric Vehicle Energy Management

Application of Artificial Intelligence in Hybrid Electric Vehicle Energy Management PDF

Author: Jili Tao

Publisher: Elsevier

Published: 2024-06-07

Total Pages: 348

ISBN-13: 0443131902

DOWNLOAD EBOOK →

Application of Artificial Intelligence in Hybrid Electric Vehicle Energy Management presents the state-of-the-art in hybrid electric vehicle system modelling and management. With a focus on learning-based energy management strategies, the book provides detailed methods, mathematical models, and strategies designed to optimize the energy management of the energy supply module of a hybrid vehicle.The book first addresses the underlying problems in Hybrid Electric Vehicle (HEV) modeling, and then introduces several artificial intelligence-based energy management strategies of HEV systems, including those based on fuzzy control with driving pattern recognition, multi objective optimization, fuzzy Q-learning and Deep Deterministic Policy Gradient (DDPG) algorithms. To help readers apply these management strategies, the book also introduces State of Charge and State of Health prediction methods and real time driving pattern recognition. For each application, the detailed experimental process, program code, experimental results, and algorithm performance evaluation are provided.Application of Artificial Intelligence in Hybrid Electric Vehicle Energy Management is a valuable reference for anyone involved in the modelling and management of hybrid electric vehicles, and will be of interest to graduate students, researchers, and professionals working on HEVs in the fields of energy, electrical, and automotive engineering. Provides a guide to the modeling and simulation methods of hybrid electric vehicle energy systems, including fuel cell systems Describes the fundamental concepts and theory behind CNN, MPC, fuzzy control, multi objective optimization, fuzzy Q-learning and DDPG Explains how to use energy management methods such as parameter estimation, Q-learning, and pattern recognition, including battery State of Health and State of Charge prediction, and vehicle operating conditions

Deep Reinforcement Learning

Deep Reinforcement Learning PDF

Author: Hao Dong

Publisher: Springer Nature

Published: 2020-06-29

Total Pages: 526

ISBN-13: 9811540950

DOWNLOAD EBOOK →

Deep reinforcement learning (DRL) is the combination of reinforcement learning (RL) and deep learning. It has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine, and famously contributed to the success of AlphaGo. Furthermore, it opens up numerous new applications in domains such as healthcare, robotics, smart grids and finance. Divided into three main parts, this book provides a comprehensive and self-contained introduction to DRL. The first part introduces the foundations of deep learning, reinforcement learning (RL) and widely used deep RL methods and discusses their implementation. The second part covers selected DRL research topics, which are useful for those wanting to specialize in DRL research. To help readers gain a deep understanding of DRL and quickly apply the techniques in practice, the third part presents mass applications, such as the intelligent transportation system and learning to run, with detailed explanations. The book is intended for computer science students, both undergraduate and postgraduate, who would like to learn DRL from scratch, practice its implementation, and explore the research topics. It also appeals to engineers and practitioners who do not have strong machine learning background, but want to quickly understand how DRL works and use the techniques in their applications.

Proceedings of the 4th International Conference on Electrical and Information Technologies for Rail Transportation (EITRT) 2019

Proceedings of the 4th International Conference on Electrical and Information Technologies for Rail Transportation (EITRT) 2019 PDF

Author: Limin Jia

Publisher: Springer Nature

Published: 2020-04-07

Total Pages: 869

ISBN-13: 9811528624

DOWNLOAD EBOOK →

This book reflects the latest research trends, methods and experimental results in the field of electrical and information technologies for rail transportation, which covers abundant state-of-the-art research theories and ideas. As a vital field of research that is highly relevant to current developments in a number of technological domains, the subjects it covered include intelligent computing, information processing, Communication Technology, Automatic Control, etc. The objective of the proceedings is to provide a major interdisciplinary forum for researchers, engineers, academicians as well as industrial professionals to present the most innovative research and development in the field of rail transportation electrical and information technologies. Engineers and researchers in academia, industry, and the government will also explore an insight view of the solutions that combine ideas from multiple disciplines in this field. The volumes serve as an excellent reference work for researchers and graduate students working on rail transportation, electrical and information technologies.

Advances in Theoretical and Computational Energy Optimization Processes

Advances in Theoretical and Computational Energy Optimization Processes PDF

Author: Ferdinando Salata

Publisher: MDPI

Published: 2020-12-29

Total Pages: 422

ISBN-13: 3039366386

DOWNLOAD EBOOK →

The paradigm in the design of all human activity that requires energy for its development must change from the past. We must change the processes of product manufacturing and functional services. This is necessary in order to mitigate the ecological footprint of man on the Earth, which cannot be considered as a resource with infinite capacities. To do this, every single process must be analyzed and modified, with the aim of decarbonising each production sector. This collection of articles has been assembled to provide ideas and new broad-spectrum contributions for these purposes.