In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic no...In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic nonlinear systems. The idea is to use an iterative adaptive dynamic programming(ADP) technique to construct the iterative control law which optimizes the iterative Q function. When the optimal Q function is obtained, the optimal control law can be achieved by directly minimizing the optimal Q function, where the mathematical model of the system is not necessary. Convergence property is analyzed to show that the iterative Q function is monotonically non-increasing and converges to the solution of the optimality equation. It is also proven that any of the iterative control laws is a stable control law. Neural networks are employed to implement the policy iteration based deterministic Q-learning algorithm, by approximating the iterative Q function and the iterative control law, respectively. Finally, two simulation examples are presented to illustrate the performance of the developed algorithm.展开更多
India’s energy crisis can be resolved by using reliable sources of renewable resources,such as solar energy with minimum adverse ecological effects.Several photovoltaic projects have been sanctioned based on rooftop ...India’s energy crisis can be resolved by using reliable sources of renewable resources,such as solar energy with minimum adverse ecological effects.Several photovoltaic projects have been sanctioned based on rooftop models and landbased solar parks to address energy security concerns.India’s strategy focusing on increasing the installation of new solar plants,lead to the vast expansion of the renewable energy market.This paper explores the Indian government policies,current approaches,significant achievements and a scenario for solar power in India.It also summaries various technological options,research,awareness and outreach activities for the deployment of solar energy.These supportive policies provide tax exemptions,attractive tariff plans,and economic incentives which contribute to the sustainable development of the nation.展开更多
基金supported in part by National Natural Science Foundation of China(Grant Nos.6137410561233001+1 种基金61273140)in part by Beijing Natural Science Foundation(Grant No.4132078)
文摘In this paper, a novel iterative Q-learning algorithm, called "policy iteration based deterministic Qlearning algorithm", is developed to solve the optimal control problems for discrete-time deterministic nonlinear systems. The idea is to use an iterative adaptive dynamic programming(ADP) technique to construct the iterative control law which optimizes the iterative Q function. When the optimal Q function is obtained, the optimal control law can be achieved by directly minimizing the optimal Q function, where the mathematical model of the system is not necessary. Convergence property is analyzed to show that the iterative Q function is monotonically non-increasing and converges to the solution of the optimality equation. It is also proven that any of the iterative control laws is a stable control law. Neural networks are employed to implement the policy iteration based deterministic Q-learning algorithm, by approximating the iterative Q function and the iterative control law, respectively. Finally, two simulation examples are presented to illustrate the performance of the developed algorithm.
文摘India’s energy crisis can be resolved by using reliable sources of renewable resources,such as solar energy with minimum adverse ecological effects.Several photovoltaic projects have been sanctioned based on rooftop models and landbased solar parks to address energy security concerns.India’s strategy focusing on increasing the installation of new solar plants,lead to the vast expansion of the renewable energy market.This paper explores the Indian government policies,current approaches,significant achievements and a scenario for solar power in India.It also summaries various technological options,research,awareness and outreach activities for the deployment of solar energy.These supportive policies provide tax exemptions,attractive tariff plans,and economic incentives which contribute to the sustainable development of the nation.
