The adaptive critic heuristic has been a popular algorithm in reinforcement learning(RL) and approximate dynamic programming(ADP) alike.It is one of the ?rst RL and ADP algorithms.RL and ADP algorithms are particularl...The adaptive critic heuristic has been a popular algorithm in reinforcement learning(RL) and approximate dynamic programming(ADP) alike.It is one of the ?rst RL and ADP algorithms.RL and ADP algorithms are particularly useful for solving Markov decision processes(MDPs) that suffer from the curses of dimensionality and modeling.Many real-world problems,however,tend to be semi-Markov decision processes(SMDPs) in which the time spent in each transition of the underlying Markov chains is itself a random variable.Unfortunately for the average reward case,unlike the discounted reward case,the MDP does not have an easy extension to the SMDP.Examples of SMDPs can be found in the area of supply chain management,maintenance management,and airline revenue management.In this paper,we propose an adaptive critic heuristic for the SMDP under the long-run average reward criterion.We present the convergence analysis of the algorithm which shows that under certain mild conditions,which can be ensured within a simulator,the algorithm converges to an optimal solution with probability 1.We test the algorithm extensively on a problem of airline revenue management in which the manager has to set prices for airline tickets over the booking horizon.The problem has a large scale,suffering from the curse of dimensionality,and hence it is difficult to solve it via classical methods of dynamic programming.Our numerical results are encouraging and show that the algorithm outperforms an existing heuristic used widely in the airline industry.展开更多
Jane Eyre is a masterpiece of the famous English writer Charlotte Bronte's in 19 th century. From its coming into being,it has appealed a lot of literary critics to explore the heroine, Jane Eyre. Their opinions a...Jane Eyre is a masterpiece of the famous English writer Charlotte Bronte's in 19 th century. From its coming into being,it has appealed a lot of literary critics to explore the heroine, Jane Eyre. Their opinions are positive, negative, or they study it from different aspects. So it's very necessary to have a review about these different views in order that readers can understand it more clearly. This essay attempts to summarize these different literary critics in the recent years in China, mainly from Jane Eyre's characters, and through the approaches of feminism, religious consciousness, and comparison with other females.展开更多
This paper will use formalist approach to analyze The Secret Life of Walter Mitty. From parts to the organic whole and with the analysis of narrative skills, poetic elements, meaning in tension, the story will be aest...This paper will use formalist approach to analyze The Secret Life of Walter Mitty. From parts to the organic whole and with the analysis of narrative skills, poetic elements, meaning in tension, the story will be aesthetically appreciated through a close reading, then its theme will also be cleared up.展开更多
基金supported by the National Science Foundation (No.ECS0841055)
文摘The adaptive critic heuristic has been a popular algorithm in reinforcement learning(RL) and approximate dynamic programming(ADP) alike.It is one of the ?rst RL and ADP algorithms.RL and ADP algorithms are particularly useful for solving Markov decision processes(MDPs) that suffer from the curses of dimensionality and modeling.Many real-world problems,however,tend to be semi-Markov decision processes(SMDPs) in which the time spent in each transition of the underlying Markov chains is itself a random variable.Unfortunately for the average reward case,unlike the discounted reward case,the MDP does not have an easy extension to the SMDP.Examples of SMDPs can be found in the area of supply chain management,maintenance management,and airline revenue management.In this paper,we propose an adaptive critic heuristic for the SMDP under the long-run average reward criterion.We present the convergence analysis of the algorithm which shows that under certain mild conditions,which can be ensured within a simulator,the algorithm converges to an optimal solution with probability 1.We test the algorithm extensively on a problem of airline revenue management in which the manager has to set prices for airline tickets over the booking horizon.The problem has a large scale,suffering from the curse of dimensionality,and hence it is difficult to solve it via classical methods of dynamic programming.Our numerical results are encouraging and show that the algorithm outperforms an existing heuristic used widely in the airline industry.
文摘Jane Eyre is a masterpiece of the famous English writer Charlotte Bronte's in 19 th century. From its coming into being,it has appealed a lot of literary critics to explore the heroine, Jane Eyre. Their opinions are positive, negative, or they study it from different aspects. So it's very necessary to have a review about these different views in order that readers can understand it more clearly. This essay attempts to summarize these different literary critics in the recent years in China, mainly from Jane Eyre's characters, and through the approaches of feminism, religious consciousness, and comparison with other females.
文摘This paper will use formalist approach to analyze The Secret Life of Walter Mitty. From parts to the organic whole and with the analysis of narrative skills, poetic elements, meaning in tension, the story will be aesthetically appreciated through a close reading, then its theme will also be cleared up.
