Recently, the emergence of pre-trained models(PTMs) has brought natural language processing(NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language rep...Recently, the emergence of pre-trained models(PTMs) has brought natural language processing(NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy from four different perspectives. Next,we describe how to adapt the knowledge of PTMs to downstream tasks. Finally, we outline some potential directions of PTMs for future research. This survey is purposed to be a hands-on guide for understanding, using, and developing PTMs for various NLP tasks.展开更多
The Globus Toolkit （GT） has been developed since the late 1990s to support the development of serviceoriented distributed computing applications and infrastructures. Core GT components address, within a common frame...The Globus Toolkit （GT） has been developed since the late 1990s to support the development of serviceoriented distributed computing applications and infrastructures. Core GT components address, within a common framework, fundamental issues relating to security, resource access, resource management, data movement, resource discovery, and so forth. These components enable a broader ＂Globus ecosystem＂ of tools and components that build on, or interoperate with, GT functionality to provide a wide range of useful application-level functions. These tools have in turn been used to develop a wide range of both ＂Grid＂ infrastructures and distributed applications. I summarize here the principal characteristics of the recent Web Services-based GT4 release, which provides significant improvements over previous releases in terms of robustness, performance,, usability, documentation, standards compliance, and functionality. I also introduce the new ＂dev.globus＂ community development process, which allows a larger community to contribute to the development of Globus software.展开更多
This paper proposes a control strategy that can realize seamless microgrid operation mode transition between grid-connected operation and stand-alone operation.The scenario of a microgrid based on master-slave control...This paper proposes a control strategy that can realize seamless microgrid operation mode transition between grid-connected operation and stand-alone operation.The scenario of a microgrid based on master-slave control is considered,where the master distributed generation(DG) unit operates in different control schemes in different microgrid operation modes,while other slave DG units operate with power/current control all the time.The proposed control strategy focuses on the master DG unit,and contains the control state/reference compensation algorithm and separation switch control logic.The proposed method can effectively reduce the impact on the critical loads and DG units caused by microgrid operation mode transitions.展开更多
基金the National Natural Science Foundation of China(Grant Nos.61751201 and 61672162)the Shanghai Municipal Science and Technology Major Project(Grant No.2018SHZDZX01)and ZJLab。
文摘Recently, the emergence of pre-trained models(PTMs) has brought natural language processing(NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy from four different perspectives. Next,we describe how to adapt the knowledge of PTMs to downstream tasks. Finally, we outline some potential directions of PTMs for future research. This survey is purposed to be a hands-on guide for understanding, using, and developing PTMs for various NLP tasks.
基金Work on Giobus has been supported in part by the Mathematical, Information, and Computational Sciences Division subprogram of the 0ffice of Advanced Scientific Computing Research, U.S. Department of Energy, under Contract W-31-109-Eng-38, by the National Science Foundation （NSF）＇s 0ffice of Cyberinfrastructure and other programs, and by IBM, DARPA, NASA, Microsoft, the UK Engineering and Physical Sciences Research Council and Department of Trade and Industry, and the Swedish Research Council. I report here on the work of many talented colleagues, as detailed at www.globus.org. The core team is currently based primarily at Argonne National Lab, U. Chicago, the USC Information Sciences Institute, U. Edinburgh, the Royal Institute of Technology, the National Center for Supercomputing Applications, and Univa Corporation, but many others have also contributed to Globus code, documentation, and testing, and/or made our work worthwhile by using the software.
文摘The Globus Toolkit （GT） has been developed since the late 1990s to support the development of serviceoriented distributed computing applications and infrastructures. Core GT components address, within a common framework, fundamental issues relating to security, resource access, resource management, data movement, resource discovery, and so forth. These components enable a broader ＂Globus ecosystem＂ of tools and components that build on, or interoperate with, GT functionality to provide a wide range of useful application-level functions. These tools have in turn been used to develop a wide range of both ＂Grid＂ infrastructures and distributed applications. I summarize here the principal characteristics of the recent Web Services-based GT4 release, which provides significant improvements over previous releases in terms of robustness, performance,, usability, documentation, standards compliance, and functionality. I also introduce the new ＂dev.globus＂ community development process, which allows a larger community to contribute to the development of Globus software.
基金supported by the National Basic Research Program of China ("973" Project) (Grant No. 2009CB219700)the National Natural Science Foundation of China (Grant No. 50837001)
文摘This paper proposes a control strategy that can realize seamless microgrid operation mode transition between grid-connected operation and stand-alone operation.The scenario of a microgrid based on master-slave control is considered,where the master distributed generation(DG) unit operates in different control schemes in different microgrid operation modes,while other slave DG units operate with power/current control all the time.The proposed control strategy focuses on the master DG unit,and contains the control state/reference compensation algorithm and separation switch control logic.The proposed method can effectively reduce the impact on the critical loads and DG units caused by microgrid operation mode transitions.
