Prediction of melt index （MI）, the most important parameter in determining the product＇s grade and quality control of polypropylene produced in practical industrial processes, is studied. A novel soft-sensor model ...Prediction of melt index （MI）, the most important parameter in determining the product＇s grade and quality control of polypropylene produced in practical industrial processes, is studied. A novel soft-sensor model with principal component analysis （PCA）, radial basis function （RBF） networks, and multi-scale analysis （MSA） is proposed to infer the MI of manufactured products from real process variables, where PCA is carried out to select the most relevant process features and to eliminate the correlations of the input variables, MSA is introduced to a^quire much more information and to reduce the uncertainty of the system, and RBF networks are used to characterize the nonlinearity of the process. The research results show that the proposed method provides promising prediction reliability and accuracy, and supposed to have extensive application prospects in propylene polymerization processes.展开更多
Most of the neural network architectures are based on human experience,which requires a long and tedious trial-and-error process.Neural architecture search(NAS)attempts to detect effective architectures without human ...Most of the neural network architectures are based on human experience,which requires a long and tedious trial-and-error process.Neural architecture search(NAS)attempts to detect effective architectures without human intervention.Evolutionary algorithms(EAs)for NAS can find better solutions than human-designed architectures by exploring a large search space for possible architectures.Using multiobjective EAs for NAS,optimal neural architectures that meet various performance criteria can be explored and discovered efficiently.Furthermore,hardware-accelerated NAS methods can improve the efficiency of the NAS.While existing reviews have mainly focused on different strategies to complete NAS,a few studies have explored the use of EAs for NAS.In this paper,we summarize and explore the use of EAs for NAS,as well as large-scale multiobjective optimization strategies and hardware-accelerated NAS methods.NAS performs well in healthcare applications,such as medical image analysis,classification of disease diagnosis,and health monitoring.EAs for NAS can automate the search process and optimize multiple objectives simultaneously in a given healthcare task.Deep neural network has been successfully used in healthcare,but it lacks interpretability.Medical data is highly sensitive,and privacy leaks are frequently reported in the healthcare industry.To solve these problems,in healthcare,we propose an interpretable neuroevolution framework based on federated learning to address search efficiency and privacy protection.Moreover,we also point out future research directions for evolutionary NAS.Overall,for researchers who want to use EAs to optimize NNs in healthcare,we analyze the advantages and disadvantages of doing so to provide detailed guidance,and propose an interpretable privacy-preserving framework for healthcare applications.展开更多
The paper introduces a novel approach for detecting structural damage in full-scale structures using surrogate models generated from incomplete modal data and deep neural networks(DNNs).A significant challenge in this...The paper introduces a novel approach for detecting structural damage in full-scale structures using surrogate models generated from incomplete modal data and deep neural networks(DNNs).A significant challenge in this field is the limited availability of measurement data for full-scale structures,which is addressed in this paper by generating data sets using a reduced finite element(FE)model constructed by SAP2000 software and the MATLAB programming loop.The surrogate models are trained using response data obtained from the monitored structure through a limited number of measurement devices.The proposed approach involves training a single surrogate model that can quickly predict the location and severity of damage for all potential scenarios.To achieve the most generalized surrogate model,the study explores different types of layers and hyperparameters of the training algorithm and employs state-of-the-art techniques to avoid overfitting and to accelerate the training process.The approach’s effectiveness,efficiency,and applicability are demonstrated by two numerical examples.The study also verifies the robustness of the proposed approach on data sets with sparse and noisy measured data.Overall,the proposed approach is a promising alternative to traditional approaches that rely on FE model updating and optimization algorithms,which can be computationally intensive.This approach also shows potential for broader applications in structural damage detection.展开更多
Multi-scale system remains a classical scientific problem in fluid dynamics,biology,etc.In the present study,a scheme of multi-scale Physics-informed neural networks is proposed to solve the boundary layer flow at hig...Multi-scale system remains a classical scientific problem in fluid dynamics,biology,etc.In the present study,a scheme of multi-scale Physics-informed neural networks is proposed to solve the boundary layer flow at high Reynolds numbers without any data.The flow is divided into several regions with different scales based on Prandtl's boundary theory.Different regions are solved with governing equations in different scales.The method of matched asymptotic expansions is used to make the flow field continuously.A flow on a semi infinite flat plate at a high Reynolds number is considered a multi-scale problem because the boundary layer scale is much smaller than the outer flow scale.The results are compared with the reference numerical solutions,which show that the msPINNs can solve the multi-scale problem of the boundary layer in high Reynolds number flows.This scheme can be developed for more multi-scale problems in the future.展开更多
The present study proposes a sub-grid scale model for the one-dimensional Burgers turbulence based on the neuralnetwork and deep learning method.The filtered data of the direct numerical simulation is used to establis...The present study proposes a sub-grid scale model for the one-dimensional Burgers turbulence based on the neuralnetwork and deep learning method.The filtered data of the direct numerical simulation is used to establish thetraining data set,the validation data set,and the test data set.The artificial neural network(ANN)methodand Back Propagation method are employed to train parameters in the ANN.The developed ANN is applied toconstruct the sub-grid scale model for the large eddy simulation of the Burgers turbulence in the one-dimensionalspace.The proposed model well predicts the time correlation and the space correlation of the Burgers turbulence.展开更多
Fifty-one patients with mild （n -- 14）, moderate （n = 10） and severe traumatic brain injury （n = 27） received early rehabilitation. Level of consciousness was evaluated using the Glasgow Coma Score Functional le...Fifty-one patients with mild （n -- 14）, moderate （n = 10） and severe traumatic brain injury （n = 27） received early rehabilitation. Level of consciousness was evaluated using the Glasgow Coma Score Functional level was determined using the Glasgow Outcome Score, whilst mobility was evaluated using the Mobility Scale for Acute Stroke. Activities of daily living were assessed using the Barthel Index. Following Bobath neurodevelopmental therapy, the level of consciousness was significantly improved in patients with moderate and severe traumatic brain injury, but was not greatly influenced in patients with mild traumatic brain injury. Mobility and functional level were significantly improved in patients with mild, moderate and severe traumatic brain injury. Gait recovery was more obvious in patients with mild traumatic brain injury than in patients with moderate and severe traumatic brain injury. Activities of daily living showed an improvement but this was insignificant except for patients with severe traumatic brain injury. Nevertheless, complete recovery was not acquired at discharge. Multiple regression analysis showed that gait and Glasgow Coma Scale scores can be considered predictors of functional outcomes following traumatic brain injury.展开更多
The tradeoff between efficiency and model size of the convolutional neural network(CNN)is an essential issue for applications of CNN-based algorithms to diverse real-world tasks.Although deep learning-based methods ha...The tradeoff between efficiency and model size of the convolutional neural network(CNN)is an essential issue for applications of CNN-based algorithms to diverse real-world tasks.Although deep learning-based methods have achieved significant improvements in image super-resolution(SR),current CNNbased techniques mainly contain massive parameters and a high computational complexity,limiting their practical applications.In this paper,we present a fast and lightweight framework,named weighted multi-scale residual network(WMRN),for a better tradeoff between SR performance and computational efficiency.With the modified residual structure,depthwise separable convolutions(DS Convs)are employed to improve convolutional operations’efficiency.Furthermore,several weighted multi-scale residual blocks(WMRBs)are stacked to enhance the multi-scale representation capability.In the reconstruction subnetwork,a group of Conv layers are introduced to filter feature maps to reconstruct the final high-quality image.Extensive experiments were conducted to evaluate the proposed model,and the comparative results with several state-of-the-art algorithms demonstrate the effectiveness of WMRN.展开更多
Cerebral blood flow is strongly associated with brain function, and is the main symptom and diagnostic basis for a variety of encephalopathies. However, changes in cerebral blood flow after mild traumatic brain injury...Cerebral blood flow is strongly associated with brain function, and is the main symptom and diagnostic basis for a variety of encephalopathies. However, changes in cerebral blood flow after mild traumatic brain injury remain poorly understood. This study sought to observe changes in cerebral blood flow in different regions after mild traumatic brain injury using pulsed arterial spin labeling. Our results demonstrate maximal cerebral blood flow in gray matter and minimal in the white matter of patients with mild traumatic brain injury. At the acute and subacute stages, cerebral blood flow was reduced in the occipital lobe, parietal lobe, central region, subcutaneous region, and frontal lobe. Cerebral blood flow was restored at the chronic stage. At the acute, subacute, and chronic stages, changes in cerebral blood flow were not apparent in the insula. Cerebral blood flow in the temporal lobe and limbic lobe diminished at the acute and subacute stages, but was restored at the chronic stage. These findings suggest that pulsed arterial spin labeling can precisely measure cerebral blood flow in various brain regions, and may play a reference role in evaluating a patient＇s condition and judging prognosis after traumatic brain injury.展开更多
基金Supported by the National Natural Science Foundation of China (No. 20106008)National HI-TECH Industrialization Program of China (No. Fagai-Gaoji-2004-2080)Science Fund for Distinguished Young Scholars of Zhejiang University (No. 111000-581645).
文摘Prediction of melt index （MI）, the most important parameter in determining the product＇s grade and quality control of polypropylene produced in practical industrial processes, is studied. A novel soft-sensor model with principal component analysis （PCA）, radial basis function （RBF） networks, and multi-scale analysis （MSA） is proposed to infer the MI of manufactured products from real process variables, where PCA is carried out to select the most relevant process features and to eliminate the correlations of the input variables, MSA is introduced to a^quire much more information and to reduce the uncertainty of the system, and RBF networks are used to characterize the nonlinearity of the process. The research results show that the proposed method provides promising prediction reliability and accuracy, and supposed to have extensive application prospects in propylene polymerization processes.
基金supported in part by the National Natural Science Foundation of China (NSFC) under Grant No.61976242in part by the Natural Science Fund of Hebei Province for Distinguished Young Scholars under Grant No.F2021202010+2 种基金in part by the Fundamental Scientific Research Funds for Interdisciplinary Team of Hebei University of Technology under Grant No.JBKYTD2002funded by Science and Technology Project of Hebei Education Department under Grant No.JZX2023007supported by 2022 Interdisciplinary Postgraduate Training Program of Hebei University of Technology under Grant No.HEBUT-YXKJC-2022122.
文摘Most of the neural network architectures are based on human experience,which requires a long and tedious trial-and-error process.Neural architecture search(NAS)attempts to detect effective architectures without human intervention.Evolutionary algorithms(EAs)for NAS can find better solutions than human-designed architectures by exploring a large search space for possible architectures.Using multiobjective EAs for NAS,optimal neural architectures that meet various performance criteria can be explored and discovered efficiently.Furthermore,hardware-accelerated NAS methods can improve the efficiency of the NAS.While existing reviews have mainly focused on different strategies to complete NAS,a few studies have explored the use of EAs for NAS.In this paper,we summarize and explore the use of EAs for NAS,as well as large-scale multiobjective optimization strategies and hardware-accelerated NAS methods.NAS performs well in healthcare applications,such as medical image analysis,classification of disease diagnosis,and health monitoring.EAs for NAS can automate the search process and optimize multiple objectives simultaneously in a given healthcare task.Deep neural network has been successfully used in healthcare,but it lacks interpretability.Medical data is highly sensitive,and privacy leaks are frequently reported in the healthcare industry.To solve these problems,in healthcare,we propose an interpretable neuroevolution framework based on federated learning to address search efficiency and privacy protection.Moreover,we also point out future research directions for evolutionary NAS.Overall,for researchers who want to use EAs to optimize NNs in healthcare,we analyze the advantages and disadvantages of doing so to provide detailed guidance,and propose an interpretable privacy-preserving framework for healthcare applications.
基金This study was supported by Bualuang ASEAN Chair Professor Fund.
文摘The paper introduces a novel approach for detecting structural damage in full-scale structures using surrogate models generated from incomplete modal data and deep neural networks(DNNs).A significant challenge in this field is the limited availability of measurement data for full-scale structures,which is addressed in this paper by generating data sets using a reduced finite element(FE)model constructed by SAP2000 software and the MATLAB programming loop.The surrogate models are trained using response data obtained from the monitored structure through a limited number of measurement devices.The proposed approach involves training a single surrogate model that can quickly predict the location and severity of damage for all potential scenarios.To achieve the most generalized surrogate model,the study explores different types of layers and hyperparameters of the training algorithm and employs state-of-the-art techniques to avoid overfitting and to accelerate the training process.The approach’s effectiveness,efficiency,and applicability are demonstrated by two numerical examples.The study also verifies the robustness of the proposed approach on data sets with sparse and noisy measured data.Overall,the proposed approach is a promising alternative to traditional approaches that rely on FE model updating and optimization algorithms,which can be computationally intensive.This approach also shows potential for broader applications in structural damage detection.
文摘Multi-scale system remains a classical scientific problem in fluid dynamics,biology,etc.In the present study,a scheme of multi-scale Physics-informed neural networks is proposed to solve the boundary layer flow at high Reynolds numbers without any data.The flow is divided into several regions with different scales based on Prandtl's boundary theory.Different regions are solved with governing equations in different scales.The method of matched asymptotic expansions is used to make the flow field continuously.A flow on a semi infinite flat plate at a high Reynolds number is considered a multi-scale problem because the boundary layer scale is much smaller than the outer flow scale.The results are compared with the reference numerical solutions,which show that the msPINNs can solve the multi-scale problem of the boundary layer in high Reynolds number flows.This scheme can be developed for more multi-scale problems in the future.
基金supported by the National Key R&D Program of China(Grant No.2022YFB3303500).
文摘The present study proposes a sub-grid scale model for the one-dimensional Burgers turbulence based on the neuralnetwork and deep learning method.The filtered data of the direct numerical simulation is used to establish thetraining data set,the validation data set,and the test data set.The artificial neural network(ANN)methodand Back Propagation method are employed to train parameters in the ANN.The developed ANN is applied toconstruct the sub-grid scale model for the large eddy simulation of the Burgers turbulence in the one-dimensionalspace.The proposed model well predicts the time correlation and the space correlation of the Burgers turbulence.
文摘Fifty-one patients with mild （n -- 14）, moderate （n = 10） and severe traumatic brain injury （n = 27） received early rehabilitation. Level of consciousness was evaluated using the Glasgow Coma Score Functional level was determined using the Glasgow Outcome Score, whilst mobility was evaluated using the Mobility Scale for Acute Stroke. Activities of daily living were assessed using the Barthel Index. Following Bobath neurodevelopmental therapy, the level of consciousness was significantly improved in patients with moderate and severe traumatic brain injury, but was not greatly influenced in patients with mild traumatic brain injury. Mobility and functional level were significantly improved in patients with mild, moderate and severe traumatic brain injury. Gait recovery was more obvious in patients with mild traumatic brain injury than in patients with moderate and severe traumatic brain injury. Activities of daily living showed an improvement but this was insignificant except for patients with severe traumatic brain injury. Nevertheless, complete recovery was not acquired at discharge. Multiple regression analysis showed that gait and Glasgow Coma Scale scores can be considered predictors of functional outcomes following traumatic brain injury.
基金the National Natural Science Foundation of China(61772149,61866009,61762028,U1701267,61702169)Guangxi Science and Technology Project(2019GXNSFFA245014,ZY20198016,AD18281079,AD18216004)+1 种基金the Natural Science Foundation of Hunan Province(2020JJ3014)Guangxi Colleges and Universities Key Laboratory of Intelligent Processing of Computer Images and Graphics(GIIP202001).
文摘The tradeoff between efficiency and model size of the convolutional neural network(CNN)is an essential issue for applications of CNN-based algorithms to diverse real-world tasks.Although deep learning-based methods have achieved significant improvements in image super-resolution(SR),current CNNbased techniques mainly contain massive parameters and a high computational complexity,limiting their practical applications.In this paper,we present a fast and lightweight framework,named weighted multi-scale residual network(WMRN),for a better tradeoff between SR performance and computational efficiency.With the modified residual structure,depthwise separable convolutions(DS Convs)are employed to improve convolutional operations’efficiency.Furthermore,several weighted multi-scale residual blocks(WMRBs)are stacked to enhance the multi-scale representation capability.In the reconstruction subnetwork,a group of Conv layers are introduced to filter feature maps to reconstruct the final high-quality image.Extensive experiments were conducted to evaluate the proposed model,and the comparative results with several state-of-the-art algorithms demonstrate the effectiveness of WMRN.
文摘Cerebral blood flow is strongly associated with brain function, and is the main symptom and diagnostic basis for a variety of encephalopathies. However, changes in cerebral blood flow after mild traumatic brain injury remain poorly understood. This study sought to observe changes in cerebral blood flow in different regions after mild traumatic brain injury using pulsed arterial spin labeling. Our results demonstrate maximal cerebral blood flow in gray matter and minimal in the white matter of patients with mild traumatic brain injury. At the acute and subacute stages, cerebral blood flow was reduced in the occipital lobe, parietal lobe, central region, subcutaneous region, and frontal lobe. Cerebral blood flow was restored at the chronic stage. At the acute, subacute, and chronic stages, changes in cerebral blood flow were not apparent in the insula. Cerebral blood flow in the temporal lobe and limbic lobe diminished at the acute and subacute stages, but was restored at the chronic stage. These findings suggest that pulsed arterial spin labeling can precisely measure cerebral blood flow in various brain regions, and may play a reference role in evaluating a patient＇s condition and judging prognosis after traumatic brain injury.
