We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (...We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (SG) algorithm is applied to obtain initial estimates of the unknown parameter matrix and in the second step an optimization criterion is introduced for the sparse identification of multivariate ARX systems. Under mild conditions, we prove that by minimizing the criterion function, the zero elements of the unknown parameter matrix can be recovered with a finite number of observations. The performance of the algorithm is testified through a simulation example.展开更多
Indoor air quality becomes increasingly important,partly because the COVID-19 pandemic increases the time people spend indoors.Research into the prediction of indoor volatile organic compounds(VOCs)is traditionally co...Indoor air quality becomes increasingly important,partly because the COVID-19 pandemic increases the time people spend indoors.Research into the prediction of indoor volatile organic compounds(VOCs)is traditionally confined to building materials and furniture.Relatively little research focuses on estimation of human-related VOCs,which have been shown to contribute significantly to indoor air quality,especially in densely-occupied environments.This study applies a machine learning approach to accurately estimate the human-related VOC emissions in a university classroom.The time-resolved concentrations of two typical human-related(ozone-related)VOCs in the classroom over a five-day period were analyzed,i.e.,6-methyl-5-hepten-2-one(6-MHO),4-oxopentanal(4-OPA).By comparing the results for 6-MHO concentration predicted via five machine learning approaches including the random forest regression(RFR),adaptive boosting(Adaboost),gradient boosting regression tree(GBRT),extreme gradient boosting(XGboost),and least squares support vector machine(LSSVM),we find that the LSSVM approach achieves the best performance,by using multi-feature parameters(number of occupants,ozone concentration,temperature,relative humidity)as the input.The LSSVM approach is then used to predict the 4-OPA concentration,with mean absolute percentage error(MAPE)less than 5%,indicating high accuracy.By combining the LSSVM with a kernel density estimation(KDE)method,we further establish an interval prediction model,which can provide uncertainty information and viable option for decision-makers.The machine learning approach in this study can easily incorporate the impact of various factors on VOC emission behaviors,making it especially suitable for concentration prediction and exposure assessment in realistic indoor settings.展开更多
Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for...Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.展开更多
Joint sparse recovery(JSR)in compressed sensing(CS)is to simultaneously recover multiple jointly sparse vectors from their incomplete measurements that are conducted based on a common sensing matrix.In this study,the ...Joint sparse recovery(JSR)in compressed sensing(CS)is to simultaneously recover multiple jointly sparse vectors from their incomplete measurements that are conducted based on a common sensing matrix.In this study,the focus is placed on the rank defective case where the number of measurements is limited or the signals are significantly correlated with each other.First,an iterative atom refinement process is adopted to estimate part of the atoms of the support set.Subsequently,the above atoms along with the measurements are used to estimate the remaining atoms.The estimation criteria for atoms are based on the principle of minimum subspace distance.Extensive numerical experiments were performed in noiseless and noisy scenarios,and results reveal that iterative subspace matching pursuit(ISMP)outperforms other existing algorithms for JSR.展开更多
Support vector machine(SVM) has shown great potential in pattern recognition and regressive estima-tion.Due to the industrial development demands,such as the fermentation process modeling,improving the training perfor...Support vector machine(SVM) has shown great potential in pattern recognition and regressive estima-tion.Due to the industrial development demands,such as the fermentation process modeling,improving the training performance on increasingly large sample sets is an important problem.However,solving a large optimization problem is computationally intensive and memory intensive.In this paper,a geometric interpretation of SVM re-gression(SVR) is derived,and μ-SVM is extended for both L1-norm and L2-norm penalty SVR.Further,Gilbert al-gorithm,a well-known geometric algorithm,is modified to solve SVR problems.Theoretical analysis indicates that the presented SVR training geometric algorithms have the same convergence and almost identical cost of computa-tion as their corresponding algorithms for SVM classification.Experimental results show that the geometric meth-ods are more efficient than conventional methods using quadratic programming and require much less memory.展开更多
One-class support vector machine （OCSVM） and support vector data description （SVDD） are two main domain-based one-class （kernel） classifiers. To reveal their relationship with density estimation in the case of t...One-class support vector machine （OCSVM） and support vector data description （SVDD） are two main domain-based one-class （kernel） classifiers. To reveal their relationship with density estimation in the case of the Gaussian kernel, OCSVM and SVDD are firstly unified into the framework of kernel density estimation, and the essential relationship between them is explicitly revealed. Then the result proves that the density estimation induced by OCSVM or SVDD is in agreement with the true density. Meanwhile, it can also reduce the integrated squared error （ISE）. Finally, experiments on several simulated datasets verify the revealed relationships.展开更多
A new approach for the prediction of lift, drag, and moment coefficients is presented. This approach is based on the support vector machines （SVMs） methodology and an optimization meta-heuristic algorithm called ext...A new approach for the prediction of lift, drag, and moment coefficients is presented. This approach is based on the support vector machines （SVMs） methodology and an optimization meta-heuristic algorithm called extended great deluge （EGD）. The novelty of this approach is the hybridization between the SVM and the EGD algorithm. The EGD is used to optimize the SVM parameters. The training and validation of this new identification approach is realized using the aerodynamic coefficients of an ATR-42 wing model. The aerodynamic coefficients data are obtained with the XFoil software and experimental tests using the Price-Paidoussis wind tunnel. The predicted results with our approach are compared with those from the XFoil software and experimental results for different flight cases of angles of attack and Mach numbers. The main pur- pose of this methodology is to rapidly Predict aircraft aerodynamic coefficients.展开更多
A method of medical image segmentation based on support vector machine (SVM) for density estimation is presented. We used this estimator to construct a prior model of the image intensity and curvature profile of the s...A method of medical image segmentation based on support vector machine (SVM) for density estimation is presented. We used this estimator to construct a prior model of the image intensity and curvature profile of the structure from training images. When segmenting a novel image similar to the training images, the technique of narrow level set method is used. The higher dimensional surface evolution metric is defined by the prior model instead of by energy minimization function. This method offers several advantages. First, SVM for density estimation is consistent and its solution is sparse. Second, compared to the traditional level set methods, this method incorporates shape information on the object to be segmented into the segmentation process. Segmentation results are demonstrated on synthetic images, MR images and ultrasonic images.展开更多
Detecting naturally arising structures in data is central to knowledge extraction from data. In most applications, the main challenge is in the choice of the appropriate model for exploring the data features. The choi...Detecting naturally arising structures in data is central to knowledge extraction from data. In most applications, the main challenge is in the choice of the appropriate model for exploring the data features. The choice is generally poorly understood and any tentative choice may be too restrictive. Growing volumes of data, disparate data sources and modelling techniques entail the need for model optimization via adaptability rather than comparability. We propose a novel two-stage algorithm to modelling continuous data consisting of an unsupervised stage whereby the algorithm searches through the data for optimal parameter values and a supervised stage that adapts the parameters for predictive modelling. The method is implemented on the sunspots data with inherently Gaussian distributional properties and assumed bi-modality. Optimal values separating high from lows cycles are obtained via multiple simulations. Early patterns for each recorded cycle reveal that the first 3 years provide a sufficient basis for predicting the peak. Multiple Support Vector Machine runs using repeatedly improved data parameters show that the approach yields greater accuracy and reliability than conventional approaches and provides a good basis for model selection. Model reliability is established via multiple simulations of this type.展开更多
The main purpose of this study is to classify the rock mass quality by using rock mass quality (Q) and Rock Mass Rating (RMR) systems along headrace tunnel of small hydropower in Mansehra District, Khyber Pakhtunkhwa....The main purpose of this study is to classify the rock mass quality by using rock mass quality (Q) and Rock Mass Rating (RMR) systems along headrace tunnel of small hydropower in Mansehra District, Khyber Pakhtunkhwa. Geological field work was carried out to determine the orientation, spacing, aperture, roughness and alteration of discontinuities of rock mass. The quality of rock mass along the tunnel route is classified as good to very poor quality by Q system, while very good to very poor by RMR classification system. The relatively good rock conditions are acquired via RMR values that are attributed to ground water conditions, joint spacing, RQD and favorable orientation of discontinuities with respect to the tunnel drive. The petrographic studies revealed that study area is mainly comprised of five major geological rock units namely quartz mica schist (QMS), garnet mica schist (GMS), garnet bearing quartz mica schist (G-QMS), calcareous schist (CS), marble (M). The collected samples of quartz mica schist, marble and garnet bearing quartz mica schist are fine to medium grained, compact and are cross cut by few discontinuities having greater spacing. Therefore, these rocks have greater average RQD, Q values, RMR ratings as compared to garnet mica schist and calcareous schist.展开更多
文摘We consider the sparse identification of multivariate ARX systems, i.e., to recover the zero elements of the unknown parameter matrix. We propose a two-step algorithm, where in the first step the stochastic gradient (SG) algorithm is applied to obtain initial estimates of the unknown parameter matrix and in the second step an optimization criterion is introduced for the sparse identification of multivariate ARX systems. Under mild conditions, we prove that by minimizing the criterion function, the zero elements of the unknown parameter matrix can be recovered with a finite number of observations. The performance of the algorithm is testified through a simulation example.
基金supported by the National Natural Science Foundation of China (No.52178062)the Alfred P.Sloan Foundation (No.G-2016-7050)the Opening Fund of State Key Laboratory of Green Building in Western China (LSKF202311).
文摘Indoor air quality becomes increasingly important,partly because the COVID-19 pandemic increases the time people spend indoors.Research into the prediction of indoor volatile organic compounds(VOCs)is traditionally confined to building materials and furniture.Relatively little research focuses on estimation of human-related VOCs,which have been shown to contribute significantly to indoor air quality,especially in densely-occupied environments.This study applies a machine learning approach to accurately estimate the human-related VOC emissions in a university classroom.The time-resolved concentrations of two typical human-related(ozone-related)VOCs in the classroom over a five-day period were analyzed,i.e.,6-methyl-5-hepten-2-one(6-MHO),4-oxopentanal(4-OPA).By comparing the results for 6-MHO concentration predicted via five machine learning approaches including the random forest regression(RFR),adaptive boosting(Adaboost),gradient boosting regression tree(GBRT),extreme gradient boosting(XGboost),and least squares support vector machine(LSSVM),we find that the LSSVM approach achieves the best performance,by using multi-feature parameters(number of occupants,ozone concentration,temperature,relative humidity)as the input.The LSSVM approach is then used to predict the 4-OPA concentration,with mean absolute percentage error(MAPE)less than 5%,indicating high accuracy.By combining the LSSVM with a kernel density estimation(KDE)method,we further establish an interval prediction model,which can provide uncertainty information and viable option for decision-makers.The machine learning approach in this study can easily incorporate the impact of various factors on VOC emission behaviors,making it especially suitable for concentration prediction and exposure assessment in realistic indoor settings.
基金financially supported by the National Council for Scientific and Technological Development(CNPq,Brazil),Swedish-Brazilian Research and Innovation Centre(CISB),and Saab AB under Grant No.CNPq:200053/2022-1the National Council for Scientific and Technological Development(CNPq,Brazil)under Grants No.CNPq:312924/2017-8 and No.CNPq:314660/2020-8.
文摘Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.
基金supported by the National Natural Science Foundation of China(61771258)the Postgraduate Research and Practice Innovation Program of Jiangsu Province(KYCX 210749)。
文摘Joint sparse recovery(JSR)in compressed sensing(CS)is to simultaneously recover multiple jointly sparse vectors from their incomplete measurements that are conducted based on a common sensing matrix.In this study,the focus is placed on the rank defective case where the number of measurements is limited or the signals are significantly correlated with each other.First,an iterative atom refinement process is adopted to estimate part of the atoms of the support set.Subsequently,the above atoms along with the measurements are used to estimate the remaining atoms.The estimation criteria for atoms are based on the principle of minimum subspace distance.Extensive numerical experiments were performed in noiseless and noisy scenarios,and results reveal that iterative subspace matching pursuit(ISMP)outperforms other existing algorithms for JSR.
基金Supported by the National Natural Science Foundation of China (20476007,20676013)
文摘Support vector machine(SVM) has shown great potential in pattern recognition and regressive estima-tion.Due to the industrial development demands,such as the fermentation process modeling,improving the training performance on increasingly large sample sets is an important problem.However,solving a large optimization problem is computationally intensive and memory intensive.In this paper,a geometric interpretation of SVM re-gression(SVR) is derived,and μ-SVM is extended for both L1-norm and L2-norm penalty SVR.Further,Gilbert al-gorithm,a well-known geometric algorithm,is modified to solve SVR problems.Theoretical analysis indicates that the presented SVR training geometric algorithms have the same convergence and almost identical cost of computa-tion as their corresponding algorithms for SVM classification.Experimental results show that the geometric meth-ods are more efficient than conventional methods using quadratic programming and require much less memory.
基金Supported by the National Natural Science Foundation of China(60603029)the Natural Science Foundation of Jiangsu Province(BK2007074)the Natural Science Foundation for Colleges and Universities in Jiangsu Province(06KJB520132)~~
文摘One-class support vector machine （OCSVM） and support vector data description （SVDD） are two main domain-based one-class （kernel） classifiers. To reveal their relationship with density estimation in the case of the Gaussian kernel, OCSVM and SVDD are firstly unified into the framework of kernel density estimation, and the essential relationship between them is explicitly revealed. Then the result proves that the density estimation induced by OCSVM or SVDD is in agreement with the true density. Meanwhile, it can also reduce the integrated squared error （ISE）. Finally, experiments on several simulated datasets verify the revealed relationships.
基金funded by the Natural Sciences and Engineering Research Council of Canada(NSERC)in the frame of the Canada Research Chair for Aircraft Modeling and Simulation Technologies
文摘A new approach for the prediction of lift, drag, and moment coefficients is presented. This approach is based on the support vector machines （SVMs） methodology and an optimization meta-heuristic algorithm called extended great deluge （EGD）. The novelty of this approach is the hybridization between the SVM and the EGD algorithm. The EGD is used to optimize the SVM parameters. The training and validation of this new identification approach is realized using the aerodynamic coefficients of an ATR-42 wing model. The aerodynamic coefficients data are obtained with the XFoil software and experimental tests using the Price-Paidoussis wind tunnel. The predicted results with our approach are compared with those from the XFoil software and experimental results for different flight cases of angles of attack and Mach numbers. The main pur- pose of this methodology is to rapidly Predict aircraft aerodynamic coefficients.
基金Project (No. 2003CB716103) supported by the National BasicResearch Program (973) of China and the Key Lab for Image Proc-essing and Intelligent Control of National Education Ministry, China
文摘A method of medical image segmentation based on support vector machine (SVM) for density estimation is presented. We used this estimator to construct a prior model of the image intensity and curvature profile of the structure from training images. When segmenting a novel image similar to the training images, the technique of narrow level set method is used. The higher dimensional surface evolution metric is defined by the prior model instead of by energy minimization function. This method offers several advantages. First, SVM for density estimation is consistent and its solution is sparse. Second, compared to the traditional level set methods, this method incorporates shape information on the object to be segmented into the segmentation process. Segmentation results are demonstrated on synthetic images, MR images and ultrasonic images.
文摘Detecting naturally arising structures in data is central to knowledge extraction from data. In most applications, the main challenge is in the choice of the appropriate model for exploring the data features. The choice is generally poorly understood and any tentative choice may be too restrictive. Growing volumes of data, disparate data sources and modelling techniques entail the need for model optimization via adaptability rather than comparability. We propose a novel two-stage algorithm to modelling continuous data consisting of an unsupervised stage whereby the algorithm searches through the data for optimal parameter values and a supervised stage that adapts the parameters for predictive modelling. The method is implemented on the sunspots data with inherently Gaussian distributional properties and assumed bi-modality. Optimal values separating high from lows cycles are obtained via multiple simulations. Early patterns for each recorded cycle reveal that the first 3 years provide a sufficient basis for predicting the peak. Multiple Support Vector Machine runs using repeatedly improved data parameters show that the approach yields greater accuracy and reliability than conventional approaches and provides a good basis for model selection. Model reliability is established via multiple simulations of this type.
文摘The main purpose of this study is to classify the rock mass quality by using rock mass quality (Q) and Rock Mass Rating (RMR) systems along headrace tunnel of small hydropower in Mansehra District, Khyber Pakhtunkhwa. Geological field work was carried out to determine the orientation, spacing, aperture, roughness and alteration of discontinuities of rock mass. The quality of rock mass along the tunnel route is classified as good to very poor quality by Q system, while very good to very poor by RMR classification system. The relatively good rock conditions are acquired via RMR values that are attributed to ground water conditions, joint spacing, RQD and favorable orientation of discontinuities with respect to the tunnel drive. The petrographic studies revealed that study area is mainly comprised of five major geological rock units namely quartz mica schist (QMS), garnet mica schist (GMS), garnet bearing quartz mica schist (G-QMS), calcareous schist (CS), marble (M). The collected samples of quartz mica schist, marble and garnet bearing quartz mica schist are fine to medium grained, compact and are cross cut by few discontinuities having greater spacing. Therefore, these rocks have greater average RQD, Q values, RMR ratings as compared to garnet mica schist and calcareous schist.
