Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-li...Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-likelihood equation for the GLM has a solution when the sample size n is sufficiently large. The rate of this solution tending to the true value is determined. In an important special case, this rate is the same as specified in the LIL for iid partial sums and thus cannot be improved anymore.展开更多
In a generalized linear model with q x 1 responses, the bounded and fixed (or adaptive) p × q regressors Zi and the general link function, under the most general assumption on the minimum eigenvalue of ZiZ'i,...In a generalized linear model with q x 1 responses, the bounded and fixed (or adaptive) p × q regressors Zi and the general link function, under the most general assumption on the minimum eigenvalue of ZiZ'i,the moment condition on responses as weak as possible and the other mild regular conditions, we prove that the maximum quasi-likelihood estimates for the regression parameter vector are asymptotically normal and strongly consistent.展开更多
In a generalized linear model with q×1 responses, bounded and fixed p×q regressors zi and general link function, under the most general assumption on the minimum eigenvalue of ∑in=1 ZiZi', the moment co...In a generalized linear model with q×1 responses, bounded and fixed p×q regressors zi and general link function, under the most general assumption on the minimum eigenvalue of ∑in=1 ZiZi', the moment condition on responses as weak as possible and other mild regular conditions, we prove that with probability one, the quasi-likelihood equation has a solution βn for all large sample size n, which converges to the true regression parameter β0. This result is an essential improvement over the relevant results in literature.展开更多
Quasi-likelihood nonlinear models （QLNM） include generalized linear models as a special case. Under some regularity conditions, the rate of the strong consistency of the maximum quasi-likelihood estimation （MQLE） ...Quasi-likelihood nonlinear models （QLNM） include generalized linear models as a special case. Under some regularity conditions, the rate of the strong consistency of the maximum quasi-likelihood estimation （MQLE） is obtained in QLNM. In an important case, this rate is O（n-^1/2（loglogn）^1/2）, which is just the rate of LIL of partial sums for i.i.d variables, and thus cannot be improved anymore.展开更多
This paper proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of maximum quasi-likelihood estimation （MQLE） in quasi-likelihood nonlinear models ...This paper proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of maximum quasi-likelihood estimation （MQLE） in quasi-likelihood nonlinear models （QLNM）. Our results may be regarded as a further generalization of the relevant results in Ref. [4].展开更多
This paper proposes some regularity conditions, which result in the existence, strong consistency and asymptotic normality of maximum quasi-likelihood estimator （MQLE） in quasi-likelihood nonlinear models （QLNM） w...This paper proposes some regularity conditions, which result in the existence, strong consistency and asymptotic normality of maximum quasi-likelihood estimator （MQLE） in quasi-likelihood nonlinear models （QLNM） with random regressors. The asymptotic results of generalized linear models （GLM） with random regressors are generalized to QLNM with random regressors.展开更多
Maximum entropy likelihood (MEEL) methods also known as exponential tilted empirical likelihood methods using constraints from model Laplace transforms (LT) are introduced in this paper. An estimate of overall loss of...Maximum entropy likelihood (MEEL) methods also known as exponential tilted empirical likelihood methods using constraints from model Laplace transforms (LT) are introduced in this paper. An estimate of overall loss of efficiency based on Fourier cosine series expansion of the density function is proposed to quantify the loss of efficiency when using MEEL methods. Penalty function methods are suggested for numerical implementation of the MEEL methods. The methods can easily be adapted to estimate continuous distribution with support on the real line encountered in finance by using constraints based on the model generating function instead of LT.展开更多
There has been a considerable recent attention in modeling over dispersed binomial data occurring in toxicology, biology, clinical medicine, epidemiology and other similar fields using a class of Binomial mixture dist...There has been a considerable recent attention in modeling over dispersed binomial data occurring in toxicology, biology, clinical medicine, epidemiology and other similar fields using a class of Binomial mixture distribution such as Beta Binomial distribution (BB) and Kumaraswamy-Binomial distribution (KB). A new three-parameter binomial mixture distribution namely, McDonald Generalized Beta Binomial (McGBB) distribution has been developed which is superior to KB and BB since studies have shown that it gives a better fit than the KB and BB distribution on both real life data set and on the extended simulation study in handling over dispersed binomial data. The dispersion parameter will be treated as nuisance in the analysis of proportions since our interest is in the parameters of McGBB distribution. In this paper, we consider estimation of parameters of this MCGBB model using Quasi-likelihood (QL) and Quadratic estimating functions (QEEs) with dispersion. By varying the coefficients of the QEE’s we obtain four sets of estimating equations which in turn yield four sets of estimates. We compare small sample relative efficiencies of the estimates based on QEEs and quasi-likelihood with the maximum likelihood estimates. The comparison is performed using real life data sets arising from alcohol consumption practices and simulated data. These comparisons show that estimates based on optimal QEEs and QL are highly efficient and are the best among all estimates investigated.展开更多
Various models have been proposed in the literature to study non-negative integer-valued time series. In this paper, we study estimators for the generalized Poisson autoregressive process of order 1, a model developed...Various models have been proposed in the literature to study non-negative integer-valued time series. In this paper, we study estimators for the generalized Poisson autoregressive process of order 1, a model developed by Alzaid and Al-Osh [1]. We compare three estimation methods, the methods of moments, quasi-likelihood and conditional maximum likelihood and study their asymptotic properties. To compare the bias of the estimators in small samples, we perform a simulation study for various parameter values. Using the theory of estimating equations, we obtain expressions for the variance-covariance matrices of those three estimators, and we compare their asymptotic efficiency. Finally, we apply the methods derived in the paper to a real time series.展开更多
In generalized linear models with fixed design, under the assumption λ↑_n→∞ and other regularity conditions, the asymptotic normality of maximum quasi-likelihood estimator ^↑βn, which is the root of the quasi-li...In generalized linear models with fixed design, under the assumption λ↑_n→∞ and other regularity conditions, the asymptotic normality of maximum quasi-likelihood estimator ^↑βn, which is the root of the quasi-likelihood equation with natural link function ∑i=1^n Xi（yi -μ（Xi′β）） = 0, is obtained, where λ↑_n denotes the minimum eigenvalue of ∑i=1^nXiXi′, Xi are bounded p × q regressors, and yi are q × 1 responses.展开更多
Asymptotic results are obtained using an approach based on limit theorem results obtained for α-mixing sequences for the class of general spacings (GSP) methods which include the maximum spacings (MSP) method. The MS...Asymptotic results are obtained using an approach based on limit theorem results obtained for α-mixing sequences for the class of general spacings (GSP) methods which include the maximum spacings (MSP) method. The MSP method has been shown to be very useful for estimating parameters for univariate continuous models with a shift at the origin which are often encountered in loss models of actuarial science and extreme models. The MSP estimators have also been shown to be as efficient as maximum likelihood estimators in general and can be used as an alternative method when ML method might have numerical difficulties for some parametric models. Asymptotic properties are presented in a unified way. Robustness results for estimation and parameter testing results which facilitate the applications of the GSP methods are also included and related to quasi-likelihood results.展开更多
Group testing is a method of pooling a number of units together and performing a single test on the resulting group. It is an appealing option when few individual units are thought to be infected leading to reduced co...Group testing is a method of pooling a number of units together and performing a single test on the resulting group. It is an appealing option when few individual units are thought to be infected leading to reduced costs of testing as compared to individually testing the units. Group testing aims to identify the positive groups in all the groups tested or to estimate the proportion of positives (p) in a population. Interval estimation methods of the proportions in group testing for unequal group sizes adjusted for overdispersion have been examined. Lately improvement in statistical methods allows the construction of highly accurate confidence intervals (CIs). The aim here is to apply group testing for estimation and generate highly accurate Bootstrap confidence intervals (CIs) for the proportion of defective or positive units in particular. This study provided a comparison of several proven methods of constructing CIs for a binomial proportion after adjusting for overdispersion in group testing with groups of unequal sizes. Bootstrap resampling was applied on data simulated from binomial distribution, and confidence intervals with high coverage probabilities were produced. This data was assumed to be overdispersed and independent between groups but correlated within these groups. Interval estimation methods based on the Wald, the Logit and Complementary log-log (CLL) functions were considered. The criterion used in the comparisons is mainly the coverage probabilities attained by nominal 95% CIs, though interval width is also regarded. Bootstrapping produced CIs with high coverage probabilities for each of the three interval methods.展开更多
In this paper, the estimation of average treatment effects is considered when we have the model information of the conditional mean and conditional variance for the responses given the covariates. The quasi-likelihood...In this paper, the estimation of average treatment effects is considered when we have the model information of the conditional mean and conditional variance for the responses given the covariates. The quasi-likelihood method adapted to treatment effects data is developed to estimate the parameters in the conditional mean and conditional variance models. Based on the model information, we define three estimators by imputation, regression and inverse probability weighted methods. All the estimators are shown asymptotically normal. Our simulation results show that by using the model information, the substantial efficiency gains are obtained which are comparable with the existing estimators.展开更多
The generalized estimating equations(GEE) approach is perhaps one of the most widely used methods for longitudinal data analysis. While the GEE method guarantees the consistency of its estimators under working correla...The generalized estimating equations(GEE) approach is perhaps one of the most widely used methods for longitudinal data analysis. While the GEE method guarantees the consistency of its estimators under working correlation structure misspecification, the corresponding efficiency can be severely affected. In this paper, we propose a new two-step estimation method in which the correlation matrix is assumed to be a linear combination of some known working matrices. Asymptotic properties of the new estimators are developed.Simulation studies are conducted to examine the performance of the proposed estimators. We illustrate the methodology with an epileptic data set.展开更多
The selection of fixed effects is studied in high-dimensional generalized linear mixed models(HDGLMMs)without parametric distributional assumptions except for some moment conditions.The iterative-proxy-based penalized...The selection of fixed effects is studied in high-dimensional generalized linear mixed models(HDGLMMs)without parametric distributional assumptions except for some moment conditions.The iterative-proxy-based penalized quasi-likelihood method(IPPQL)is proposed to select the important fixed effects where an iterative proxy matrix of the covariance matrix of the random effects is constructed and the penalized quasi-likelihood is adapted.We establish the model selection consistency with oracle properties even for dimensionality of non-polynomial(NP)order of sample size.Simulation studies show that the proposed procedure works well.Besides,a real data is also analyzed.展开更多
基金This work was supported by the National Natural Science Foundation of China.
文摘Under the assumption that in the generalized linear model (GLM) the expectation of the response variable has a correct specification and some other smooth conditions, it is shown that with probability one the quasi-likelihood equation for the GLM has a solution when the sample size n is sufficiently large. The rate of this solution tending to the true value is determined. In an important special case, this rate is the same as specified in the LIL for iid partial sums and thus cannot be improved anymore.
基金supported by the National Natural Science Foundation of China(Grant No.10471136)Ph.D.Program Foundation of Ministry of Education of China and Special Foundation of the Chinese Academy of Science and USTC.
文摘In a generalized linear model with q x 1 responses, the bounded and fixed (or adaptive) p × q regressors Zi and the general link function, under the most general assumption on the minimum eigenvalue of ZiZ'i,the moment condition on responses as weak as possible and the other mild regular conditions, we prove that the maximum quasi-likelihood estimates for the regression parameter vector are asymptotically normal and strongly consistent.
基金This work was partially supported by the National Natural Science Foundation of China(Grant Nos.10171094&10471136)Ph.D.Program Foundation of Ministry of Education of ChinaSpecial Foundations of the Chinese Academy of Science and USTC.
文摘In a generalized linear model with q×1 responses, bounded and fixed p×q regressors zi and general link function, under the most general assumption on the minimum eigenvalue of ∑in=1 ZiZi', the moment condition on responses as weak as possible and other mild regular conditions, we prove that with probability one, the quasi-likelihood equation has a solution βn for all large sample size n, which converges to the true regression parameter β0. This result is an essential improvement over the relevant results in literature.
基金Supported by the National Natural Sciences Foundation of China (10761011)Mathematical Tianyuan Fund of National Natural Science Fundation of China(10626048)
文摘Quasi-likelihood nonlinear models （QLNM） include generalized linear models as a special case. Under some regularity conditions, the rate of the strong consistency of the maximum quasi-likelihood estimation （MQLE） is obtained in QLNM. In an important case, this rate is O（n-^1/2（loglogn）^1/2）, which is just the rate of LIL of partial sums for i.i.d variables, and thus cannot be improved anymore.
基金the Natural Science Foundation of Yunnan University （No. 2005Z007C） the Scientific Research Fund of Yunnan Provincial Education Department （No. 5Y0062A）+1 种基金 Mathematical Tianyuan Fund of National Natural Science Foundation of China （No. 10626048） Special Foundation for Middle and Young Excellent Teachers of Yunnan University.
文摘This paper proposes some regularity conditions. On the basis of the proposed regularity conditions, we show the strong consistency of maximum quasi-likelihood estimation （MQLE） in quasi-likelihood nonlinear models （QLNM）. Our results may be regarded as a further generalization of the relevant results in Ref. [4].
基金Supported by National Natural Science Foundation of China (No. 10761011,10671139,10901135)Natural Science Foundation of Yunnan Province(No. 2008CD081)Special Foundation for Middle and Young Excellent Teachers of Yunnan University
文摘This paper proposes some regularity conditions, which result in the existence, strong consistency and asymptotic normality of maximum quasi-likelihood estimator （MQLE） in quasi-likelihood nonlinear models （QLNM） with random regressors. The asymptotic results of generalized linear models （GLM） with random regressors are generalized to QLNM with random regressors.
文摘Maximum entropy likelihood (MEEL) methods also known as exponential tilted empirical likelihood methods using constraints from model Laplace transforms (LT) are introduced in this paper. An estimate of overall loss of efficiency based on Fourier cosine series expansion of the density function is proposed to quantify the loss of efficiency when using MEEL methods. Penalty function methods are suggested for numerical implementation of the MEEL methods. The methods can easily be adapted to estimate continuous distribution with support on the real line encountered in finance by using constraints based on the model generating function instead of LT.
文摘There has been a considerable recent attention in modeling over dispersed binomial data occurring in toxicology, biology, clinical medicine, epidemiology and other similar fields using a class of Binomial mixture distribution such as Beta Binomial distribution (BB) and Kumaraswamy-Binomial distribution (KB). A new three-parameter binomial mixture distribution namely, McDonald Generalized Beta Binomial (McGBB) distribution has been developed which is superior to KB and BB since studies have shown that it gives a better fit than the KB and BB distribution on both real life data set and on the extended simulation study in handling over dispersed binomial data. The dispersion parameter will be treated as nuisance in the analysis of proportions since our interest is in the parameters of McGBB distribution. In this paper, we consider estimation of parameters of this MCGBB model using Quasi-likelihood (QL) and Quadratic estimating functions (QEEs) with dispersion. By varying the coefficients of the QEE’s we obtain four sets of estimating equations which in turn yield four sets of estimates. We compare small sample relative efficiencies of the estimates based on QEEs and quasi-likelihood with the maximum likelihood estimates. The comparison is performed using real life data sets arising from alcohol consumption practices and simulated data. These comparisons show that estimates based on optimal QEEs and QL are highly efficient and are the best among all estimates investigated.
文摘Various models have been proposed in the literature to study non-negative integer-valued time series. In this paper, we study estimators for the generalized Poisson autoregressive process of order 1, a model developed by Alzaid and Al-Osh [1]. We compare three estimation methods, the methods of moments, quasi-likelihood and conditional maximum likelihood and study their asymptotic properties. To compare the bias of the estimators in small samples, we perform a simulation study for various parameter values. Using the theory of estimating equations, we obtain expressions for the variance-covariance matrices of those three estimators, and we compare their asymptotic efficiency. Finally, we apply the methods derived in the paper to a real time series.
基金the National Natural Science Foundation of China under Grant Nos.10171094,10571001,and 30572285the Foundation of Nanjing Normal University under Grant No.2005101XGQ2B84+1 种基金the Natural Science Foundation of the Jiangsu Higher Education Institutions of China under Grant No.07KJD110093the Foundation of Anhui University under Grant No.02203105
文摘In generalized linear models with fixed design, under the assumption λ↑_n→∞ and other regularity conditions, the asymptotic normality of maximum quasi-likelihood estimator ^↑βn, which is the root of the quasi-likelihood equation with natural link function ∑i=1^n Xi（yi -μ（Xi′β）） = 0, is obtained, where λ↑_n denotes the minimum eigenvalue of ∑i=1^nXiXi′, Xi are bounded p × q regressors, and yi are q × 1 responses.
文摘Asymptotic results are obtained using an approach based on limit theorem results obtained for α-mixing sequences for the class of general spacings (GSP) methods which include the maximum spacings (MSP) method. The MSP method has been shown to be very useful for estimating parameters for univariate continuous models with a shift at the origin which are often encountered in loss models of actuarial science and extreme models. The MSP estimators have also been shown to be as efficient as maximum likelihood estimators in general and can be used as an alternative method when ML method might have numerical difficulties for some parametric models. Asymptotic properties are presented in a unified way. Robustness results for estimation and parameter testing results which facilitate the applications of the GSP methods are also included and related to quasi-likelihood results.
文摘Group testing is a method of pooling a number of units together and performing a single test on the resulting group. It is an appealing option when few individual units are thought to be infected leading to reduced costs of testing as compared to individually testing the units. Group testing aims to identify the positive groups in all the groups tested or to estimate the proportion of positives (p) in a population. Interval estimation methods of the proportions in group testing for unequal group sizes adjusted for overdispersion have been examined. Lately improvement in statistical methods allows the construction of highly accurate confidence intervals (CIs). The aim here is to apply group testing for estimation and generate highly accurate Bootstrap confidence intervals (CIs) for the proportion of defective or positive units in particular. This study provided a comparison of several proven methods of constructing CIs for a binomial proportion after adjusting for overdispersion in group testing with groups of unequal sizes. Bootstrap resampling was applied on data simulated from binomial distribution, and confidence intervals with high coverage probabilities were produced. This data was assumed to be overdispersed and independent between groups but correlated within these groups. Interval estimation methods based on the Wald, the Logit and Complementary log-log (CLL) functions were considered. The criterion used in the comparisons is mainly the coverage probabilities attained by nominal 95% CIs, though interval width is also regarded. Bootstrapping produced CIs with high coverage probabilities for each of the three interval methods.
文摘In this paper, the estimation of average treatment effects is considered when we have the model information of the conditional mean and conditional variance for the responses given the covariates. The quasi-likelihood method adapted to treatment effects data is developed to estimate the parameters in the conditional mean and conditional variance models. Based on the model information, we define three estimators by imputation, regression and inverse probability weighted methods. All the estimators are shown asymptotically normal. Our simulation results show that by using the model information, the substantial efficiency gains are obtained which are comparable with the existing estimators.
基金Supported by the National Natural Science Foundation of China(No.11471068)
文摘The generalized estimating equations(GEE) approach is perhaps one of the most widely used methods for longitudinal data analysis. While the GEE method guarantees the consistency of its estimators under working correlation structure misspecification, the corresponding efficiency can be severely affected. In this paper, we propose a new two-step estimation method in which the correlation matrix is assumed to be a linear combination of some known working matrices. Asymptotic properties of the new estimators are developed.Simulation studies are conducted to examine the performance of the proposed estimators. We illustrate the methodology with an epileptic data set.
基金Supported by National Natural Science Foundation of China(Grant No.11671398)State Key Lab of Coal Resources and Safe Mining(China University of Mining and Technology)(Grant No.SKLCRSM16KFB03)the Fundamental Research Funds for the Central Universities in China(Grant No.2009QS02)。
文摘The selection of fixed effects is studied in high-dimensional generalized linear mixed models(HDGLMMs)without parametric distributional assumptions except for some moment conditions.The iterative-proxy-based penalized quasi-likelihood method(IPPQL)is proposed to select the important fixed effects where an iterative proxy matrix of the covariance matrix of the random effects is constructed and the penalized quasi-likelihood is adapted.We establish the model selection consistency with oracle properties even for dimensionality of non-polynomial(NP)order of sample size.Simulation studies show that the proposed procedure works well.Besides,a real data is also analyzed.
