Robust Weighted Least Squares Method using different schemes of M-estimators (RWLSM), A comparative Study
Abstract
In this research, it was reducing or excluding the effect of not satisfying the assumption of normal distribution of the data, due to the presence of types of outlying values in it when we wish to choose the best regression equation by robust methods, and this was achieved by introducing weights from the robust methods in the estimate and testing their robustness and suitability for the model in advance, And then selecting the weights resulting from the highest efficient robust methods and introducing these weights in the stages of selecting best regression equation, which results in a model that achieves two characteristics at the same time, which are robustness and reducing dimensions in return for increasing efficiency.The simulation approach was used on models with different dimensions, different sample sizes, and different contamination rates in the dependent variable once, in the independent variables again, and in both together, with a focus on studying the possible impact of the presence of outliers on the variables that will remain in the model and the variables that will be deleted. .To achieve the idea of the paper, a number of robust estimation methods were studied, and the results were compared with the ordinary least squares method (OLS) and the robust adaptive LASSO method on experimental data using simulation, as well as on data for a sample of thalassemia patients in Nineveh province..
References
- Al-Nuaimi, A. M. (2005). "Variable Selection in Ridge Regression", Un-Published MSc. Thesis, Faculty of Computer Science and Mathematics, University of Mosul Iraq.
- Al-Subaihi, Ali, A. (2004). " Variable Selection in Multivariable's Regression Using SAS/IML ", Institute of Public Admin station, Saudi Arabia.
- Arif, A. L. (2012). "Using Types of Robust Regression to Deal with Outying Values in Simple Linear Regression", Dhi Qar Journal of Agricultural Research, College of Science - Dhi Qar University, Iraq, 1 (2) , PP 93-103.
- Beaton, A.E., and Tukey, W., (1974)."The Fitting of Power series Meaning Polynomials, Illustrated on band Spectroscopic Data", Techno metrics, 16, PP 147 185.
- Croux, C. Rousseeuw, P. J. and Hossjer, O. (1994)." Generalized S-Estimators" Journal of the American Statistical Association , 89(428), pp.1271-1281.
- Grubbs,F.E.(1969)."Procedures for Detecting Outlying observation", Technimetrics.
- Hasan, T. A. and Ridha, M. S. (2011). "Using Robust Regression to Find the Most Appropriate Model to Represent Meteorological Data in the City of Erbil during (1998-2010)", Journal of Administration and Economics, thirty four years, 39 year, Issue: 39.
- Huber,P.J. (1964)."Robust Estimation of location parameter".Ann .math .stat.35, PP 73-101.
- Huber,P.J.(1973). "Robust estimation of location parameter ", Annals of Mathematical Statistics, 35: 73-101.
- Hurn , D. and Mirosevich , V. , (2008) . "Modern Robust Statistical Methods" , The American Psychologist Association , Vol. 63, No. 7, PP. 591601.
- Montgomery D. C., Peck E. A., and Vining G. C. (2001). " Introduction to Linear Regression Analyses", 3rd ed., New york: John Wiley&Sons Inc, Library of congress, U.S.A.
- Rousseeuw P.J. and Yohai V.J. (1984). "Robust regression by means of S-estimators. in Robust and Nonlinear Time Series Analysis", eds. J. Franke. W. Hrdle and R.D. Martin. Lecture Notes in Statistics 26, New york: Springer Verlag. <ftp://ftp.win.ua.ac.be/pub/preprints/84/ Robreg84.pdf>
- Rousseeuw, P. J .and Leroy, A. M. (1987). Robust Regression and Outlier Detection, Wiley- Interscience , New York (series in Applied probability and statistics) , 329 Pages . ISBNO-471-852333.
- Toka, O., etin, M., and Arslan, O. (2021). "Robust regression estimation and variable selection when cellwise and casewise outliers are present" ,Hacettepe Journal ,Volume 50 (1), 289 303.
- Uraibi , H. S. , Talib , B. A. , and Yousif , J. H. , (2009)."Linear Regression Model Selection Based on Robust Bootstrapping Technique" , American Journal of Applied Sciences , 6 (6), PP.1191-1198.
- Wang, X., Yunlu J., Mian H., and Heping Z. (2013). Robust Variable Selection with Exponential Squared Loss.Journal of the American Statistical Association108(502):6323.https://doi.org/10.1080/01621459.2013.766613.
- Zou, H. (2006). The Adaptive Lasso and Its Oracle Properties.Journal of the American Statistical Association101 (476): 141829.https://doi.org/10.1198/016214506000000735.