On the robustness of the Olanrewaju-Olanrewaju regression kernel-based to nonparametric kernels for Support Vector Regressor (SVR)

Author(s): Rasaki Olawale Olanrewaju1, Toyin Omoyeni Oguntola2, Lukman Abiodun Nafiu3, Sodiq Adejare Olanrewaju4
1Business Analytics Value Networks (BAVNs), Africa Business School (ABS), Mohammed VI Polytechnic University (UM6P), X4JH+QJR Avenue Mohamed Ben Abdellah Regragui, Rabat 10112, Morocco
2Ladoke Akintola University of Technology, Ogbomoso, Oyo State, Nigeria
3School of Graduates and Research at Metropolitan International University (MIU), Kampala, Uganda
4Department of Statistics, University of Ibadan, Ibadan, University of Ibadan, 900001, Oyo State, Nigeria
Copyright © Rasaki Olawale Olanrewaju, Toyin Omoyeni Oguntola, Lukman Abiodun Nafiu, Sodiq Adejare Olanrewaju. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

{In this article we studied and juxtaposed nonparametric Least Square and the Olanrewaju-Olanrewaju regression-type \({L_{(O – O){\lambda _{\gamma (\left| \theta \right|)}}}}\) kernels for supervised Support Vector Regressor (SVR) machine learning of hyperplane regression in a bivariate setting. The nonparametric kernels used to expound the SVR were Bisquare, Gaussian, Triweight, Uniform, Epanechnikov, and Triangular. Lagrangian multiplier estimation technique was adopted in estimating the involved SVR hyperplane regression coefficients as well as other embedded coefficients in each of the stated kernels. In addition, point estimate of the Euclidean distance (\(r\)) and error margin (\(d\)) in each of the SVR kernels were carved-out. In demonstration to the annual birthrate and its percentage change (\(\Delta \% \)) of the Nigeria populace from 1950 to 2023, the Olanrewaju-Olanrewaju regression-type kernel for SVR robustly outperformed the nonparametric and Least Square kernel-based SVRs with a miniature Cross-Validation index of -1205.49. 5.9% and 3.2% hyperplane estimated regression coefficients from the Olanrewaju-Olanrewaju kernel-based SVR were recorded for the annual birthrate and its percentage change (\(\Delta \% \)) respectively. Interpretably, this connotes that for every one percent increment in the annual birthrate per 1000, the mean rate of the Nigeria populace from 1950 to 2023 increased by 5.9% while other variables were held constant. Similarly, its percentage change per 1000 increased by 3.2% while other variables were held constant. In recommendation, the nonparametric and Olanrewaju-Olanrewaju regression-type SVRs as well as the Least Square SVR were pinpointed for future consideration of categorical, missing and zero bivariate observations.

Keywords: Kernels, Lagrangian Multiplier, Least Square, Olanrewaju-Olanrewaju Regression-Type, Nonparametric Regression, Support Vector Regressor (SVR)