AIRCC's International Journal of Computer Science and Information Technology

Open Access Open Access  Restricted Access Subscription Access

Enactment Ranking of Supervised Algorithms Dependence of Data Splitting Algorithms:A Case Study of Real Datasets


Affiliations
1 Department of Statistics, Bahauddin Zakariya University, Multan, Pakistan
 

We conducted comparative analysis of different supervised dimension reduction techniques by integrating a set of different data splitting algorithms and demonstrate the relative efficacy of learning algorithms dependence of sample complexity. The issue of sample complexity discussed in the dependence of data splitting algorithms. In line with the expectations, every supervised learning classifier demonstrated different capability for different data splitting algorithms and no way to calculate overall ranking of techniques was directly available. We specifically focused the classifier ranking dependence of data splitting algorithms and devised a model built on weighted average rank Weighted Mean Rank Risk Adjusted Model (WMRRAM) for consent ranking of learning classifier algorithms.

Keywords

Supervised Learning Algorithms, Data Splitting Algorithms, Ranking, Weighted Mean Rank Risk-Adjusted Model..
User
Notifications
Font Size

  • K. K. Dobbin and R. M. Simon, "Optimally splitting cases for training and testing high dimensional classifiers," Dobbin and Simon BMC Medical Genomics vol. 4, no. 31, pp. 1-8, 2011.

  • R. Kohavi, "A Study of CrossValidation and Bootstrap for Accuracy Estimation and Model Selecti," presented at the International Joint Conference on Articial Intelligence IJCA, 1995.

  • J. Awwalu and O. F. Nonyelum, "On Holdout and Cross Validation A Comparison between Neural Network and Support Vector Machine " International Journal of Trend in Research and Development, vol. 6, no. 2, pp. 235-239, 2019.

  • Z. Reitermanov´a, "Data Splitting," 2010.

  • Y. Xu and R. Goodacre, "On Splitting Training and Validation Set: A Comparative Study of Cross‑Validation, Bootstrap and Systematic Sampling for Estimating the Generalization Performance of Supervised Learning," Journal of Analysis and Testing, vol. 2, pp. 249–262 2018.

  • CatherineChampagne, HeatherMcNairn, B. Daneshfar, and J. Shang, "A bootstrap method for assessing classification accuracy and confidence for agricultural land use mapping in Canada," International Journal of Applied Earth Observation and Geoinformation, vol. 29, pp. 44-52, 2014 .

  • AgapitoLedezma, RicardoAler, AraceliSanchis, and DanielBorrajo, "GA-stacking: Evolutionarystacked generalization," Intelligent Data Analysis pp. 1-31, 2010, doi: 10.3233/IDA-2010-0410.

  • A. Gosavi, "Analyzing Responses from Likert Surveys and Risk-adjusted Ranking: A Data Analytics Perspective," Procedia Computer Science, vol. 61, pp. 24-31, 2015, doi: doi.org/10.1016/j.procs.2015.09.139.

  • S. M. Abdulrahman, P. Brazdil, J. N. v. Rijn, and J. Vanschoren, "Speeding up algorithm selection using average ranking and active testing by introducing runtime," Machine Learning volume, vol. 107, pp. 79-108, 2017, doi: doi.org/10.1007/s10994-017-5687-8


Abstract Views: 330

PDF Views: 135




  • Enactment Ranking of Supervised Algorithms Dependence of Data Splitting Algorithms:A Case Study of Real Datasets

Abstract Views: 330  |  PDF Views: 135

Authors

Hina Tabassum
Department of Statistics, Bahauddin Zakariya University, Multan, Pakistan
Muhammad Mutahir Iqbal
Department of Statistics, Bahauddin Zakariya University, Multan, Pakistan

Abstract


We conducted comparative analysis of different supervised dimension reduction techniques by integrating a set of different data splitting algorithms and demonstrate the relative efficacy of learning algorithms dependence of sample complexity. The issue of sample complexity discussed in the dependence of data splitting algorithms. In line with the expectations, every supervised learning classifier demonstrated different capability for different data splitting algorithms and no way to calculate overall ranking of techniques was directly available. We specifically focused the classifier ranking dependence of data splitting algorithms and devised a model built on weighted average rank Weighted Mean Rank Risk Adjusted Model (WMRRAM) for consent ranking of learning classifier algorithms.

Keywords


Supervised Learning Algorithms, Data Splitting Algorithms, Ranking, Weighted Mean Rank Risk-Adjusted Model..

References