Effective hybrid feature selection using different bootstrap enhances cancers classification performance

Abdelwahed, Noura Mohammed; El-Tawel, Gh. S.; Makhlouf, M. A.

doi:10.1186/s13040-022-00304-y

BioData Mining

Table 4 Average results after applying OFBS-RFS-RFE after 20 runs

From: Effective hybrid feature selection using different bootstrap enhances cancers classification performance

Algo.	Train Data %	Test Data %	Over-fitting Diff. %	Pre	Rec	F1-score	No.F	F-Time (sec)	C-Time (sec)	AUC	Var.	ACC %
RNA gene dataset
LR classifier
OFBS-RFS	100.000	99.944	0.056	1.000	0.999	1.000	379.100	9.537	0.296	1.000	0.000003	99.944
OFBS-RFS-RFE	100.000	99.981	0.019	1.000	1.000	1.000	142.500	189.35	0.445	1.000	0.0000004	99.981
SVM classifier
OFBS-RFS	100.000	99.945	0.055	1.000	0.999	1.000	379.100	9.537	0.296	1.000	0.000003	99.945
OFBS-RFS-RFE	100.000	95.038	4.962	1.000	0.961	1.000	142.500	189.35	0.192	1.000	0.0000002	95.038
RF classifier
OFBS-RFS	100.000	99.875	0.125	0.999	0.999	0.999	379.100	9.537	1.007	0.999	0.000013	99.875
OFBS-RFS-RFE	100.000	99.925	0.075	1.000	0.999	0.999	142.500	189.35	0.807	0.999	0.000005	99.925
Bagg classifier
OFBS-RFS	99.967	99.439	0.528	0.995	0.994	0.994	379.100	9.537	0.912	0.999	0.000074	99.439
OFBS-RFS-RFE	99.972	99.513	0.459	0.996	0.995	0.995	142.500	189.35	0.4482	0.999	0.000063	99.513
DNA CNV dataset
LR classifier
OFBS-RFS	93.838	90.857	2.981	0.914	0.875	0.888	1351	5.435	5.620	0.981	0.00138	90.857
OFBS-RFS-RFE	93.462	91.020	2.442	0.919	0.875	0.887	675.000	2755	2.637	0.983	0.00028	91.020
SVM classifier
OFBS-RFS	94.248	90.980	3.268	0.923	0.873	0.890	1351	5.435	27.316	0.981	0.00012	90.980
OFBS-RFS-RFE	94.248	90.980	3.268	0.923	0.873	0.890	675.000	2755	27.316	0.981	0.00048	90.980
RF classifier
OFBS-RFS	90.966	86.613	4.353	0.918	0.834	0.888	1351	5.435	2.934	0.985	0.00021	86.613
OFBS-RFS-RFE	95.687	91.265	4.421	0.921	0.875	0.890	675.000	2755	2.147	0.986	0.00074	91.265
Bagg classifier
OFBS-RFS	98.622	92.971	5.651	0.927	0.907	0.916	1351	5.435	9.080	0.929	0.00024	92.971
OFBS-RFS-RFE	95.525	92.762	2.763	0.925	0.910	0.912	675.000	2755	4.502	0.981	0.00023	92.762
Parkinson’s disease dataset
LR classifier
OFBS-RFS	78.453	77.864	0.589	0.737	0.602	0.605	228.150	1.704	0.128	0.736	0.00103	77.864
OFBS-RFS-RFE	77.050	72.740	4.310	0.700	0.556	0.579	113.850	11.213	0.149	0.705	0.00093	72.740
SVM classifier
OFBS-RFS	76.109	75.624	0.485	0.623	0.543	0.512	228.150	1.704	0.644	0.643	0.00043	75.624
OFBS-RFS-RFE	76.003	75.499	0.504	0.617	0.541	0.509	113.850	11.214	0.496	0.638	0.00041	75.499
RF classifier
OFBS-RFS	100.000	94.634	5.366	0.948	0.910	0.926	228.150	1.704	1.434	0.986	0.00064	94.634
OFBS-RFS-RFE	100.000	95.000	5.000	0.945	0.906	0.922	113.850	11.214	1.134	0.985	0.00062	95.000
Bagg classifier
OFBS-RFS	99.719	93.163	6.556	0.917	0.904	0.908	228.150	1.704	1.790	0.966	0.00092	93.163
OFBS-RFS-RFE	99.735	93.008	6.727	0.916	0.901	0.906	113.850	11.214	0.820	0.966	0.00078	93.008
Dermatology erythemato-squamous diseases dataset
LR classifier
OFBS-RFS	96.023	95.037	0.986	0.926	0.912	0.907	18.625	0.216	0.014	0.995	0.000190	95.037
OFBS-RFS-RFE	97.241	96.481	0.760	0.932	0.934	0.926	16.000	0.203	0.517	0.997	0.000730	96.481
SVM classifier
OFBS-RFS	79.269	78.375	0.894	0.672	0.708	0.668	18.625	0.216	0.169	0.973	0.002590	78.375
OFBS-RFS-RFE	99.484	98.940	0.544	0.988	0.986	0.984	16.000	0.203	0.064	0.998	0.000368	98.940
RF classifier
OFBS-RFS	100.000	100.000	0.0	1.000	1.000	1.000	18.625	0.216	0.562	1.000	0.0	100.000
OFBS-RFS-RFE	100.000	100.000	0.0	1.000	1.000	1.000	16.000	0.203	0.500	1.000	0.0	100.000
Bagg classifier
OFBS-RFS	99.970	99.730	0.240	0.997	0.995	0.996	18.625	0.216	0.077	0.997	0.000057	99.730
OFBS-RFS-RFE	99.966	99.796	0.170	0.998	0.995	0.996	16.000	0.203	0.242	0.998	0.000055	99.796
BreastEW dataset
LR classifier
OFBS-RFS	94.776	94.218	0.558	0.922	0.933	0.937	27.100	0.298	0.012	0.988	0.000001	94.218
OFBS-RFS-RFE	95.069	94.587	0.482	0.947	0.939	0.941	13.316	0.130	0.091	0.989	0.000810	94.587
SVM classifier
OFBS-RFS	92.167	91.902	0.266	0.934	0.897	0.909	27.100	0.298	0.076	0.978	0.000986	91.902
OFBS-RFS-RFE	93.301	93.114	0.187	0.913	0.914	0.927	13.316	0.130	0.070	0.982	0.001115	93.114
RF classifier
OFBS-RFS	100.000	97.864	2.136	0.984	0.981	0.979	27.100	0.298	0.506	0.997	0.000270	97.864
OFBS-RFS-RFE	100.000	98.000	2.000	0.983	0.979	0.982	13.316	0.130	0.428	0.997	0.000300	98.000
Bagg classifier
OFBS-RFS	99.889	97.548	2.341	0.977	0.972	0.974	27.100	0.298	0.101	0.949	0.000280	97.548
OFBS-RFS-RFE	99.888	97.724	2.164	0.978	0.974	0.976	13.316	0.130	0.104	0.948	0.000430	97.724

Back to article page

ISSN: 1756-0381

Contact us

General enquiries: journalsubmissions@springernature.com