Table 3: Open in new tab Benchmark... | Oxford Academic

Table 3:

Open in new tab

Benchmark scores on 11 different datasets.

	Our IAL-KD			IAL-KD (early stop)			Old Model			Retraining
Classification	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy
Adult	25.55	35.41	85.53%	5	10.18	85.54%†	24.14	33.84	85.01%	23.64	32.35	85.51%
Higgs Small	21.19	88.59	72.09%†	5	30.24	71.75%	32.94	90.15	71.84%	30.42	95.53	71.97%
EPSILON	24.27	326.08	89.45%	5	73.90	89.46%†	26.52	338.43	89.45%	27.23	335.55	89.45%
Helena	19.66	23.23	37.48%	5	5.78	37.34%	27.59	35.55	37.49%†	22.91	36.97	36.28%
Jannis	59.14	67.11	71.74%†	5	8.77	70.64%	60.45	63.37	71.55%	60.41	62.40	71.62%
ALOI	22.25	195.38	96.03%	5	57.76	96.62%†	43.16	357.17	94.29%	43.49	384.29	94.96%
Covtype	121.24	2429	96.30%†	5	227.70	90.08%	122.56	2402	96.23%	122.42	2433	96.29%
CLS_AVG	41.9	452.11	78.37%†	5	59.19	77.35%	48.19	474.36	77.98%	47.22	482.87	78.01%
Regression	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE
Cal Housing	35.0	18.97	0.5512†	5	4.02	0.6485	34.10	18.11	0.5829	32.90	18.32	0.5557
YEAR	21.53	237.07	8.84	5	60.20	8.78†	29.97	292.97	8.89	29.07	286.64	8.86
Yahoo	21.45	1042.06	0.7673	5	353.63	0.7715	29.69	1417.76	0.7672	30.93	1378.10	0.7672†
Microsoft	27.43	1238.79	0.7581†	5	317.42	0.7610	34.27	1324.55	0.7584	33.71	1399.40	0.7585
REG_AVG	26.35	634.22	2.7292†	5	183.82	2.7402	32.01	763.35	2.7496	31.65	770.62	2.7354

	Our IAL-KD			IAL-KD (early stop)			Old Model			Retraining
Classification	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy
Adult	25.55	35.41	85.53%	5	10.18	85.54%†	24.14	33.84	85.01%	23.64	32.35	85.51%
Higgs Small	21.19	88.59	72.09%†	5	30.24	71.75%	32.94	90.15	71.84%	30.42	95.53	71.97%
EPSILON	24.27	326.08	89.45%	5	73.90	89.46%†	26.52	338.43	89.45%	27.23	335.55	89.45%
Helena	19.66	23.23	37.48%	5	5.78	37.34%	27.59	35.55	37.49%†	22.91	36.97	36.28%
Jannis	59.14	67.11	71.74%†	5	8.77	70.64%	60.45	63.37	71.55%	60.41	62.40	71.62%
ALOI	22.25	195.38	96.03%	5	57.76	96.62%†	43.16	357.17	94.29%	43.49	384.29	94.96%
Covtype	121.24	2429	96.30%†	5	227.70	90.08%	122.56	2402	96.23%	122.42	2433	96.29%
CLS_AVG	41.9	452.11	78.37%†	5	59.19	77.35%	48.19	474.36	77.98%	47.22	482.87	78.01%
Regression	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE
Cal Housing	35.0	18.97	0.5512†	5	4.02	0.6485	34.10	18.11	0.5829	32.90	18.32	0.5557
YEAR	21.53	237.07	8.84	5	60.20	8.78†	29.97	292.97	8.89	29.07	286.64	8.86
Yahoo	21.45	1042.06	0.7673	5	353.63	0.7715	29.69	1417.76	0.7672	30.93	1378.10	0.7672†
Microsoft	27.43	1238.79	0.7581†	5	317.42	0.7610	34.27	1324.55	0.7584	33.71	1399.40	0.7585
REG_AVG	26.35	634.22	2.7292†	5	183.82	2.7402	32.01	763.35	2.7496	31.65	770.62	2.7354

† is the best-performing model

Table 3:

Open in new tab

Benchmark scores on 11 different datasets.

	Our IAL-KD			IAL-KD (early stop)			Old Model			Retraining
Classification	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy
Adult	25.55	35.41	85.53%	5	10.18	85.54%†	24.14	33.84	85.01%	23.64	32.35	85.51%
Higgs Small	21.19	88.59	72.09%†	5	30.24	71.75%	32.94	90.15	71.84%	30.42	95.53	71.97%
EPSILON	24.27	326.08	89.45%	5	73.90	89.46%†	26.52	338.43	89.45%	27.23	335.55	89.45%
Helena	19.66	23.23	37.48%	5	5.78	37.34%	27.59	35.55	37.49%†	22.91	36.97	36.28%
Jannis	59.14	67.11	71.74%†	5	8.77	70.64%	60.45	63.37	71.55%	60.41	62.40	71.62%
ALOI	22.25	195.38	96.03%	5	57.76	96.62%†	43.16	357.17	94.29%	43.49	384.29	94.96%
Covtype	121.24	2429	96.30%†	5	227.70	90.08%	122.56	2402	96.23%	122.42	2433	96.29%
CLS_AVG	41.9	452.11	78.37%†	5	59.19	77.35%	48.19	474.36	77.98%	47.22	482.87	78.01%
Regression	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE
Cal Housing	35.0	18.97	0.5512†	5	4.02	0.6485	34.10	18.11	0.5829	32.90	18.32	0.5557
YEAR	21.53	237.07	8.84	5	60.20	8.78†	29.97	292.97	8.89	29.07	286.64	8.86
Yahoo	21.45	1042.06	0.7673	5	353.63	0.7715	29.69	1417.76	0.7672	30.93	1378.10	0.7672†
Microsoft	27.43	1238.79	0.7581†	5	317.42	0.7610	34.27	1324.55	0.7584	33.71	1399.40	0.7585
REG_AVG	26.35	634.22	2.7292†	5	183.82	2.7402	32.01	763.35	2.7496	31.65	770.62	2.7354

	Our IAL-KD			IAL-KD (early stop)			Old Model			Retraining
Classification	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy	Epoch	Time(s)	Accuracy
Adult	25.55	35.41	85.53%	5	10.18	85.54%†	24.14	33.84	85.01%	23.64	32.35	85.51%
Higgs Small	21.19	88.59	72.09%†	5	30.24	71.75%	32.94	90.15	71.84%	30.42	95.53	71.97%
EPSILON	24.27	326.08	89.45%	5	73.90	89.46%†	26.52	338.43	89.45%	27.23	335.55	89.45%
Helena	19.66	23.23	37.48%	5	5.78	37.34%	27.59	35.55	37.49%†	22.91	36.97	36.28%
Jannis	59.14	67.11	71.74%†	5	8.77	70.64%	60.45	63.37	71.55%	60.41	62.40	71.62%
ALOI	22.25	195.38	96.03%	5	57.76	96.62%†	43.16	357.17	94.29%	43.49	384.29	94.96%
Covtype	121.24	2429	96.30%†	5	227.70	90.08%	122.56	2402	96.23%	122.42	2433	96.29%
CLS_AVG	41.9	452.11	78.37%†	5	59.19	77.35%	48.19	474.36	77.98%	47.22	482.87	78.01%
Regression	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE	Epoch	Time(s)	RMSE
Cal Housing	35.0	18.97	0.5512†	5	4.02	0.6485	34.10	18.11	0.5829	32.90	18.32	0.5557
YEAR	21.53	237.07	8.84	5	60.20	8.78†	29.97	292.97	8.89	29.07	286.64	8.86
Yahoo	21.45	1042.06	0.7673	5	353.63	0.7715	29.69	1417.76	0.7672	30.93	1378.10	0.7672†
Microsoft	27.43	1238.79	0.7581†	5	317.42	0.7610	34.27	1324.55	0.7584	33.71	1399.40	0.7585
REG_AVG	26.35	634.22	2.7292†	5	183.82	2.7402	32.01	763.35	2.7496	31.65	770.62	2.7354

† is the best-performing model