The Wilcoxon signed-rank test for measuring the statistical significance of the performance between different approaches in terms of accuracy, F1, MCC and AUC
| Accuracy . | . | . | . | . | . | ||
|---|---|---|---|---|---|---|---|
| Wilcoxon P-value . | AMAP . | AMPDiscover-RF . | AMPDiscover-RNN . | AMPfun . | iAMP-CA2L . | iAMP-RAAC . | dbAMP . |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.006714 | – | ||
| dbAMP | – | – | – | 0.030151 | – | 0.035339 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| F1 | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.187622 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.106995 | – | ||
| dbAMP | – | – | – | 0.002014 | – | 0.00061 | |
| iAMPCN | 0.000122 | – | – | 6.10E−05 | 0.000122 | 0.000122 | 0.000305 |
| MCC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.008362 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.047913 | |
| iAMPCN | 6.10E−05 | 6.10E−05 | 6.10E−05 | 6.10E−05 | 0.000183 | 6.10E−05 | 6.10E−05 |
| AUC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.072998 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.00116 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| Accuracy . | . | . | . | . | . | ||
|---|---|---|---|---|---|---|---|
| Wilcoxon P-value . | AMAP . | AMPDiscover-RF . | AMPDiscover-RNN . | AMPfun . | iAMP-CA2L . | iAMP-RAAC . | dbAMP . |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.006714 | – | ||
| dbAMP | – | – | – | 0.030151 | – | 0.035339 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| F1 | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.187622 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.106995 | – | ||
| dbAMP | – | – | – | 0.002014 | – | 0.00061 | |
| iAMPCN | 0.000122 | – | – | 6.10E−05 | 0.000122 | 0.000122 | 0.000305 |
| MCC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.008362 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.047913 | |
| iAMPCN | 6.10E−05 | 6.10E−05 | 6.10E−05 | 6.10E−05 | 0.000183 | 6.10E−05 | 6.10E−05 |
| AUC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.072998 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.00116 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
‘–’ means that the number of functional activities that both tools can predict is less than 5.
The Wilcoxon signed-rank test for measuring the statistical significance of the performance between different approaches in terms of accuracy, F1, MCC and AUC
| Accuracy . | . | . | . | . | . | ||
|---|---|---|---|---|---|---|---|
| Wilcoxon P-value . | AMAP . | AMPDiscover-RF . | AMPDiscover-RNN . | AMPfun . | iAMP-CA2L . | iAMP-RAAC . | dbAMP . |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.006714 | – | ||
| dbAMP | – | – | – | 0.030151 | – | 0.035339 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| F1 | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.187622 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.106995 | – | ||
| dbAMP | – | – | – | 0.002014 | – | 0.00061 | |
| iAMPCN | 0.000122 | – | – | 6.10E−05 | 0.000122 | 0.000122 | 0.000305 |
| MCC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.008362 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.047913 | |
| iAMPCN | 6.10E−05 | 6.10E−05 | 6.10E−05 | 6.10E−05 | 0.000183 | 6.10E−05 | 6.10E−05 |
| AUC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.072998 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.00116 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| Accuracy . | . | . | . | . | . | ||
|---|---|---|---|---|---|---|---|
| Wilcoxon P-value . | AMAP . | AMPDiscover-RF . | AMPDiscover-RNN . | AMPfun . | iAMP-CA2L . | iAMP-RAAC . | dbAMP . |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.006714 | – | ||
| dbAMP | – | – | – | 0.030151 | – | 0.035339 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
| F1 | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.187622 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.106995 | – | ||
| dbAMP | – | – | – | 0.002014 | – | 0.00061 | |
| iAMPCN | 0.000122 | – | – | 6.10E−05 | 0.000122 | 0.000122 | 0.000305 |
| MCC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.008362 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.047913 | |
| iAMPCN | 6.10E−05 | 6.10E−05 | 6.10E−05 | 6.10E−05 | 0.000183 | 6.10E−05 | 6.10E−05 |
| AUC | |||||||
| Wilcoxon P-value | AMAP | AMPDiscover-RF | AMPDiscover-RNN | AMPfun | iAMP-CA2L | iAMP-RAAC | dbAMP |
| AMPDiscover-RF | – | ||||||
| AMPDiscover-RNN | – | – | |||||
| AMPfun | – | – | – | ||||
| iAMP-CA2L | 0.008362 | – | – | – | |||
| iAMP-RAAC | – | – | – | 0.072998 | – | ||
| dbAMP | – | – | – | 0.035339 | – | 0.00116 | |
| iAMPCN | 6.10E−05 | – | – | 6.10E−05 | 0.000122 | 6.10E−05 | 6.10E−05 |
‘–’ means that the number of functional activities that both tools can predict is less than 5.
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.
