Table 6. Open in new tab Performance... | Oxford Academic

Table 6.

Open in new tab

Performance metrics across different concept features while using only GPT-4 on the manually annotated test-set.^a

Concept feature	Concept accuracy	Concept F1
Fluctuating cognitive performance	0.85	0.83
Difficulty answering questions	0.79	0.72
Reduced speech output	0.94	0.92
Forgetfulness	0.5	0.47
Bladder dysfunction	0.85	0.80
White-matter changes	0.90	0.88
Delirium	0.89	0.87
A loss of libido	1.0	1.0
Substance dependence	1.0	1.0
Low energy	0.89	0.88

Concept feature	Concept accuracy	Concept F1
Fluctuating cognitive performance	0.85	0.83
Difficulty answering questions	0.79	0.72
Reduced speech output	0.94	0.92
Forgetfulness	0.5	0.47
Bladder dysfunction	0.85	0.80
White-matter changes	0.90	0.88
Delirium	0.89	0.87
A loss of libido	1.0	1.0
Substance dependence	1.0	1.0
Low energy	0.89	0.88

Each concept feature is of the form “The patient exhibits ….”.

Table 6.

Open in new tab

Performance metrics across different concept features while using only GPT-4 on the manually annotated test-set.^a

Concept feature	Concept accuracy	Concept F1
Fluctuating cognitive performance	0.85	0.83
Difficulty answering questions	0.79	0.72
Reduced speech output	0.94	0.92
Forgetfulness	0.5	0.47
Bladder dysfunction	0.85	0.80
White-matter changes	0.90	0.88
Delirium	0.89	0.87
A loss of libido	1.0	1.0
Substance dependence	1.0	1.0
Low energy	0.89	0.88

Concept feature	Concept accuracy	Concept F1
Fluctuating cognitive performance	0.85	0.83
Difficulty answering questions	0.79	0.72
Reduced speech output	0.94	0.92
Forgetfulness	0.5	0.47
Bladder dysfunction	0.85	0.80
White-matter changes	0.90	0.88
Delirium	0.89	0.87
A loss of libido	1.0	1.0
Substance dependence	1.0	1.0
Low energy	0.89	0.88

Each concept feature is of the form “The patient exhibits ….”.