Evaluating different top-k sampling methods and different note chunk sizes for the Text Embeddings with GPT-4 approach on the manually annotated test-set. The bolded text represents the best peforming approach.
| Top-k sampling approach . | Number of sentences in note chunk . | Concept accuracy . | Concept F1 . |
|---|---|---|---|
| Constant (10%) | 1 | 0.73 | 0.66 |
| Varying (using extrapolation) | 1 | 0.81 | 0.76 |
| Varying (using extrapolation) | 2 | 0.82 | 0.78 |
| Varying (using extrapolation) | 3 | 0.78 | 0.73 |
| Varying (using extrapolation) | 4 | 0.81 | 0.78 |
| Varying (using extrapolation) | 5 | 0.78 | 0.74 |
| Top-k sampling approach . | Number of sentences in note chunk . | Concept accuracy . | Concept F1 . |
|---|---|---|---|
| Constant (10%) | 1 | 0.73 | 0.66 |
| Varying (using extrapolation) | 1 | 0.81 | 0.76 |
| Varying (using extrapolation) | 2 | 0.82 | 0.78 |
| Varying (using extrapolation) | 3 | 0.78 | 0.73 |
| Varying (using extrapolation) | 4 | 0.81 | 0.78 |
| Varying (using extrapolation) | 5 | 0.78 | 0.74 |
Evaluating different top-k sampling methods and different note chunk sizes for the Text Embeddings with GPT-4 approach on the manually annotated test-set. The bolded text represents the best peforming approach.
| Top-k sampling approach . | Number of sentences in note chunk . | Concept accuracy . | Concept F1 . |
|---|---|---|---|
| Constant (10%) | 1 | 0.73 | 0.66 |
| Varying (using extrapolation) | 1 | 0.81 | 0.76 |
| Varying (using extrapolation) | 2 | 0.82 | 0.78 |
| Varying (using extrapolation) | 3 | 0.78 | 0.73 |
| Varying (using extrapolation) | 4 | 0.81 | 0.78 |
| Varying (using extrapolation) | 5 | 0.78 | 0.74 |
| Top-k sampling approach . | Number of sentences in note chunk . | Concept accuracy . | Concept F1 . |
|---|---|---|---|
| Constant (10%) | 1 | 0.73 | 0.66 |
| Varying (using extrapolation) | 1 | 0.81 | 0.76 |
| Varying (using extrapolation) | 2 | 0.82 | 0.78 |
| Varying (using extrapolation) | 3 | 0.78 | 0.73 |
| Varying (using extrapolation) | 4 | 0.81 | 0.78 |
| Varying (using extrapolation) | 5 | 0.78 | 0.74 |
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.
