VCMER study results, conclusion-specific and source-specific probabilities, and reported overall error rates
| Firearm forensics black-box studies for examiners and algorithms using measured 3D surface topographies Chapnick et al. (2020) . | ||||
|---|---|---|---|---|
| Study type . | Test set . | Participants . | . | |
| . | # SS Comparisons . | # DS Comparisons . | . | . |
| Open set | 17 | 23 | 76 examiners | |
| Experiment count data | ||||
| Identification | Inconclusive | Elimination | Source total | |
| Same source | 453 | 38 | 0 | 491 |
| Different source | 3 | 254 | 436 | 693 |
| Conclusion total | 456 | 292 | 436 | 1184 |
| Conclusion-specific probabilities | ||||
| Identification | Inconclusive | Elimination | ||
| Same source | 0.9934 | 0.1301 | 0.0000 | Experiment count data are divided by conclusion totals (3rd row) |
| Different source | 0.0066 | 0.8699 | 1.0000 | |
| Total # comparisons | 456 | 292 | 436 | |
| Source-specific probabilities | ||||
| Identification | Inconclusive | Elimination | Total # comparisons | |
| Same source | 0.9226 | 0.0774 | 0.0000 | 491 |
| Different source | 0.0043 | 0.3665 | 0.6291 | 693 |
| Experiment count data are divided by source totals (last column) | ||||
| Overall error rates | ||||
| Opt. | Meaning | Missed identification | Missed elimination | Total |
| 2 | FTE error | 0.0000 | 0.0043 | 0.0025 |
| 3 | Process error | 0.0774 | 0.3709 | 0.2492 |
| 4 | Inconcl. = Elim. | 0.0774 | 0.0043 | 0.0346 |
| Firearm forensics black-box studies for examiners and algorithms using measured 3D surface topographies Chapnick et al. (2020) . | ||||
|---|---|---|---|---|
| Study type . | Test set . | Participants . | . | |
| . | # SS Comparisons . | # DS Comparisons . | . | . |
| Open set | 17 | 23 | 76 examiners | |
| Experiment count data | ||||
| Identification | Inconclusive | Elimination | Source total | |
| Same source | 453 | 38 | 0 | 491 |
| Different source | 3 | 254 | 436 | 693 |
| Conclusion total | 456 | 292 | 436 | 1184 |
| Conclusion-specific probabilities | ||||
| Identification | Inconclusive | Elimination | ||
| Same source | 0.9934 | 0.1301 | 0.0000 | Experiment count data are divided by conclusion totals (3rd row) |
| Different source | 0.0066 | 0.8699 | 1.0000 | |
| Total # comparisons | 456 | 292 | 436 | |
| Source-specific probabilities | ||||
| Identification | Inconclusive | Elimination | Total # comparisons | |
| Same source | 0.9226 | 0.0774 | 0.0000 | 491 |
| Different source | 0.0043 | 0.3665 | 0.6291 | 693 |
| Experiment count data are divided by source totals (last column) | ||||
| Overall error rates | ||||
| Opt. | Meaning | Missed identification | Missed elimination | Total |
| 2 | FTE error | 0.0000 | 0.0043 | 0.0025 |
| 3 | Process error | 0.0774 | 0.3709 | 0.2492 |
| 4 | Inconcl. = Elim. | 0.0774 | 0.0043 | 0.0346 |
VCMER study results, conclusion-specific and source-specific probabilities, and reported overall error rates
| Firearm forensics black-box studies for examiners and algorithms using measured 3D surface topographies Chapnick et al. (2020) . | ||||
|---|---|---|---|---|
| Study type . | Test set . | Participants . | . | |
| . | # SS Comparisons . | # DS Comparisons . | . | . |
| Open set | 17 | 23 | 76 examiners | |
| Experiment count data | ||||
| Identification | Inconclusive | Elimination | Source total | |
| Same source | 453 | 38 | 0 | 491 |
| Different source | 3 | 254 | 436 | 693 |
| Conclusion total | 456 | 292 | 436 | 1184 |
| Conclusion-specific probabilities | ||||
| Identification | Inconclusive | Elimination | ||
| Same source | 0.9934 | 0.1301 | 0.0000 | Experiment count data are divided by conclusion totals (3rd row) |
| Different source | 0.0066 | 0.8699 | 1.0000 | |
| Total # comparisons | 456 | 292 | 436 | |
| Source-specific probabilities | ||||
| Identification | Inconclusive | Elimination | Total # comparisons | |
| Same source | 0.9226 | 0.0774 | 0.0000 | 491 |
| Different source | 0.0043 | 0.3665 | 0.6291 | 693 |
| Experiment count data are divided by source totals (last column) | ||||
| Overall error rates | ||||
| Opt. | Meaning | Missed identification | Missed elimination | Total |
| 2 | FTE error | 0.0000 | 0.0043 | 0.0025 |
| 3 | Process error | 0.0774 | 0.3709 | 0.2492 |
| 4 | Inconcl. = Elim. | 0.0774 | 0.0043 | 0.0346 |
| Firearm forensics black-box studies for examiners and algorithms using measured 3D surface topographies Chapnick et al. (2020) . | ||||
|---|---|---|---|---|
| Study type . | Test set . | Participants . | . | |
| . | # SS Comparisons . | # DS Comparisons . | . | . |
| Open set | 17 | 23 | 76 examiners | |
| Experiment count data | ||||
| Identification | Inconclusive | Elimination | Source total | |
| Same source | 453 | 38 | 0 | 491 |
| Different source | 3 | 254 | 436 | 693 |
| Conclusion total | 456 | 292 | 436 | 1184 |
| Conclusion-specific probabilities | ||||
| Identification | Inconclusive | Elimination | ||
| Same source | 0.9934 | 0.1301 | 0.0000 | Experiment count data are divided by conclusion totals (3rd row) |
| Different source | 0.0066 | 0.8699 | 1.0000 | |
| Total # comparisons | 456 | 292 | 436 | |
| Source-specific probabilities | ||||
| Identification | Inconclusive | Elimination | Total # comparisons | |
| Same source | 0.9226 | 0.0774 | 0.0000 | 491 |
| Different source | 0.0043 | 0.3665 | 0.6291 | 693 |
| Experiment count data are divided by source totals (last column) | ||||
| Overall error rates | ||||
| Opt. | Meaning | Missed identification | Missed elimination | Total |
| 2 | FTE error | 0.0000 | 0.0043 | 0.0025 |
| 3 | Process error | 0.0774 | 0.3709 | 0.2492 |
| 4 | Inconcl. = Elim. | 0.0774 | 0.0043 | 0.0346 |
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.
