Home / Publications / E-library page
Only AES members and Institutional Journal Subscribers can download
In forensic voice comparison, it is common for a practitioner to compare the same set of recordings using multiple speaker recognition systems or methods. The usual approach for comparing the results obtained from different systems or methods is to use performance metrics such as the Equal Error Rate (EER) or log-likelihood ratio cost (Cllr), and graphics like the Detection Error Tradeoff (DET) curve and Tippett Plot. While these metrics and graphics are very useful indicators of overall system discrimination and calibration, they do not indicate the level of agreement, or congruence, between the systems at the level of individual comparisons; for example, they do not inform as to whether System A and System B provide the same categorical output for an individual comparison. The congruence plot provides a visual representation of system agreement on a comparison-by-comparison basis by plotting the scores obtained for the same set of comparisons from two different systems against one another. This paper will introduce the congruence plot and its features within the Bio-Metrics software tool. The applications of congruence plots for voice comparison research and casework will then be illustrated through three forensically-relevant case studies.
Author (s): Kelly, Finnian; Coy, Thomas; Alexander, Anil; Jessen, Michael
Affiliation:
Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Department of Text, Speech and Audio, Bundeskriminalamt, Germany
(See document for exact affiliation information.)
Publication Date:
2024-06-17
Import into BibTeX
Session subject:
Forensic Voice Comparison; Forensic Automatic Speaker Recognition; Biometric Performance Assessement; Validation; Bio-Metrics
Permalink: https://aes2.org/publications/elibrary-page/?id=22630
(599KB)
Click to purchase paper as a non-member or login as an AES member. If your company or school subscribes to the E-Library then switch to the institutional version. If you are not an AES member Join the AES. If you need to check your member status, login to the Member Portal.
Kelly, Finnian; Coy, Thomas; Alexander, Anil; Jessen, Michael; 2024; Congruence plots and their applications in forensic voice comparison [PDF]; Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Department of Text, Speech and Audio, Bundeskriminalamt, Germany; Paper 5; Available from: https://aes2.org/publications/elibrary-page/?id=22630
Kelly, Finnian; Coy, Thomas; Alexander, Anil; Jessen, Michael; Congruence plots and their applications in forensic voice comparison [PDF]; Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Oxford Wave Research Ltd., Oxford, United Kingdom; Department of Text, Speech and Audio, Bundeskriminalamt, Germany; Paper 5; 2024 Available: https://aes2.org/publications/elibrary-page/?id=22630