---------------------------- International Biometric Group ----------------------------- International Biometric Group
Independent Biometrics Expertise

Home - About IBG - Contact IBG
 Services and Solutions > Biometric Testing and Evaluation > Comparative Biometric Testing

Comparative Biometric Testing

IBG's Comparative Biometric Testing is the industry's longest-running scenario test effort, detailing the accuracy of leading fingerprint, facial recognition, iris-scan, voice recognition, signature-scan, hand geometry, and keystroke-scan systems. 

January 8, 2003 - Round 4 Full Test Results Available for Purchase New! 

Download the Comparative Biometric Testing - Test Plan (pdf)
Download the Table of Contents from the Comparative Biometric Testing Round 4 Report (pdf)
Download a presentation on Lessons Learned from Comparative Biometric Testing (pdf)

To assess the real-world performance of leading biometrics technologies, and to provide deployers, technology firms, and government agencies with objective information on biometrics system capabilities, IBG has conducted independent, scenario-based Comparative Biometric Testing since 1999. Past and present test sponsors include Microsoft, American Airlines, Lockheed Martin, EDS, Fidelity Investments, Star Systems, and the Financial Services Technology Consortium.

Round Four - Completed December 2002

Round Three - Completed August 2001

Fingerprint

    •  Bioscrypt 

    •  DigitalPersona

    •  Fujitsu

    •  Identix

    •  Indivos

    •  Siemens

    •  STMicro

    •  Ultra-Scan

Hand Geometry

    •  Recognition Systems, Inc.

Iris-Scan

    •  Iridian 

Voice Recognition

    •  Nuance

Fingerprint

    •  BES

    •  Identix

    •  Precise Biometrics

    •  SAGEM MORPHO

    •  SecuGen

    •  Sony

Facial Recognition

    •  AcSys Biometrics

    •  Viisage

Iris-Scan

    •  Iridian

Voice Recognition

    •  T-NETIX (SpeechWorks)

Round Two - Completed February 2001

Round One - Completed July 1999

Fingerprint

    •  Advanced Precision Technology

    •  American Biometric Company (ActivCard)

    •  AuthenTec

    •  DigitalPersona

    •  Ethentica

    •  Precise Biometrics

Facial Recognition

    •  Visionics (Identix)

Keystroke-Scan

    •  Net Nanny - BioPassword (BioNet Systems)

Signature-Scan

    •  Cyber-SIGN

Voice Recognition

    •  Nuance

Fingerprint

    •  American Biometric Company (ActivCard)

    •  DigitalPersona

    •  Identicator (Identix)

    •  Identix

    •  Mytec (Bioscrypt)

    •  Sony

    •  ST Microelectronics

    •  Veridicom

Facial Recognition

    •  Miros (eTrue)

    •  Visionics (Identix)

IBG's Comparative Biometric Testing addresses the following questions critical to successful deployments:

  • How do leading technologies compare in terms of False Match Rates, False Non-Match Rates, and Failure to Enroll Rates?

  • How well do technologies perform under real-world conditions with typical users?

  • Which technologies are able to enroll the largest percentage of users?

  • What percentage of enrolled users are falsely matched and non-matched? 

  • Do error rates increase over time?

  • How well do biometric devices address ergonomic and ease-of-use issues? 

  • Which technologies and devices are ready to deploy in operational environments?

Understanding biometric technologies' accuracy and performance under real-world conditions is a precondition of effectively deploying biometrics. Error rates encountered by actual users - including false match rates, false non-match rates, and failure to enroll rates - often differ from error rates generated in laboratory tests using databases of biometric samples. 

Test History

IBG tests between ten and twelve leading biometric systems in each Comparative Biometric Test round. To date a total of 40 biometric systems have been tested. Technologies tested to date include fingerprint, facial recognition, iris-scan, voice recognition, signature-scan, hand geometry, and keystroke-scan. 

Test Protocols

IBG's Comparative Biometric Testing protocols emulate real world conditions, focusing on cooperative users with little to no biometric experience. Careful control of the testing conditions is an essential component of IBG's biometric testing. Environmental factors, such as background noise and lighting are controlled for different biometric technologies under varying conditions. In addition, systems are tested at high, medium, and low security thresholds to determine their accuracy under different operating conditions. User perception data gathered during and after testing provides an independent, objective view of the public's view of various biometric technologies.

Test results from each Test Round are incorporated in a comprehensive Comparative Test Report, and are available for purchase. Contact IBG for information on test results and test sponsorship, and to learn how IBG test data can minimize the risks associated with large-scale or mission-critical biometric deployments.

Copyright © 2006 International Biometric Group