Testing regimes / Classes

Documentation of biometric performance

Arrow
Arrow
Slider

Requirements – Biometric performance

Dependent on varying segment performance requirements, matching testing regimes must be applied. Not conducting realistic tests will typically result in system implementations that significantly underperform in real life.

The most important variables determining what testing regimes to be applied are:

  • Whether or not the application targets to serve close to 100% of the targeted populations
  • Whether or not the application targets use under easy or harsh environmental conditions


Based on this, relevant testing regimes are grouped in 3 classes:

Class 1 – Non-critical mass market segments

The segments applicable for Class 1 testing are typically convenience focused and offering pin-code or other similar low security fallback. This including smartphones, consumer notebooks and other devices with keyboards or numeric keypads.

In these segments it is typically acceptable to compromise on the level of security and most importantly if only 80, 60 or 40% of the targeted users find the systems attractively convenient.

Testing regimes for biometric performance in this segments are typically simple and include:

  • 10-50 test subjects (people)
  • Non-representative part of population (often employees)
  • Indoor, clean, office worker environment
  • Poor methodology

Class 2 – Quality critical mass market segments – Indoor / Clean environments

The segments requiring Class 2 testing are both security and convenience focused. This including applications like retail banking smart cards, corporate access devices, some commercial notebooks and other devices not offering any fallback way to authenticate.

In these segments security, convenience, relevant enrollment schemes, relevant fallback solutions must be offered in parallel with ability to serve very close to 100% of the targeted solutions. The typical application is indoor and in relatively clean environments.

Testing regimes needs to include (ref the “Madrid Tests”:

  • 500 people + (3*60 000 prints)
  • Representative part of population
  • For office worker users/ clean environments
  • High Quality methodology (ISO)

Class 3 – Quality critical mass market segments – Outdoor/ Harsh environments

The segments requiring Class 3 testing are typically security and convenience focused and offering pin-code or other similar low security fallback. This including smart cards, payment solutions, government id (including India).

In these segments security, convenience, relevant enrollment schemes, relevant fallback solutions must be offered in parallel with ability to serve very close to 100% of the targeted solutions. The applications is often outdoor or in harsh environments e.g. with

Testing regimes must include (ref the “Adhaar tests”) :

  • 5000 people +
  • Representative part of population
  • For challenging users and enviromental conditions
  • High quality methodology

Required testing regime per market segment

Application Testing requirement
– India Government applications Class 3
– US Government applications Class 3
– Payment Cards – Financial Inclusion Class 3
– Government ID – Cards Class 3
– Government ID – Cards Niches Class 3 or 2
– Payment Cards – Retail banking Class 2 or 3
– Payment Cards – Niches Class 2 or 3
– Misc devices – Security focus Class 2 or 3
– Corporate Access – Cards Class 2 or 3
– Corporate Access – Devices Class 2 or 3
– Notebooks – Commercial Class 2
– Misc devices – Convenience focus Class 1
– Notebooks – Consumer Class 1
– Smart phones Class 1
Documentation
In quality critical applications, relevant and credible testing is mandatory
Class 1 testing
Not real life relevant. Yields incorrect results
Class 2 testing
Relevant in indoor / clean environments
Class 3 testing
Typically yields FRRs 200-300 % higher than Class 2 testing