Skip to content

Neural networks used in LUNA ID#

In LUNA ID, neural networks provide efficient and accurate processing of faces in images and video streams. Neural networks are stored in .plan files.

The table below shows the .plan files used in LUNA ID for Android and iOS and functionality that the files cover.

.plan file

Feature name

Description

More information

Android

iOS

angle_estimation_flwr_arm.plan

Head pose estimation

Determines person head rotation angles in 3D space, that is pitch, yaw, and roll.

BestShotQuality Estimation

BestShotQuality Estimation

ags_angle_estimation_flwr_arm.plan

BestShotQuality estimation

Evaluates image quality to choose the best image before descriptor extraction. The BestShotQuality estimator consists of two components - AGS (garbage store) and Head Pose.

ags_estimation_flwr_arm.plan

AGS estimation

Determines the source image score for further descriptor extraction and matching.

eye_status_estimation_flwr_arm.plan

Eye state

Determines the eye state: open, closed, occluded.

Eyes Estimation

Eyes Estimation

eyes_estimation_flwr8_arm.plan

Eye state estimation

Determines the following eye state and keypoints:

  • Eye state: open, closed, occluded.
  • Precise eye iris location as an array of landmarks.
  • Precise eyelid location as an array of landmarks.

FaceDet_v2_first_arm.plan

Face detection

Detects a face in an image and shows a rectangular area around the detected face.

The neural networks should be launched consequently.

Face Detection

Face Detection

FaceDet_v2_second_arm.plan

FaceDet_v2_third_arm.plan

glasses_estimation_flwr_arm.plan

Image glasses estimation

Determines whether a person is currently wearing glasses.

Glasses estimation

Glasses estimation

mask_clf_v3_arm.plan

Medical mask estimation

Determines whether a person is currently wearing a medical mask on the face.

Medical Mask Estimation Functionality

Medical Mask Estimation Functionality

model_subjective_quality_v1_arm.plan

Image quality estimation

Determines an image quality by the following criteria:

  • The image is blurred.
  • The image is underexposed, that is, too dark.
  • The image is overexposed, that is, too light.
  • The face in the image is illuminated unevenly and there is a great difference between dark and light regions.
  • The image contains flares on face, that is, too specular.

Image Quality Estimation

Image Quality Estimation

model_subjective_quality_v2_arm.plan

Configuration options of the supported features are stored in the faceengine.conf file. The file locates in "data/faceengine.conf" in current working directory.

Warning! We do not recommend that you change any configuration settings from default ones as these settings affect performance and output results of your application.

For more information about the settings stored in the faceengine.conf file, see: