“Last events” section#

The “Last events” section displays detection and object (faces, bodies) recognition events, and records identification events using lists.

The general view of the “Last events” section is shown in Figure 8.

The section displays the last 30 events within the settings of handling policy for processing incoming images of the video stream, terminals, REST requests, etc. Receiving and displaying events is performed with minimal delays in near real time.

At the bottom of the screen, there is a “View events archive” button which leads to “Events archive” section (for more details about see the “Events archive” section)

If departments are created, and users and event sources are attached to the department, the user sees only those events that were recorded by the event sources of his department. In order for the user to see the events, the administrator creates a department in the "Departments" section, then adds the user and the selected event source to it.

The filter icon (1), which is located on the right, hides the block with filtering settings. The page shows the following event data (2):

"Event image"
a photo image of the face from the video stream;
a photo image of the body from the video stream;
"Top Match"—the column is displayed if the “Display top match” checkbox is active (3). If no matches are found for a photo from an event, then the column with the top match for this event will remain empty. The "Top match" includes:
reference photo images of the face and/or body;
value of similarity of the identified face with the reference (in percentage terms and with the color coding of similarity thresholds);
"Match type"—the type of object (face or event), according to which the similarity of the identified face/body with the reference was found;
"External ID"—external identifier of the face (for "Face" in "Match type");
"User data"—information from the database, linked to a person from the control (for "Face" in "Match type");
"List"—the name of the list to which the person is attached (for "Face" in "Match type");
"Date created"—date and time of fixing the event (for "Event" in "Match type");
"Source"—the name of the event source that recorded the event (for "Event" in "Match type");
"Handling policy"—the name of the handler, according to which the reference photo image of the body was processed (for "Event" in "Match type").
"Event details" shows the available event data:
"Date of created"—date and time of event registration;
"Source"—the name of the event source that recorded the event;
"Handling policy"—the name of the handler, according to which the reference photo images of the face/body were processed
Face attribute, if found:
- "Gender"—gender based on face image;
- “Age category”—the age of the detected person;
Body attributes, if found:
- "Upper body colors"—an indication of the color of the clothes of the human body upper part;
- "Lower body colors"—indicating the color of the human body upper part;
- "Headwear"—the presence or absence of a headdress, if it is defined.
- "Backpack"—the presence or absence of a backpack, if it is defined.

The color coding of similarity thresholds (3):

similarity values below “low” will be marked in red;
similarity values between “low” and “medium” will be marked in yellow;
similarity values above “medium” will be marked in green.

Color coding of similarity thresholds is configured in the config.json configuration file (see Luna Clementine 2.0. Administration Manual).

Last events filtering#

The Service allows you to filter last events (Figure 8, (2)) to find and display necessary events (Figure 9).

User can quickly find an event among the last 30, as well as set a limit for displaying new events on the screen.

Figure 10. Filter application (gender — male, age from 18 to 44) to display the latest events

When a user clicks on the icon (Figure 8, (1)) on the “Last events” page, a menu with settings and filters opens. The number next to the icon shows the number of installed filters. A short description of the elements and parameters of the filter block on the “Last events” page is presented in the table (Table 2).

Table 2. Filters available to the user to search for last events

Name	Description
Event details
"Sound notification" toggle and "Similarity threshold" field	Allows user to configure sound alerts about detection of an object that is not below the specified value of the similarity threshold
General
Source	Select one or more sources from the list of available ones;
Handling policies	Handling policy names, according to which the face or body in the image was processed. One or several handling policies can be selected for searching.
Liveness	Liveness status selection:
	Spoof;
	Real;
	Unknown;
	Not estimated;
	A combination of several values is possible;
Tags	Selection of one or more tags.
	For example, the "Temperature" tag, is intended for displaying information about the temperature of the human body, filtering events by temperature. "Temperature":
	Abnormal—very low or very high body temperature of a person, which may indicate an incorrect setting of the thermal imaging camera (the event will be highlighted in red);
	Normal—normal human body temperature range;
	Increased—above the specified normal human body temperature range (the event will be highlighted in red);
Labels
Label	Label name (labels are rules by which the comparison is made);
Similarity,%	Lower and/or upper limits of similarity for displaying faces identified by the lists;
Face attributes and properties
Gender	Gender of a person to be detected:
	Female;
	Male;
	Not estimated;
Age	Lower and/or upper limits of age of a person to be detected:
	Under 18;
	From 18 to 44;
	45 to 60;
	Over 60;
Emotion	Emotion of a person to be detected:
	Anger;
	Disgust;
	Fear;
	Happiness;
	Neutral;
	Sadness;
	Surprise;
	Not estimated;
	A combination of several values is possible;
Mask	Indication of the presence of a mask:
	Missing;
	Medical mask;
	Occluded;
	Not estimated;
	A combination of several values is possible;
Body attributes and properties
Upper body colors	Top clothing color specification:
	Undefined; Black; Blue; Green; Grey; Orange; Purple; Red; White; Yellow; Pink; Brown; Beige; Khaki; Multicolored; Not estimated;
	A combination of several values is possible;
Lower body type	Bottom clothing type specification:
	Undefined;
	Trousers;
	Shorts;
	Skirt;
	Not estimated;
	A combination of several values is possible;
Lower body colors	Bottom clothing color specification:
	Indefined; Black; Blue; Green; Grey; Orange; Purple; Red; White; Yellow; Pink; Brown; Beige; Khaki; Multicolored; Not estimated;
	A combination of several values is possible;
Shoes color	Shoe color specification:
	Undefined;
	Black;
	White;
	Other;
	Not estimated;
	A combination of several values is possible;
Headwear	Headdress specification:
	Absent;
	Present;
	Undefined;
	Not estimated;
	A combination of several values is possible;
Headwear colors	Headdress color specification:
	Undefined;
	Black;
	White;
	Other;
	Not estimated;
	A combination of several values is possible;
Backpack	Backpack presence specification:
	Absent;
	Present;
	Undefined;
	Not estimated;
	A combination of several values is possible;
Sleeve	Sleeve length specification:
	Short;
	Long;
	Undefined;
	Not estimated;
	A combination of several values is possible;
Gender by body image	Female;
	Male;
	Undefined;
	Not estimated;
	A combination of several values is possible;
Age by body image	Specification of the age range;
Location
City	Event location
Area
District
Street
House number
Longitude(-180…180);
Accuracy (0…90);
Latitude(-90…90);
Accuracy (0…90);

Color coding of temperature values:

increased temperature values will be marked in yellow;
abnormal temperature values will be marked in red;
normal temperature values will be marked in green.

See the LUNA Access documentation for more information on setting of temperature ranges.

The user needs to install one filter or a combination of them and click on the “Filter” button.

To reset the installed filters, click on the “Reset” button.

The applied filters will affect the appearance of new events on the screen.

To collapse “Filters”, click on the filter icon

on the right side of the screen.

Event card#

A card with detailed event data (Figure 10) opens when clicking on an arrow button on the face or body from the event image. (Figure 8).

When an event contains data on the detection of both a face and a body, the event card gives the ability to switch between these data. If an event contains detection data for only one object, such as a face, then there will be no detection data for another object.

The event card consists of four blocks. The description of the elements of the event card is presented in Table 3.

Table 3. Elements and parameters of the event card

Name	Description
Event details
Date created	Date and time of event recording
Additional information	“Event ID” — when clicked on


Figure 11. Copy

, the value is copied to the clipboard | | Handling policy | Name of the policy by which the image processing in the video stream is performed. || Clicking on the name of the policy opens the form for editing its parameters| |Tags | Name of tags by which the event is filtered |Liveness|Result of Liveness check for person identification purposes (KYC) |Face detection image and body detection image when two objects are detected|Clicking face detection or body detection will switch the data to face detection or body detection details | Location | Location data (“City”, “Area”, “District”, “Street”, “House number”, “Coordinates (latitude)”, “Coordinates (longitude)”) | |Face Detection or Body Detection (if equipped) |Find similar: events

| Clicking on

opens a page in a new tab and searches for similar faces and/or bodies by the event ID where the face/body was recorded |Find similar: faces

| Clicking on

opens the page in a new tab and searches for similar faces by the Face ID | Photo image of a face from a video stream | Normalized image: || when clicked on

the biometric sample opens in a new tab; || when clicked on

the face/body detection track opens; || when clicked on

the full frame from the video stream opens; | Face attributes | “Attributes”: || “Gender”—gender of a person (male/female); || “Age category”—specification of age category; | Body attributes | “Basic Attributes”: || “Gender”—gender of a person (male/female); || “Age”—specification of age; ||"Upper body"—specification of the type and color of clothing of the upper body: ||- "Headwear"; ||- "Headwear color"; ||- "Sleeve"; ||- "Color"; || "Lower body"—specification of the type and color of clothing of the lower body: ||- "Lower garment type" ||- "Lower garment color" ||- "Shoes apparent color" ||"Accessories"—specification of the presence or absence of a "backpack" | Additional properties| Head tilt angle (roll); || Head tilt angle (pitch); || Head rotation angle (yaw); || Eye direction (pitch); || Eye direction (yaw); || Mouth state; || Eye state ; || Image quality determination: || Light; || Dark; || Blur; || Specularity; || Illumination | ||Definition of attributes and properties of the face/body is set in the handler settings | Best match (type - "Event" or "Person") | Similarity value of identified face/body with the face/body from control list/event (in percentage); |Find similar: events

| Clicking on

opens a page in a new tab and searches for similar faces and/or bodies by the event ID where the face/body was recorded |Find similar: faces

| Clicking on

opens the page in a new tab and searches for similar faces by the Face ID | Photo image of a face/body| Reference photo image of the face or body (sample) or no photo: || when clicked on

the biometric sample opens in a new tab; || when clicked on

face details opens| || when clicked on

the face/body detection track opens; || when clicked on

the full frame from the video stream opens; | Face attributes | “Attributes”: || “Gender”—gender of a person (male/female); || “Age category”—specification of age category; | Body attributes | “Basic Attributes”: || “Gender”—gender of a person (male/female); || “Age”—specification of age; ||"Upper body"—specification of the type and color of clothing of the upper body: ||- "Headwear"; ||- "Headwear color"; ||- "Sleeve"; ||- "Color"; || "Lower body"—specification of the type and color of clothing of the lower body: ||- "Lower garment type" ||- "Lower garment color" ||- "Shoes apparent color" ||"Accessories"—specification of the presence or absence of a "backpack" | Additional properties| Head tilt angle (roll); || Head tilt angle (pitch); || Head rotation angle (yaw); || Eye direction (pitch); || Eye direction (yaw); || Mouth state; || Eye state ; || Image quality determination: || Light; || Dark; || Blur; || Specularity; || Illumination | ||Definition of attributes and properties of the face/body is set in the handler settings |"Matches"| | Event photo| “Face” type — an avatar, sample, or no photo image. ||Similarity value of identified face with the face from control list (in percentage)| ||“Event” type — detection (photo image of a face from a video stream). ||Similarity value of identified face or body with the face or body from the event (in percentage)| |Type| - Face; ||- Event| | Date created | Date and time of creation in the Service of the card of the face on which the identification event occurred | | Label | Label name. Labels are rules by which the comparison is made | | Additional information | “Face” type — “User data”, “Lists”, “External ID”. “Event” type — “Handling policy”, “Source”. || When clicked on

face or event details opens|

The external ID is used to integrate LUNA CLEMENTINE 2.0 with external systems, to transfer data to other systems in order to analyze and quickly respond to an event.

Face card#

To open the face card (Figure 11) click on the arrow button on the fec or body image from the "Top match" column. Users can also open the face card from the event card by clicking on

in the "Best match" block or near the "Additional information" in the "Matches" block.

The face card consists of two blocks. The description of the elements of the face card is presented in Table 4.

Table 4. Elements and parameters of the face card

Name	Description
Face details
Photo image of a face	Avatar is a biometric sample that is created when uploading a photo image to the list (to the LUNA PLATFORM 5 system):
	when clicked on


Figure 11. Zoom

the biometric sample opens in a new tab| | Update photo | Opening the form to upload a new face photo image| | Edit face user data | Opening a form for editing face data (“User data”, “External ID”, “Lists”)| | Delete face | Removal of face biometric sample, face photo image, and face card (available only for the administrator role) | | Date created | Date and time of creation of the biometric sample| | Information| User data from the database, linked to a face (upon availability)| | External ID | External identifier of the face| | Lists (N)| The list and number of lists to which the person is attached. || Clicking on a name opens a list| | Additional information | “Face ID” — when clicked on

, the value is copied to the clipboard | | Face attributes | “Attributes”: || “Gender” — gender of a person (male/female); || “Age category” — indication of age category| | Additional properties| Face properties: || Head tilt angle (roll); || Head tilt angle (pitch); || Head rotation angle (yaw); || Eye direction (pitch); || Eye direction (yaw); || Mouth state; || Eye state || Image quality determination: || Light; || Dark; || Blur; || Specularity; || Illumination | | Additional block || | Faces with the same external ID. Could be empty (“No external ID”) || | Photo image of a face| Avatar, sample or no photo | | Date created | Date and time of creation of the biometric sample| | User data| Information from the database, linked to a face (upon availability)| | Lists (N)| The list and number of lists to which the person is attached. || Clicking on a name opens a list| || When clicked on

face details open| | Last events with this face (there may be no events with this face) || | Photo image of a face from a video stream | Normalized image: || when clicked on

the biometric sample opens in a new tab; || when clicked on

the full frame from the video stream opens || Similarity value of identified face with the face from control list (in percentage) | | Date created | Date and time of recording the event with a face| | Event source | The name of the event source that recorded the event with a face: || when clicked on

in a new tab a preview of the video stream of the event source that has recorded the event opens; || when clicked on the name of the event source, a form for editing its parameters opens (available only for the administrator role) | | Handling policy | Name of the policy that processed the image in the video stream. || Clicking on the name of the policy opens the form for editing its parameters | | View all faces with the same external ID | When clicked, the search for faces by external ID is performed, and a list of all faces, whose external ID matches the one of the reference photo, opens.|

Face card editing#

Updating the photo image in the face card is performed by clicking the “Update photo” button (Figure 11). The general view of the photo image update form in the face card is shown in Figure 12.

Image file requirements:

*.png , *.jpeg, or *.bmp format;
image size no more than 15 MB and no more than 3840х2160 pixels;
image may contain one or more people;
image must have a person's face.

Form for updating a photo image in a face card

Editing the face user data is performed by clicking the “Edit face user data” button (Figure 11). The general view of the face user data editing form is shown in Figure 13.

Face user data editing form contains:

“User data” — information from the database, linked to a face (upon availability);
“External ID” — external identifier of the face;
“Lists” — lists to which the face is attached;
“Save” button — button for saving changes.