Monitoring¶
Data for monitoring¶
We are currently processing several types of events for monitoring:
request (any http request)
error (failed http request)
sdk usage & sdk estimation
licensing
Every event is a point in the time series. The point is represented as union of the following data:
series name
start event time
tags, indexed data in storage, dictionary: keys - string tag names, values - string, integer, float
fields, non indexed data in storage, dictionary: keys - string tag names, values - string, integer, float
Monitoring series¶
Requests series.
Triggered on every request. Each point contains a data about corresponding request (execution time and etc).
¶ tag name
description
service
always “luna-handlers”
route
concatenation of a request method and a request resource (POST:/extractor)
status_code
http status code of response
¶ fields
description
request_id
request id
execution_time
request execution time
¶ tag name
resource
description
handler_id
/handlers/{handlerId}/events
handler ID
¶ fields
resource
description
download_images_time
/detector
time taken to download the image from Image Store
save_warps_time
/detector
time taken to save warps to Image Store
save_samples_time
/extractor
time taken to save samples to Image Store
load_face_samples_time
/extractor
time taken to download the face sample from Image Store
load_face_samples_time
/extractor/upgrade
time taken to download the face sample from Image Store
load_body_samples_time
/extractor/upgrade
time taken to download the body sample from Image Store
save_face_attributes_time
/extractor/upgrade
time taken to save face attributes to Luna Faces
save_event_attributes_time
/extractor/upgrade
time taken to save event attributes to Luna Faces
load_images_for_processing_time
/handlers/{handlerId}/events
time taken to load image for processing from request
face_sample_storage_policy_time
/handlers/{handlerId}/events
time taken to save face samples to Image Store
body_sample_storage_policy_time
/handlers/{handlerId}/events
time taken to save body samples to Image Store
image_origin_storage_policy_time
/handlers/{handlerId}/events
time taken to save image origins to Image Store
face_attribute_storage_policy_time
/handlers/{handlerId}/events
time taken to save face attributes to Image Store
face_storage_policy_time
/handlers/{handlerId}/events
time taken to save face with avatar to Luna Faces
event_storage_policy_time
/handlers/{handlerId}/events
time taken to save event to Luna Events
notification_storage_policy_time
/handlers/{handlerId}/events
time taken to send notification to Luna Sender
match_policy_time
/handlers/{handlerId}/events
time taken for matching
match_policy_time
/verifiers/{verifierId}/verifications
time taken for matching
load_images_for_processing_time
/sdk
time taken to load image for processing from request
load_images_for_processing_time
/iso
time taken to load image for processing from request
Errors series.
Triggered on failed request. Each point contains error_code of luna error.
¶ tag name
description
service
always “luna-handlers”
route
concatenation of a request method and a request resource (POST:/extractor)
status_code
http status code of response
error_code
Luna Platform error code
¶ fields
description
request_id
request id
¶ tag name
resource
description
handler_id
/handlers/{handlerId}/events
handler ID
Usages_statistic series.
Triggered on every request involving some SDK estimations. Each point contains data on the number of estimations performed.
¶ tag name
description
service
always “luna-handlers”
¶ fields
description
face_detector_usages
face detector usages count
landmarks68_detector_usages
landmarks68 detector usages count
head_pose_estimator_usages
head pose estimator usages count
liveness_estimator_usages
liveness estimator usages count
mask_estimator_usages
mask estimator usages count
emotion_estimator_usages
emotion estimator usages count
mouth_estimator_usages
mouth estimator usages count
eye_estimator_usages
eye estimator usages count
gaze_estimator_usages
gaze estimator usages count
glasses_estimator_usages
glasses estimator usages count
face_warp_quality_estimator_usages
face warp quality estimator usages count
face_basic_attributes_extractor_usages
face basic attributes extractor usages count
face_descriptor_extractor_usages
face descriptor extractor usages count
body_detector_usages
body detector estimator usages count
body_descriptor_extractor_usages
body descriptor extractor usages count
iso_estimator_usages
iso estimator usages count
face_quality_estimator_usages
face quality estimator usages count
body_basic_attributes_estimator_usages
body basic attribute estimator usages count
body_upper_attributes_estimator_usages
body upper attribute estimator usages count
body_accessories_estimator_usages
body accessory estimator usages count
body_lower_attributes_estimator_usages
body lower attribute estimator usages count
Sdkloop_task series.
Image_load series.
SDK monitoring series. Triggered on every request involving some SDK estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
format
image format, i.e. “JPEG”, “PNG”, etc.
exif
whether the exif loading is on
autorotated
whether the autorotation is on
¶ fields
description
execution_time
image loading time in seconds
size
image size in bytes
height
image height in pel
width
image width in pel
Image_orientation series.
Human_detection series.
SDK monitoring series. Triggered on every request involving human detection estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
¶ fields
description
execution_time
estimation time in seconds
face_detection_height
face detection height
face_detection_width
face detection width
body_detection_height
body detection height
body_detection_width
body detection width
image_height
image height
image_width
image width
detection_count
detection count
face_detection_count
face detection count
body_detection_count
body detection count
Face_detection series.
SDK monitoring series. Triggered on every request involving face detection estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
¶ fields
description
execution_time
estimation time in seconds
face_detection_height
face detection height
image_height
image height
face_detection_width
face detection width
image_width
image width
detection_count
detection count
Face_redetection series.
SDK monitoring series. Triggered on every request involving face redetection estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
¶ fields
description
execution_time
estimation time in seconds
face_detection_height
face detection height
image_height
image height
face_detection_width
face detection width
image_width
image width
detection_count
detection count
bbox_width
bbox width
bbox_height
bbox height
Face_warp series.
Face_warp_quality series.
Emotions series.
Eyes series.
Gaze_direction series.
Glasses series.
Head_pose series.
LivenessV1 series.
Mask series.
Mouth_state series.
Basic_attributes series.
Aggregated_basic_attributes series.
SDK monitoring series. Triggered on every request involving aggregated basic attributes estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
¶ fields
description
execution_time
estimation time in seconds
Face_descriptor series.
SDK monitoring series. Triggered on every request involving face descriptor estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
descriptor_version
descriptor version
¶ fields
description
execution_time
estimation time in seconds
Aggregated_face_descriptor series.
SDK monitoring series. Triggered on every request involving aggregated face descriptor estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
descriptor_version
descriptor version
¶ fields
description
execution_time
estimation time in seconds
Body_detection series.
SDK monitoring series. Triggered on every request involving body detection estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
estimate_17landmarks
estimate 17landmarks
¶ fields
description
execution_time
estimation time in seconds
body_detection_height
body detection height
image_height
image height
body_detection_width
body detection width
image_width
image width
detection_count
detection count
Body_redetection series.
SDK monitoring series. Triggered on every request involving body redetection estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
estimate_17landmarks
estimate 17landmarks
¶ fields
description
execution_time
estimation time in seconds
body_detection_height
body detection height
image_height
image height
body_detection_width
body detection width
image_width
image width
detection_count
detection count
bbox_width
bbox width
bbox_height
bbox height
Body_warp series.
Body_attributes series.
Body_descriptor series.
SDK monitoring series. Triggered on every request involving body descriptor estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
descriptor_version
descriptor version
¶ fields
description
execution_time
estimation time in seconds
Aggregated_body_descriptor series.
SDK monitoring series. Triggered on every request involving aggregated body descriptor estimations. Each point contains data on estimations performed.
¶ tag name
description
service
always “luna-handlers”
batch_size
batch size for estimations
descriptor_version
descriptor version
¶ fields
description
execution_time
estimation time in seconds
Licensing series.
Triggered on each request with liveness estimation if liveness balance expired. Each point contains license check data.
¶ tag name
description
service
always “luna-handlers”
license_status
license status (“ok”, “warning”, “error”, “exception”)
¶ fields
description
liveness_balance
number of liveness estimations before the license expires
warnings
license warning messages
errors
license errors messages
Database¶
Monitoring is implemented as data sending to an influx database. You can setup your database credentials in configuration file in section “monitoring”.
Plugins¶
You can realize your own plugin for sending monitoring data. See plugins
Module request monitoring plugin example
- class luna_handlers.crutches_on_wheels.cow.plugins.plugin_examples.request_monitoring_plugin_example.BaseRequestMonitoringPlugin(app)[source]¶
Base class for requests monitoring.
- class luna_handlers.crutches_on_wheels.cow.plugins.plugin_examples.request_monitoring_plugin_example.RequestMonitoringPlugin(app)[source]¶
Example plugin sends a request data for monitoring to third-party source. Only one instance of this class exist during the program execution.