Monitoring¶
Data for monitoring¶
We are currently processing several types of events for monitoring:
- request (any http request) 
- error (failed http request) 
- licensing 
- sdk estimation 
- analytics manager 
- stream processing start 
- stream processing stop 
- stream processing error 
Every event is a point in the time series. The point is represented as union of the following data:
- series name 
- start event time 
- tags, indexed data in storage, dictionary: keys - string tag names, values - string, integer, float 
- fields, non indexed data in storage, dictionary: keys - string tag names, values - string, integer, float 
Monitoring series¶
- Requests series. - Triggered on every request. Each point contains a data about corresponding request (execution time and etc). - Requests series tags¶ - tag name - description - service - always “luna-video-agent” - route - concatenation of a request method and a request resource (POST:/sdk) - status_code - http status code of response - Requests series fields¶ - fields - description - request_id - request id - execution_time - request execution time - Requests series additional fields¶ - fields - resource - description - load_images_for_processing_time - /sdk - time taken to load image for processing from request - load_images_for_processing_time - /iso - time taken to load image for processing from request 
- Errors series. - Triggered on failed request. Each point contains error_code of luna error. - Errors series tags¶ - tag name - description - service - always “luna-video-agent” - route - concatenation of a request method and a request resource (POST:/sdk) - status_code - http status code of response - error_code - Luna Platform error code - Errors series fields¶ - fields - description - request_id - request id 
- Licensing series. - Triggered if liveness balance is over. Each point contains license check data. - Licensing series tags¶ - tag name - description - service - always “luna-video-agent” - license_status - license status (“warning”, “error”) - Licensing series fields¶ - fields - description - liveness_balance - number of liveness estimations before the license expires - warnings - license warning messages - errors - license errors messages 
- Stream_processing_start series. 
- Stream_processing_stop series. 
- Stream_processing_error series. - Triggered every time when an error occurs during stream processing. Each point contains event time and error description. - Stream_processing_error series tags¶ - tag name - description - service - always “luna-video-agent” - agent_id - agent id - Stream_processing_error series fields¶ - fields - description - error - error message 
- frame_monitoring series. - Analytics manger monitoring series. Triggered on every frame of the video. Each point contains data on analytics performed on one frame. - frame_monitoring series tags¶ - tag name - description - service - always “luna-video-agent” - concurrency - max number of frames processed in parallel - frame_monitoring series fields¶ - fields - description - execution_time - analytics execution time in seconds - video_id - internal id of the video on which analytic was performed - frame_monitoring series additional fields¶ - fields - description - human_tracking_frame_execution - time taken to execute human tracking analytic on a frame - crowd_frame_execution - time taken to execute crowd analytic on a frame 
- node_crowd series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_crowd series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_crowd series additional tags¶ - tag name - description - agent_id - agent id - node_crowd series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed - node_crowd series additional fields¶ - fields - description - people_count - estimated amount of people 
- node_human_tracking series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_human_tracking series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_human_tracking series additional tags¶ - tag name - description - agent_id - agent id - node_human_tracking series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed - people_count - people tracked on a frame - node_human_tracking series additional fields¶ - fields - description - face_count - faces detected on a frame - body_count - bodies detected on a frame 
- node_overview series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_overview series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_overview series additional tags¶ - tag name - description - agent_id - agent id - node_overview series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_body_attributes series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_body_attributes series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_body_attributes series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_body_attributes series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_body_thumbnail series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_body_thumbnail series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_body_thumbnail series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_body_thumbnail series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_body_descriptor series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_body_descriptor series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_body_descriptor series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_body_descriptor series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_body_samples series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_body_samples series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_body_samples series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_body_samples series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_deepfake series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_deepfake series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_deepfake series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_deepfake series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_face_basic_attributes series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_face_basic_attributes series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_face_basic_attributes series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_face_basic_attributes series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_face_thumbnail series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_face_thumbnail series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_face_thumbnail series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_face_thumbnail series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_face_descriptor series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_face_descriptor series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_face_descriptor series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_face_descriptor series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_face_samples series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_face_samples series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_face_samples series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_face_samples series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_aggregated_liveness series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_aggregated_liveness series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_aggregated_liveness series additional tags¶ - tag name - description - agent_id - agent id - node_aggregated_liveness series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_ags series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_ags series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_ags series additional tags¶ - tag name - description - agent_id - agent id - node_ags series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_emotions series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_emotions series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_emotions series additional tags¶ - tag name - description - agent_id - agent id - node_emotions series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_eyes series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_eyes series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_eyes series additional tags¶ - tag name - description - agent_id - agent id - node_eyes series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_gaze series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_gaze series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_gaze series additional tags¶ - tag name - description - agent_id - agent id - node_gaze series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_glasses series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_glasses series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_glasses series additional tags¶ - tag name - description - agent_id - agent id - node_glasses series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_head_pose series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_head_pose series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_head_pose series additional tags¶ - tag name - description - agent_id - agent id - node_head_pose series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_landmarks5 series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_landmarks5 series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_landmarks5 series additional tags¶ - tag name - description - agent_id - agent id - node_landmarks5 series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_mask series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_mask series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_mask series additional tags¶ - tag name - description - agent_id - agent id - node_mask series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_mouth series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_mouth series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_mouth series additional tags¶ - tag name - description - agent_id - agent id - node_mouth series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_warp_quality series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_warp_quality series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_warp_quality series additional tags¶ - tag name - description - agent_id - agent id - node_warp_quality series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_body_warp series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_body_warp series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_body_warp series additional tags¶ - tag name - description - agent_id - agent id - node_body_warp series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_event_policy series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_event_policy series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_event_policy series additional tags¶ - tag name - description - agent_id - agent id - node_event_policy series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
- node_face_warp series. - Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame. - node_face_warp series tags¶ - tag name - description - service - always “luna-video-agent” - skipped - whether node was skipped or not (true or false) - node_face_warp series additional tags¶ - tag name - description - agent_id - agent id - node_face_warp series fields¶ - fields - description - execution_time - estimation time in seconds - video_id - Internal id of the video on which analytic was performed 
Database¶
Monitoring is implemented as data sending to an influx database. You can setup your database credentials in configuration file in section “monitoring”.
Plugins¶
You can implement your own plugin for sending monitoring data. See plugins