Monitoring

Data for monitoring

We are currently processing several types of events for monitoring:

  1. request (any http request)

  2. error (failed http request)

  3. licensing

  4. sdk estimation

  5. analytics manager

  6. stream processing start

  7. stream processing stop

  8. stream processing error

Every event is a point in the time series. The point is represented as union of the following data:

  • series name

  • start event time

  • tags, indexed data in storage, dictionary: keys - string tag names, values - string, integer, float

  • fields, non indexed data in storage, dictionary: keys - string tag names, values - string, integer, float

Monitoring series

  • Requests series.

    Triggered on every request. Each point contains a data about corresponding request (execution time and etc).

    Requests series tags

    tag name

    description

    service

    always “luna-video-agent”

    route

    concatenation of a request method and a request resource (POST:/sdk)

    status_code

    http status code of response

    Requests series fields

    fields

    description

    request_id

    request id

    execution_time

    request execution time

    Requests series additional fields

    fields

    resource

    description

    load_images_for_processing_time

    /sdk

    time taken to load image for processing from request

    load_images_for_processing_time

    /iso

    time taken to load image for processing from request

  • Errors series.

    Triggered on failed request. Each point contains error_code of luna error.

    Errors series tags

    tag name

    description

    service

    always “luna-video-agent”

    route

    concatenation of a request method and a request resource (POST:/sdk)

    status_code

    http status code of response

    error_code

    Luna Platform error code

    Errors series fields

    fields

    description

    request_id

    request id

  • Licensing series.

    Triggered if liveness balance is over. Each point contains license check data.

    Licensing series tags

    tag name

    description

    service

    always “luna-video-agent”

    license_status

    license status (“warning”, “error”)

    Licensing series fields

    fields

    description

    liveness_balance

    number of liveness estimations before the license expires

    warnings

    license warning messages

    errors

    license errors messages

  • Stream_processing_start series.

    Triggered every time when stream processing is started. Each point contains event time.

    Stream_processing_start series tags

    tag name

    description

    service

    always “luna-video-agent”

    agent_id

    agent id

    Stream_processing_start series fields

    fields

    description

    stream_id

    stream id

  • Stream_processing_stop series.

    Triggered every time when stream processing is finished. Each point contains event time.

    Stream_processing_stop series tags

    tag name

    description

    service

    always “luna-video-agent”

    agent_id

    agent id

    Stream_processing_stop series fields

    fields

    description

    stream_id

    stream id

  • Stream_processing_error series.

    Triggered every time when an error occurs during stream processing. Each point contains event time and error description.

    Stream_processing_error series tags

    tag name

    description

    service

    always “luna-video-agent”

    agent_id

    agent id

    Stream_processing_error series fields

    fields

    description

    error

    error message

  • frame_monitoring series.

    Analytics manger monitoring series. Triggered on every frame of the video. Each point contains data on analytics performed on one frame.

    frame_monitoring series tags

    tag name

    description

    service

    always “luna-video-agent”

    concurrency

    max number of frames processed in parallel

    frame_monitoring series fields

    fields

    description

    execution_time

    analytics execution time in seconds

    video_id

    internal id of the video on which analytic was performed

    frame_monitoring series additional fields

    fields

    description

    human_tracking_frame_execution

    time taken to execute human tracking analytic on a frame

    crowd_frame_execution

    time taken to execute crowd analytic on a frame

  • node_crowd series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_crowd series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_crowd series additional tags

    tag name

    description

    agent_id

    agent id

    node_crowd series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

    node_crowd series additional fields

    fields

    description

    people_count

    estimated amount of people

  • node_human_tracking series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_human_tracking series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_human_tracking series additional tags

    tag name

    description

    agent_id

    agent id

    node_human_tracking series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

    people_count

    people tracked on a frame

    node_human_tracking series additional fields

    fields

    description

    face_count

    faces detected on a frame

    body_count

    bodies detected on a frame

  • node_overview series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_overview series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_overview series additional tags

    tag name

    description

    agent_id

    agent id

    node_overview series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_body_attributes series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_body_attributes series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_body_attributes series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_body_attributes series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_body_thumbnail series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_body_thumbnail series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_body_thumbnail series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_body_thumbnail series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_body_descriptor series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_body_descriptor series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_body_descriptor series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_body_descriptor series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_body_samples series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_body_samples series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_body_samples series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_body_samples series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_deepfake series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_deepfake series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_deepfake series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_deepfake series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_face_basic_attributes series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_face_basic_attributes series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_face_basic_attributes series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_face_basic_attributes series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_face_thumbnail series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_face_thumbnail series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_face_thumbnail series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_face_thumbnail series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_face_descriptor series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_face_descriptor series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_face_descriptor series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_face_descriptor series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_face_samples series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_face_samples series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_face_samples series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_face_samples series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_aggregated_liveness series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_aggregated_liveness series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_aggregated_liveness series additional tags

    tag name

    description

    agent_id

    agent id

    node_aggregated_liveness series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_ags series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_ags series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_ags series additional tags

    tag name

    description

    agent_id

    agent id

    node_ags series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_emotions series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_emotions series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_emotions series additional tags

    tag name

    description

    agent_id

    agent id

    node_emotions series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_eyes series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_eyes series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_eyes series additional tags

    tag name

    description

    agent_id

    agent id

    node_eyes series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_gaze series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_gaze series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_gaze series additional tags

    tag name

    description

    agent_id

    agent id

    node_gaze series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_glasses series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_glasses series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_glasses series additional tags

    tag name

    description

    agent_id

    agent id

    node_glasses series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_head_pose series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_head_pose series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_head_pose series additional tags

    tag name

    description

    agent_id

    agent id

    node_head_pose series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_landmarks5 series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_landmarks5 series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_landmarks5 series additional tags

    tag name

    description

    agent_id

    agent id

    node_landmarks5 series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_mask series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_mask series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_mask series additional tags

    tag name

    description

    agent_id

    agent id

    node_mask series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_mouth series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_mouth series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_mouth series additional tags

    tag name

    description

    agent_id

    agent id

    node_mouth series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_warp_quality series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_warp_quality series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_warp_quality series additional tags

    tag name

    description

    agent_id

    agent id

    node_warp_quality series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_body_warp series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_body_warp series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_body_warp series additional tags

    tag name

    description

    agent_id

    agent id

    node_body_warp series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_event_policy series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_event_policy series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_event_policy series additional tags

    tag name

    description

    agent_id

    agent id

    node_event_policy series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

  • node_face_warp series.

    Analytics manger nodes monitoring series. Triggered on every frame of the video if node was involved in analytics process. Each point contains data on node processing on a frame.

    node_face_warp series tags

    tag name

    description

    service

    always “luna-video-agent”

    skipped

    whether node was skipped or not (true or false)

    node_face_warp series additional tags

    tag name

    description

    agent_id

    agent id

    node_face_warp series fields

    fields

    description

    execution_time

    estimation time in seconds

    video_id

    Internal id of the video on which analytic was performed

Database

Monitoring is implemented as data sending to an influx database. You can setup your database credentials in configuration file in section “monitoring”.

Plugins

You can implement your own plugin for sending monitoring data. See plugins