Skip to content

FaceStream v.5.1.27#

Summary#

  • Now the "image_origin_policy" mechanism of the LUNA PLATFORM handler will be used to save the source frame if the resource "/images" is supposed to be used.

    Previously, several internal requests were made to save the source frame.

    The address to the "/images" resource is set in the "frame_store" parameter in the streams management settings (for example, "frame_store": "http://127.0.0.1:5000/6/images").

    This feature does not apply to saving source images to the LUNA Image Store storage bucket.

    Note that in order to send the source frame, the "send_source_frame" parameter must be enabled in the FaceStream settings, and the handler policy must have the saving of source images enabled (parameter "policies" > "storage_policy" > "image_origin_policy" > "store_image" = "1" ).

  • The ability to specify ROI or DROI coordinates as a percentage of the current frame size has been added.

    To achieve this, a new field called "mode" has been added to the parameters "roi" and "droi" in the "create stream", "get stream" and "get streams" requests of the LUNA Streams service.

    This field enables you to set one of two modes:

    • "abs" - parameters "x", "y", "width" and "height" are set in pixels (old variant);
    • "percents" - parameters "x", "y", "width" and "height" are set as percentages of the current frame size (new variant).

    If the "mode" field is not specified in the request body, then the value "abs" will be used. Thus, there is no need to recreate the old streams.

  • A new tag "estimator" has been added to the list of tags for logging (the "tags" parameter in the FaceStream settings), designed to collect and display statistics of completed estimates.

    When the tag is enabled in the FaceStream logs, information is returned on the size of the butches with which the estimators were called. In future releases, the list of returned information may be expanded.

    Example of log content with the "estimator" tag enabled:

    [I0609 15:48:03.779697 65 EstimatorStatistic.cpp:85] [estimator] Batch statistic for estimator HeadPoseEstimator Total calls: 1311 total time: 191 ms. sz cnt 1 1311 (100.00%) 2 0 (0.00%) 3 0 (0.00%) ... 16 0 (0.00%)

    In this case, the statistics show the following:

    • a total of 1311 calls were made to the "HeadPoseEstimator" estimator, which took 191 milliseconds;
    • all calls (1311) were processed individually, each in its own batch of size 1;
    • batch sizes from 2 to 16 were not used.

    If the estimators were not called, then no information will be output in the FaceStream logs.

  • The ability to disable filtering by AGS and pitch, yaw, roll angles has been added.

    To disable AGS filtering, you must set the value "0" for the "min_score" parameter in the stream management settings.

    To disable angle filtering, you must set the values "180" for the parameters "detection_pitch_threshold", "detection_roll_threshold" and "detection_yaw_threshold" in the stream management settings.

  • The GPU memory consumption of the FaceStream application has been reduced.

  • The default FaceStream monitoring settings are now similar to the default LUNA PLATFORM monitoring settings.

    This means that if the default settings are used for monitoring the LUNA PLATFORM, then to enable FaceStream monitoring, it is enough to enable the "send_data" parameter in the FaceStream settings. In this case, the FaceStream monitoring data will be saved to the "luna_monitoring" bucket.

  • The section of activating the LUNA PLATFORM license for LUNA Streams has been moved to a separate license activation manual "FS_without_LP/FS_License_Activation_Manual_Standalone_Eng.pdf/html".

    This manual also includes information on activating the LUNA PLATFORM license using Guardant keys (see the LUNA PLATFORM v.5.45.1 release notes for more information).

FaceStream developer's changes (v.5.1.24 - v.5.1.27)#

Improvements#

  • Added support for relative ROI/DROI.

  • Reduced video memory consumption on the video decoder side.

  • Added a new tag 'estimator' designed to collect and display statistics of estimators.

  • User can switch off the AGS and/or angles filtrations. For this it is needed to set the stream parameters into special values. The parameter min_score must be set into 0 for switching off the AGS filtration. Also it is needed to set three parameters: detection_pitch_threshold, detection_roll_threshold, and detection_yaw_threshold into 180 for switching off angles filtration.

  • Send the full frame image together with portraits. For this it is needed to set the parameter 'send_source_frame' in FaceStream configuration file to 'true' and define the parameter 'frame_store' in stream event handler as '//images' (for example, 'http://127.0.0.1:5000/6/images').

    It is needed to take in account the body and/or face detection handler must have the parameter storage_policy: image_origin_policy: store_image: 1.

LUNA Streams developer's changes (v.0.6.7 - v.0.6.13)#

Improvements#

  • Service dependencies were updated.

  • Added new roi and droi format for stream data. Old format is deprecated. See createStream, getStreams, getStream for more info.