Detectors#

The detectors used in the CARS API subsystem are used to find the vehicle and LP in the image. Detectors determine the location of the vehicle and LP, allocate the corresponding BBox.

This section provides information about the vehicles and LP detectors. Detectors are specified in the configuration file /data/vehicleEngine.conf (see Appendix 2).

Detectors can be tested in the CARS_API_tester interface (see CARS Analytics. Administrator manual).

Vehicle detector#

Vehicle detectors are designed to detect vehicle in images. The list of vehicle detectors is given in Table 24.

Table 24. Vehicle detector description

Name	Description
VehicleDetectorV4	Vehicle detector of the latest version that allows you to obtain information about the position of the vehicle in the image. Detector has a number of advantages:
	- Improved performance;
	- Increased speed and accuracy;
	- The presence of an algorithm for redetection of vehicle to improve the accuracy;
	- Possibility to work with images received from cameras installed at a considerable height (birdview images support);
	- Fixed issue of false positive detections for cameras set on houses.
	This version includes additional parameters configurations for vehicle and LP detectors.

Detection fields received as a result of the detector work are described in Table 25.

Table 25. Description of the vehicle detection fields

Field name	Type	Description	Possible values
detections		An array containing the coordinates and size of the detections of each vehicle in the image, as well as an estimate of the accuracy of vehicle detection	List of detected vehicles.
execution_time	int	Execution time in milliseconds	-
height	int	Bbox height.	0…1080
score	float	Estimation of TS detection accuracy.	0.0000…1.0000
width	int	Bbox width.	0…1920
x	int	The horizontal coordinate of the upper left corner of the BBox.	0…1920
y	int	The vertical coordinate of the top left corner of the BBox.	0…1080
detection	string	The name of the detector type.	car

Response example:

{
    "detections": [
        {
            "height": 298,
            "score": 0.9394,
            "width": 514.006,
            "x": 0,
            "y": 0
        }
    ],
    "detector": "car",
    "execution_time": 153
}

LP detector#

The list of LP detectors is given in Table 26.

Table 26. LP detector description

Name	Description
PlateDetectorV5	The latest version of the license plate detector, which allows you to get information about the position of license plates on the image. It has a number of changes relative to previous versions:
	- Improved accuracy;
	- Now we can detect multiple license plates on the same vehicle;
	- Detection of relevant license plate number (related to the desired vehicle);
	- Reduced speed relative to PlateDetectorV4.

Detection fields received as a result of the detector work are described in Table 27.

Table 27. Description of the LP detection fields

Field name	Type	Description	Possible values
detections		An array containing a list of all detected LPs on the image.	List of detected LPs.
execution_time	int	Execution time in milliseconds	-
height	int	Bbox height.	0…1080
score	float	Estimation of LPs detection accuracy.	0.0000…1.0000
width	int	Bbox width.	0…1920
x	int	The horizontal coordinate of the upper left corner of the BBox.	0…1920
y	int	The vertical coordinate of the top left corner of the BBox.	0…1080
detection	string	The name of the detector type.	grz

Response example:

{
    "detections": [
        {
            "height": 40,
            "score": 1,
            "width": 72,
            "x": 413,
            "y": 217
        }
    ],
    "detector": "grz",
    "execution_time": 252
}

Animal detector#

The animal detector is designed for the detection and redetection of animals on multimedia files.

A license is required for Animal detector (see "LUNA CARS. Installation Guide").

The description of the animal detector is given in Table 28.

Table 28. Animal detector description

Name	Description
AnimalDetectorV1	An animal detector that allows you to get information about the location and position of animals in a sequence of frames

Detection fields received as a result of the detector work are described in Table 29.

Table 29. Description of the animal detector fields

Field name	Type	Description	Possible values
detections		An array containing the coordinates and size of detections of each animal in the image, as well as an estimate of detection accuracy	List of detected animals.
execution_time	int	Execution time in milliseconds	-
height	int	Bbox height.	0…1080
score	float	Estimation of animal detection accuracy.	0.0000…1.0000
width	int	Bbox width.	0…1920
x	int	The horizontal coordinate of the upper left corner of the BBox.	0…1920
y	int	The vertical coordinate of the top left corner of the BBox.	0…1080
detection	string	The name of the detector type.	animal

Response example:

{
    "detections": [
        {
            "height": 708,
            "score": 0.921549916267395,
            "type": "small_animal",
            "width": 1269,
            "x": 1,
            "y": 214
        }
    ],
    "detector": "animal",
    "execution_time": 167
}

Smoke/Fire detector#

Smoke and fire detector is designed to detect fires on video streams and video files.

Smoke and fire detector description is given in Table 30.

Table 30. Smoke and fire detector description

Name	Description
smokeFireDetectorV1	Smoke and fire detector, allows you to receive information about smoke and/or fire detection on a video stream or video file.

Detection fields received as a result of the detector work are described in Table 31.

Table 31. Description of the smoke/fire detector fields

Field name	Type	Description	Possible values
detections		An array containing the coordinates, detection area size and the detections of fire or smoke in the image, as well as an estimate of the detection accuracy	List of detected zones.
execution_time	int	Execution time in milliseconds	-
height	int	Height of detection zone	0…1080
score	float	Estimation of smoke/fire detection accuracy.	0.0000…1.0000
width	int	Width of detection zone	0…1920
x	int	The horizontal coordinate of the upper left corner of the BBox.	0…1920
y	int	The vertical coordinate of the top left corner of the BBox.	0…1080
detection	string	The name of the detector type.	smoke_fire

Response example:

{
    "detections": [
        {
            "height": 958,
            "score": 0.828738808631897,
            "type": "fire",
            "width": 955,
            "x": 0,
            "y": 0
        }
    ],
    "detector": "smoke_fire",
    "execution_time": 518
}