CARS API Performance#
Test Server Configuration#
The efficiency of recognition of vehicle or LP attributes depends on the parameters of the input image:
- Image size;
- Number of bits per color.
Input data:
- Vehicle image resolution: 500х439 px;
- LP image resolution: 117x33 px;
- Format of the original image: jpeg.
Table 43. Test Server Options
| № | Resource | Values |
|---|---|---|
| 1 | CPU | Model name: Intel(R) Xeon(R) Gold 6240R CPU @ 2.40GHz, Thread(s) per core: 2, Core(s) per socket: 24 |
| 2 | CPU frequency | 2.40GHz |
| 3 | RAM | 251Gb |
| 4 | Memory | 240GB INTEL SSDSC2KB24 |
| 5 | Video memory | 15109MiB |
| 6 | Operation system | CentOS 8 |
CARS API performance measurements are provided for several types of accelerators.
Table 44. Description of accelerator parameters during testing
| Name | Description |
|---|---|
| CPU | Running the CARS API on a server with a central processing unit (CPU) without support for Advanced Vector Extensions 2 (AVX2) instructions |
| AVX2 | Running the CARS API on a server with a CPU with support for AVX2 instructions |
| GPU | Running the CARS API on a server with GPU |
The values presented in this manual are the average values obtained based on the results of at least 100 experiments. All available CPU cores were used in the experiments to determine the attributes of the TS and LPs listed in the table below.
Performance test results#
The testing was carried out using the following classifiers:
- car_brand_model_v2;
- vehicle_color;
- vehicle_type;
- vehicle_emergency_type;
- public_transport_type;
- special_transport_type;
- grz_all_countries;
- vehicle_axles;
- vehicle_descriptor_v2.
/classify Request for classifiers#
Table 45. Test Results for /classify request
| Parameter | CPU | AVX2 | GPU |
|---|---|---|---|
| CPU usage (%) | 24.64 | 24.03 | 7.79 |
| CPU memory (Mb) | 5676 | 4713 | 5528 |
| GPU usage (%) | - | - | 94.75 |
| GPU memory (Gb) | - | - | 2.26 |
| RPS (transactions/s) | 6.57 | 21.09 | 31.93 |
| Response time (ms) | 1627.55 | 484 | 322 |
/detector request with cars and grz parameters#
Table 46. Test Results for /detector request with cars and grz parameters
| Parameter | CPU | AVX2 | GPU |
|---|---|---|---|
| CPU usage (%) | 18.35 | 24.2 | 9.37 |
| CPU memory (Mb) | 8217 | 5430 | 6218 |
| GPU usage (%) | - | - | 95.5 |
| GPU memory (Gb) | - | - | 2.62 |
| RPS (transactions/s) | 3.92 | 14.27 | 23.79 |
| CARS Response time (ms) | 1399 | 375 | 217 |
| GRZ Response time (ms) | 1401 | 309.3 | 161 |