Persons or vehicles recognition and tracking for video surveillance systems
SentiVeillance SDK is designed for developing software that performs biometric face identification, detects moving pedestrians or vehicles or other objects and performs automatic license plate recognition using live video streams from digital surveillance cameras.
The SDK is used for passive identification – when passers-by do not make any efforts to be recognized. List of possible uses includes law enforcement, security, attendance control, visitor counting, traffic monitoring and other commercial applications.
The ALPR modality from the SentiVeillance component performs real-time vehicle license plate (number plate) detection and recognition. The deep neural networks based algorithms feature:
- Reliable detection. License plates can be separated even in complex images, which contain objects like signboards or traffic signs. See the reliability tests below.
- Traffic data processing. SentiVeillance algorithms can simultaneously read vehicle license plates from multiple moving vehicles in road traffic.
- Tolerance to camera position. Depending on camera resolution, the ALPR algorithm can read license plates from longer distance and higher angle.
VH modality can be used together with the ALPR modality, especially in these cases:
- Vehicle data detection. In certain scenarios a vehicle type (i.e. truck or bus) has to be detected before running the license plate recognition algorithm. Also, vehicle movement direction, color or model can be needed as a filter before running license plate recognition.
- Preventing cheating with replaced license plates. Integrators can make software logic which checks if recognized license plate corresponds other registration data, like vehicle color or make and model, and not being spoofed or moved from another vehicle.
Programming samples from the SDK show how to use this modality.
A license for using the SentiVeillance ALPR modality on one video stream is included with SentiVeillance 8.0 SDK. Additional licenses or upgrade for the number of processed video streams in the existing licenses can be purchased any time by SentiVeillance 8.0 SDK customers.
We present the testing results to show SentiVeillance 8.0 ALPR algorithm reliability on the car images taken in different conditions. Images from the platesmania.com website were used for testing. The images were grouped into five datasets:
- Dataset 1 – lower quality images with license plates' width less than 100 pixels. License plates are further away. Images feature partial occlusions and high capture angles.
- Dataset 2 – medium quality images with license plates' width between 100 and 200 pixels. The images were captured at mid-range and the license plates are closer to camera.
- Dataset 3 – high quality images with license plates' width between 200 and 300 pixels. Most of the images were captured in parking lot scenario, with only few motion blur or poor lighting occurences.
- Dataset 4 – high quality images with license plates' width between 300 and 400 pixels. Most of the images were captured in parking lot scenario, with only few motion blur or poor lighting occurences.
- Dataset 5 – high quality images with license plates' width more than 400 pixels. Most of the images were captured in parking lot scenario, with only few motion blur or poor lighting occurences.
The pictures below illustrate sample images from each dataset:
Two experiments were performed with images from each dataset:
- Experiment 1 – the OCR was set to interpret 1 (one) as I (letter I) and 0 (zero) as O (letter O).
- Experiment 2 – the OCR had no specific rules on letters and numbers interpreteation.
|SentiVeillance 8.0 ALPR algorithm reliability testing|
|Dataset 1||Dataset 2||Dataset 3||Dataset 4||Dataset 5|
|License plate width (pixels)||less than 100||100-199||200-299||300-399||more than 400|
|Experiment 1 recognition ratio||90.58 %||97.50 %||99.48 %||99.86 %||100 %|
|Experiment 2 recognition ratio||87.54 %||94.89 %||97.44 %||98.95 %||98.63 %|