13.03.2024 г.

Smart Engines has created an AI for multi-object recognition and protection against fraudsters

The Smart Engines company has introduced an AI capable of recognizing many documents in a single frame, up to dozens. This new system will help banks, microfinance organizations, and other fintech companies not only streamline the customer journey through the identification process but also protect themselves from fraudulent attacks.

It is a fundamentally new and much more convenient customer identification scenario. Previously, users who wanted to apply for a loan or use other banking services had to sequentially take photos and attach identity documents such as a national passport, ID card, driver’s license, and others to the application. On one hand, this process is not very convenient and time-consuming, and on the other hand, it leaves room for fraudsters. With the help of AI, fraudsters can generate document images or edit them using photo editors to pass anti-fraud checks.

The alternative state-of-the-art scenario created by Smart Engines researchers is based on multi-object document recognition. Now, the customer does not need to individually photograph the documents – it is enough to place them in a single frame and take a picture. The AI will handle all the rest of the work. Thanks to the latest achievements in computer vision and machine learning by scientists, the system automatically detects documents, recognizes all necessary fields, and detects any fraudulent attacks – traces of Photoshop or other interventions. If a fraudster “inserts” a document into the image or assembles several documents – the system instantly detects manipulations.

The number of documents in a photo is essentially limited only by the device’s camera capability, as Smart Engines’ proprietary OCR is trained to recognize any legible text.  Recognition of all documents in a photo takes literally a second, making the new user journey not only safer for banks but also convenient for the customer. This speed is achieved through their own OCR technology using ultra-light neural networks.

The functionality is included in the new version of the Smart ID Engine 2.3.0 software product. In addition to these features, it contains several other important improvements. For example, 24 new types of identity documents that were previously unsupported have been added to Smart ID Engine. These include new documents from African countries (such as driver’s licenses in Libya, ID cards in Sierra Leone, or visas for Madagascar) and several European countries (medical cards in Finland or military tickets in Norway). 69 new subtypes of identity documents have been added, including those from Argentina, Armenia, Brazil, Germany, France, and others. Thus, the Smart Engines product currently supports recognition of 2709 (+142) types of documents with 4305 (+258) unique templates.