Conference paper Open Access

Identity documents recognition and detection using semantic segmentation with convolutional neural network

Kozlenko, Mykola; Sendetskyi, Volodymyr; Simkiv, Oleksiy; Savchenko, Nazar; Bosyi, Andy

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.5758182</identifier>
      <creatorName>Kozlenko, Mykola</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-2502-2447</nameIdentifier>
      <affiliation>Vasyl Stefanyk Precarpathian National University</affiliation>
      <creatorName>Sendetskyi, Volodymyr</creatorName>
      <affiliation>MindCraft AI LLC</affiliation>
      <creatorName>Simkiv, Oleksiy</creatorName>
      <affiliation>MindCraft AI LLC</affiliation>
      <creatorName>Savchenko, Nazar</creatorName>
      <affiliation>MindCraft AI LLC</affiliation>
      <creatorName>Bosyi, Andy</creatorName>
      <affiliation>MindCraft AI LLC</affiliation>
    <title>Identity documents recognition and detection using semantic segmentation with convolutional neural network</title>
    <subject>identity document</subject>
    <subject>object detection</subject>
    <subject>semantic segmentation</subject>
    <subject>document recognition</subject>
    <subject>document classification</subject>
    <subject>deep learning</subject>
    <subject>neural network</subject>
    <date dateType="Issued">2021-01-28</date>
  <resourceType resourceTypeGeneral="ConferencePaper"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.5758181</relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;Object recognition and detection are well-studied problems with a developed set of almost standard solutions. Identity documents recognition, classification, detection, and localization are the tasks required in a number of applications, particularly, in physical access control security systems at critical infrastructure premises. In this paper, we propose the new original architecture of a model based on an artificial convolutional neural network and semantic segmentation approach for recognition and detection of identity documents in images. The challenge with the processing of such images is the limited computational performance and the limited amount of memory when such an application is running on industrial one-board microcomputer hardware. The aim of this research is to prove the feasibility of the proposed technique and to obtain quality metrics. The methodology of the research is to evaluate the deep learning detection model trained on the mobile identity document video dataset. The dataset contains five hundred video clips for fifty different identity document types. The numerical results from simulations are used to evaluate the quality metrics. We present the results as accuracy versus threshold of the intersection over union value. The paper reports the accuracy above 0.75 for the intersection over union (IoU) threshold value of 0.8. Besides, we assessed the size of the model and proved the feasibility of running the model on industrial one-board microcomputer or smartphone hardware.&lt;/p&gt;</description>
    <description descriptionType="Other">M. Kozlenko, V. Sendetskyi, O. Simkiv, N. Savchenko, and A. Bosyi, "Identity documents recognition and detection using semantic segmentation with convolutional neural network," CEUR Workshop Proceedings, vol. 2923, pp. 234-242, Jan. 28, 2021,</description>
All versions This version
Views 5252
Downloads 2626
Data volume 36.9 MB36.9 MB
Unique views 4747
Unique downloads 2424


Cite as