Tunisian License Plate Number Recognition - ScienceDirect

Available online at www.sciencedirect.com

ScienceDirect Procedia Computer Science 73 (2015) 312 – 319

7KH,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFHG:LUHOHVV,QIRUPDWLRQDQG&RPPXQLFDWLRQ 7HFKQRORJLHV$:,&7

7XQLVLDQ/LFHQVH3ODWH1XPEHU5HFRJQLWLRQ 6DPL.WDWD 7DKHU.KDGKUDRXL)DRX]L%HQ]DUWL+DPLG$PLUL LR-SITI Laboratory, National Engineering School of Tunis, Tunis El Manar University, BP 37, 1002 Tunis-Belvédère, Tunisia University of Tunis El Manar

$EVWUDFW /LFHQVH3ODWH5HFRJQLWLRQ/35 V\VWHPSOD\VDYHU\LPSRUWDQWUROHLQLQWHOOLJHQWWUDIILFFRQWURODQGVHFXULW\PDQDJHPHQWVXFKDV SDUNLQJHQIRUFHPHQWVWROHQYHKLFOHUHFRYHU\DQGVXUYHLOODQFHRSHUDWLRQV7KLVUHVHDUFKGHVFULEHVDQHZPHWKRGIRUWKHQXPEHU UHFRJQLWLRQRI7XQLVLDQOLFHQVHSODWH%DVHGRQORZSDVVILOWHULQOLFHQVHSODWHH[WUDFWLRQPRGXOHDQGQHWZRUNLQ/35WKHSURSRVHG PHWKRGVKRZVDJUHDWUREXVWQHVVLQPRVWXQIDYRUDEOHFRQGLWLRQV 7KH$XWKRUV3XEOLVKHGE\(OVHYLHU%9 © 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). 3HHUUHYLHZXQGHUUHVSRQVLELOLW\RIRUJDQL]LQJFRPPLWWHHRIWKH,QWHUQDWLRQDO&RQIHUHQFHRQ$GYDQFHG:LUHOHVV,QIRUPDWLRQ Peer-review under responsibility of organizing committee of the International Conference on Advanced Wireless, Information, DQG&RPPXQLFDWLRQ7HFKQRORJLHV$:,&7 and Communication Technologies (AWICT 2015) Keywords:/LFHQVHSODWHH[WUDFWLRQVHJPHQWDWLRQQHXUDOQHWZRUNOLFHQVHSODWHGHWHFWLRQ

,QWURGXFWLRQ 7KHOLFHQVHSODWHUHFRJQLWLRQV\VWHPDSSOLHVJHQHUDOO\LPDJHSURFHVVLQJDQGFKDUDFWHUUHFRJQLWLRQWHFKQRORJ\LQ RUGHUWRLGHQWLI\YHKLFOHVE\DXWRPDWLFDOO\UHDGLQJWKHLUOLFHQVHSODWHV:HSHUIRUPHGDV\VWHPRIDQDXWRPDWHGUHDGLQJ RI OLFHQVH SODWHV LQ RUGHU WR LGHQWLI\ YHKLFOHV 7KH PDLQ JRDO RI WKLV SDSHU LV WR LPSOHPHQW D UREXVW PHWKRG LQ UHFRJQL]LQJ7XQLVLDQOLFHQVHSODWHVLQYDULRXVFRQGLWLRQVVXFKDVSRRULPDJHTXDOLW\LPDJHSHUVSHFWLYHGLVWRUWLRQ RWKHUGLVWXUEDQFHFKDUDFWHUVRUUHIOHFWLRQRQYHKLFOHVXUIDFHDQGWKHFRORUVLPLODULW\EHWZHHQWKHOLFHQVHSODWHDQG EDFNJURXQGYHKLFOHERG\

&RUUHVSRQGLQJDXWKRU7HO E-mail address:VDPLNWDWD#IVHJQUQXWQ

1877-0509 © 2015 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). Peer-review under responsibility of organizing committee of the International Conference on Advanced Wireless, Information, and Communication Technologies (AWICT 2015) doi:10.1016/j.procs.2015.12.038

Sami Ktata et al. / Procedia Computer Science 73 (2015) 312 – 319

*HQHUDOO\/LFHQVH3ODWH5HFRJQLWLRQV\VWHPLQFOXGHVWKHIROORZLQJVWHSVYHKLFOHLPDJHDFTXLVLWLRQOLFHQVHSODWH LPDJHORFDWLRQLPDJHSUHSURFHVVLQJDQGFKDUDFWHUUHFRJQLWLRQ7KHGHWHFWLRQVWHSLVFUXFLDOIRUWKH/35UHVXOW6RPH DSSOLFDWLRQVXVHWZRVHWVRI/3DQGQRQ/3UHJLRQVIRU/3FODVVLILFDWLRQ 7KHFKDUDFWHUVVHJPHQWDWLRQVWHSVHSDUDWHVFKDUDFWHUVIURPRWKHUVLQD/3VRWKDWRQO\WKHSUHFLVHFRQWRXUVRIHDFK FKDUDFWHU LPDJH EORFN DUH NHSW IRU UHFRJQLWLRQ )LQDOO\ WKH FKDUDFWHU UHFRJQLWLRQ VWHS FRQYHUWV LPDJHV EDVHG RQ SUHGHILQHGUHFRJQLWLRQPRGHOV 7KHSUHVHQWSDSHULVVWUXFWXUHGDVIROORZVILUVWDVXUYH\RIUHODWHGZRUNVLVSURYLGHG6HFRQGO\DQRYHUYLHZRI WKHV\VWHPDQGLWVVXEV\VWHPVLVSUHVHQWHG7KHSDSHUFRQFOXGHVZLWKDQHYDOXDWLRQRIRXUPHWKRGSHUIRUPDQFHRQWKH /35V\VWHPDQGDGLVFXVVLRQRISRVVLEOHH[WHQVLRQV 3UHYLRXVZRUNV 7KLVVHFWLRQSURYLGHVDEULHIUHIHUHQFHWRWKHUHOHYDQWOLWHUDWXUHGHSHQGLQJRQWKHLUPDMRUFRQWULEXWLRQWRWKHWKUHH W\SLFDOVWDJHVRIOLFHQVHSODWHUHFRJQLWLRQ 2.1. License plate detection 7\SLFDOOLFHQVHSODWHGHWHFWLRQV\VWHPVDUHEDVHGRQWKHIROORZLQJWHFKQLTXHVHGJHGHWHFWLRQVWDWLVWLFDODQDO\VLV PDWKHPDWLFDOPRUSKRORJ\DGDSWLYHERRVWLQJQHXUDOQHWZRUNVFRDUVHWRILQHVWUDWHJLHVDQGYHFWRUTXDQWL]DWLRQ $ PHWKRG SURSRVHG E\ >@ LQ ZKLFK WKH DXWKRUV RQVLGHU IRXU VWHSV WR GHWHFW /3 YHUWLFDO HGJH GHWHFWLRQ HGJH VWDWLVWLFDO DQDO\VLV KLHUDUFKLFDOEDVHG OLFHQVH SODWH ORFDWLRQ DQG PDWKHPDWLFDO PRUSKRORJ\EDVHG OLFHQVH SODWH H[WUDFWLRQ7KHGDWDEDVHLVUHDFTXLUHGLQGLIIHUHQWOLJKWLQJFRQGLWLRQVFORXG\VXQQ\DQGQLJKWWLPH 6REHORSHUDWRU PDWKHPDWLFDOPRUSKRORJLFDORSHUDWRUVDQGFRORUDQDO\VLVDUHXVHGLQRUGHUWRH[WUDFWWKHYHUWLFDOHGJHVRIWKHLPDJHV ZKLOHPRVWRIWKHEDFNJURXQGHGJHVDUHUHPRYHG>@7KLVPHWKRGLVWHVWLQJLPDJHVLQGLIIHUHQWFRQGLWLRQV $UREXVWDSSURDFKFRQVLGHUVGLIIHUHQWIHDWXUHVRIOLFHQVHSODWH7KH\WU\WRILQGWKHOLFHQVHSODWHFDQGLGDWHVEDVHG RQYHUWLFDOHGJHVPRUSKRORJLFDORSHUDWLRQDQGFRORUDQDO\VLVRIWKHLPDJHVWKHQWKH\HOLPLQDWHWKHLQFRUUHFWFDQGLGDWH UHJLRQVEDVHGRQLPDJHVIHDWXUHVLQRUGHUWRREWDLQWKHFRUUHFWOLFHQVHSODWHUHJLRQV)XUWKHUPRUH>@XVHDQRYHO PDWFKHGILOWHUZKLFKZDVVXJJHVWHGWRGHWHFWSODWHFDQGLGDWHV7KLVILOWHUPRGHOVWKHGHQVLW\RIYHUWLFDOHGJHDWWKH QHLJKERUKRRGRISODWHDUHD,WLVGHILQHGDVDPL[WXUHRI*DXVVLDQIXQFWLRQV 2WKHUDSSURDFKEDVHGRQ':7'LVFUHWH:DYHOHW7UDQVIRUP LVSURSRVHG>@7KH/3ORFDOL]DWLRQFDQEHH[WUDFWHG IURPGLIIHUHQWTXDOLW\RIVRXUFHLPDJHVXQGHUFRPSOH[HQYLURQPHQWVE\XVLQJWZRIUHTXHQF\VXEEDQGV7KH\ILUVWXVH WKH+/VXEEDQGWRVHDUFKWKHIHDWXUHVRI/3DQGWKHQYHULI\WKHIHDWXUHVE\FKHFNLQJZKHWKHULQWKH/+VXEEDQGH[LVWV DKRUL]RQWDOOLQHDURXQGWKHIHDWXUH $Q /35 WHFKQLTXH ZKLFK EDVHG RQ WZR PDLQ PRGXOHV LV SURSRVHGE\ >@ 7KH OLFHQVH SODWH ORFDWLQJ PRGXOH DWWHPSWV WR H[WUDFW /3 IURP DQ LQSXW LPDJH DQG WKHQ LW ZLOO LGHQWLI\ WKH OLFHQVH QXPEHU PRGXOH ZKLFK LV FRQFHSWXDOL]HGLQWHUPVRIQHXUDOQHWZRUNVWKDWDLPWRLGHQWLI\WKHQXPEHULQWKH/3 5HFHQWVWXGLHVRI>@SURSRVHGDUREXVWPHWKRGIRUH[WUDFWLQJDQGGHWHFWLQJOLFHQVHSODWHVIURPVLPSOHLPDJHVRI 7XQLVLDQYHKLFOHVEDVHGRQ*DERUILOWHUVDQGQHXUDOQHWZRUNV 2.2. Character segmentation and recognition 0DQ\WHFKQLTXHVKDYHEHHQDSSOLHGWRGHWHFWWKHFKDUDFWHUUHJLRQVLQDQLQSXWSODWHLPDJH(GJHGHWHFWLRQDSSURDFK LQ>@IRUFKDUDFWHUVHJPHQWDWLRQDPXOWLVW\OH/3SURFHVVLQJLVDSSOLHG+RZHYHUIRXUFULWLFDOIDFWRUVSURSRVHG SODWHURWDWLRQDQJOHFKDUDFWHUOLQHQXPEHUWKHDOSKDQXPHULFW\SHVXVHGDQGFKDUDFWHUIRUPDWV%RWKSURFHGXUHVEDVHG RQDPDWKHPDWLFDOPRUSKRORJ\DSSURDFKDQGFRQQHFWHGFRPSRQHQWVDQDO\VLVDUHFRQVLGHUHG>@,QGHHGDPXOWLSOH LPDJHELQDUL]DWLRQXVLQJGLIIHUHQWJOREDOWKUHVKROGVWKHQD'0DUNRY5DQGRP)LHOGVLVDSSOLHG*HQHWLFDOJRULWKPV >@DQGODWHUDOKLVWRJUDPDQDO\VLVSURSRVHG>@LQ)HHG)RUZDUG1HXUDO1HWZRUNVDUHFRQVLGHUHGDQGWUDLQHGZLWK WKH%ORFN5HFXUVLYH/HDVW6TXDUHV%5/6 OHDUQLQJDOJRULWKP $GLUHFWWHPSODWHPDWFKLQJ>@LVXVHGRQWKHZKROHSODWHLPDJH(DFKVXELPDJHLVFKHFNHGIRUDWHPSODWHXVLQJ DFURVVFRUUHODWLRQRSHUDWRU

313

314


7KHSURSRVHGPHWKRG 7KH SUHVHQWZRUN LVUHODWHG WRUHFHQW DSSURDFKHV LQ WLPHIUHTXHQF\ DQDO\VLV EXW LWFDSLWDOL]HV RQ DQHZIHDWXUH VSDFHEDVHGRQDXWRFRUUHODWLRQIHDWXUHDQGQHXUDOQHWZRUNUHFRJQLWLRQ ,QWKLVVHFWLRQDQRYHUYLHZRIWKHSURSRVHGPHWKRGWKDWLPSOHPHQWVWKHDYHUDJHGSL[HOVDOJRULWKPLVSUHVHQWHG 7KHSURSRVHGV\VWHPLQFRUSRUDWHVWKHIROORZLQJVXEV\VWHPV/LFHQVH3ODWH'HWHFWLRQ&KDUDFWHU6HJPHQWDWLRQDQG 5HFRJQLWLRQ)LJVKRZVWKHDUFKLWHFWXUHRIWKHSURSRVHGPHWKRG

)LJ*OREDO0HWKRG$UFKLWHFWXUH

3.1. Plate extraction 7KHIORZFKDUWRIWKH/3H[WUDFWLRQPRGXOHZDVSUHVHQWHGLQ)LJ7KHGLODWDWLRQVWHSUHPRYHVVRPHFKDUDFWHULVWLFV RI WKH LPDJH GXH WR ORVV RI VRPH LPSRUWDQW SDUDPHWHUV VXFK DV FRORU GLIIHUHQFH HGJHV LOOXPLQDWLRQ GXULQJ WKH FRQYHUVLRQIURP5*%WRJUD\IRUP )LJ)ORZFKDUWRIWKHOLFHQVHSODWHH[WUDFWLRQPRGXOH

315


1H[WZHSURFHVVKHHGJHVLQWKHERWKKRUL]RQWDODQGYHUWLFDOGLUHFWLRQKRUL]RQWDODQGYHUWLFDOKLVWRJUDP ,QGHHG WKH\UHSUHVHQWWKHVXPRIGLIIHUHQFHVRIJUD\YDOXHVEHWZHHQQHLJKERXULQJSL[HOVRIDQLPDJHFROXPQZLVHDQGURZ ZLVH7KHQHDFKKLVWRJUDPLVSDVVHGWKURXJKDORZSDVVILOWHULQRUGHUWRVPRRWKRXWVXFKGUDVWLFFKDQJHVLQYDOXHV RIKLVWRJUDPEHWZHHQFRQVHFXWLYHFROXPQVDQGURZV6R/RZSDVVILOWHUVDUHXVHGWRVPRRWKWKHLPDJHDQGUHPRYH WKHKLJKIUHTXHQF\FRPSRQHQWVUHODWHGWRQRLVH6PRRWKLQJHIIHFWLVDFKLHYHGLQWKHIUHTXHQF\GRPDLQE\DWWHQXDWLQJ DVSHFLILHGUDQJHRIKLJKIUHTXHQF\FRPSRQHQWVLQWKHWUDQVIRUPHGLPDJH

I D x y

k k ¦ ¦ H i j I s x i y j c i k j k

7KLVLPSOLHVWKHVFDQQLQJRIWKHVRXUFHLPDJH I s SL[HOE\SL[HOLJQRULQJWKHILUVWDQGODVW k URZVDQGFROXPQVDQG WKHFRPSXWDWLRQRIWKHLQWHQVLW\YDOXHLQWKHFXUUHQWSRVLWLRQ x y RIWKHGHVWLQDWLRQLPDJH I D 7KHFRQYROXWLRQ PDVNLVSRVLWLRQHGVSDWLDOO\ZLWKLWVFHQWUDOHOHPHQWRYHUWKHFXUUHQWSRVLWLRQ x y

k

:KHUH c

k

¦ ¦ H i j

i k j k

H i j 7KHILOWHUIXQFWLRQJLYHQE\WKHIROORZHTXDWLRQ H i j ® ¯

Di j d D Di j

D

:KHUH D LVDVSHFLILHGSRVLWLYHTXDQWLW\DQG Di j i j LVWKHGLVWDQFHIURP i j WRWKHFHQWHURI WKHPDVN)LQDOO\DG\QDPLFWKUHVKROGHTXDOWRWKHDYHUDJHYDOXHRIDKLVWRJUDPLVDSSOLHGWRILOWHURXWERWK KRUL]RQWDODQGYHUWLFDOKLVWRJUDPVYDOXHV:HREWDLQUHJLRQVKDYLQJKLJKSUREDELOLW\RIFRQWDLQLQJDQXPEHUSODWH )LJVKRZWKHLQSXWLPDJHDQGWKHLUILOWHUHGKRUL]RQWDODQGYHUWLFDOKLVWRJUDP)URPWKHDERYHKLVWRJUDPVZHORRN IRUGLIIHUHQWUHJLRQVZKLFKKDYHPD[LPXPSUREDELOLW\RIFRQWDLQLQJDOLFHQVHSODWH7KHQZHORRNIRUWKHUHJLRQ ZLWKWKHPD[LPXPYDOXHRIWKHKLVWRJUDPZKLFKFRQVLGHUHGWKHPRVWOLNHO\FDQGLGDWHIRUWKHOLFHQVHSODWH7KHUHVW GRHVQRWFRUUHVSRQGWRWKHSODWHVZLOOEHUHPRYHGIURPWKHLPDJH

)LJ9HUWLFDODQG+RUL]RQWDO(GJH3URFHVVLQJ+LVWRJUDP

316


3.2. Skew correction %HIRUHWKHQXPEHUVHJPHQWDWLRQRSHUDWLRQZHXVHVRPHPRUSKRORJLFDOWUHDWPHQWV,QIDFWZHXVHGLODWLRQHURVLRQ DQGRSHQLQJRSHUDWLRQVZLWKWKHVDPHVWUXFWXULQJHOHPHQW,QVRPHLPDJHVZHPXVWHIIHFWVRPHSUHSURFHVVLQJIRU VNHZFRUUHFWLRQ6RDIWHUILOWHULQJWKHLPDJHUHVXOWZLOOEHSURFHVVHGWRFDOFXODWHWKHDQJOHRIVNHZRIWKHZULWLQJOLQH RIFKDUDFWHUVWKHUHIRUHWKHLPDJHZLOOEHFRUUHFWHGE\URWDWLQJDFFRUGLQJWRWKHFDOFXODWHGDQJOHEDVHGRQWKHFHQWHUV RIFRQQHFWHGUHJLRQVWKDWIRUPFKDUDFWHUV>@ 7KHPDLQLGHDLVWRILQG³YDOLG´FKDUDFWHUUHJLRQVDQGFRPSXWHFHQWURLGRIHDFK³YDOLG´UHJLRQ7KHOHDVWVTXDUH OLQH y ax b LVJHQHUDWHGE\WKHVHFHQWURLGV)LQDOO\WKHVNHZDQJOHTEHWZHHQOHDVWVTXDUHOLQHDQGKRUL]RQWDO OLQHFDQEHFDOFXODWHGE\WKH T DUFWDQ k /HWF(x,y)WKHVNHZHGLPDJHF’(x’,\¶ LVWKHGHVWLQDWLRQLPDJHZLWKRXW VNHZZDVFDOFXODWHGXVLQJWKHIROORZHTXDWLRQ 7KHRXWSXWLVVKRZQE\WKHILJ

ªx º « » ¬y ¼

ª FRVT « VLQ T ¬

VLQ T º ª x º FRVT »¼ «¬ y »¼

)LJ$QJOHRIVNHZFRUUHFWLRQHTXDWLRQ

3.3. Number segmentation 7KHDLPRIWKLVVWDJHLVWRVHSDUDWHWKHQXPEHUVIURPWKHSODWHLQRUGHUWRVLPSOLI\WKHUHFRJQLWLRQWDVNIRUWKH QHXUDOQHWZRUN7KLVVWHSWDNHVDVLQSXWWKHLPDJHRIWKHFRUUHFWHGSODWHSUHSURFHVVHGDQGWKDWFRQWDLQVRQO\QXPEHUV LQWKHSODWH7KHVHJPHQWDWLRQLVSHUIRUPHGE\UHJLRQ7KHVHJPHQWDWLRQEDVHGRQUHJLRQVLVDVSHFLILFDSSURDFKXVHG WRFUHDWHVXUIDFHVLQJDWKHULQJQHLJKERULQJSL[HOVDFFRUGLQJWRDKRPRJHQHLW\FULWHULRQVXFKDVJUD\OHYHORUWH[WXUH 3L[HOVDUHJURXSHGLQWRUHJLRQVDQGZKLFKIRUPDSDUWLWLRQRIWKHLPDJH7KHUHVXOWLVDVHWRIUHJLRQVZKLFKIRUPE\ WKHLUPHHWLQJWKHHQWLUHLPDJH 7KHVHUHJLRQVDUHUHODWHGDOOSL[HOVLQWKHVDPHUHJLRQDUHFRQWLJXRXV IRUPHGE\KRPRJHQHRXVSL[HOVEHWZHHQ WKHP$VDJDLQVWWKHSL[HOVRIDGMDFHQWUHJLRQVDUHQRWXQLIRUPEHWZHHQWKHP,QIDFWWKHVHJPHQWDWLRQE\UHJLRQ UHSUHVHQWVDSDUWLWLRQRIWKHLPDJHLQWRUHJLRQV555QWKDWVDWLVI\DKRPRJHQHLW\FULWHULRQ 3.4. Feature extraction 7KHIHDWXUHVH[WUDFWLRQPRGXOHUHFRJQLWLRQLVEDVHGRQDYHUDJHGSL[HOVPHWKRG,QIDFWWKHPDWUL[RIWKHLPDJHLV IUDJPHQWHGLQWRS[TDUHDVRIWKHVDPHVL]H7KHDYHUDJHYDOXHRIJUD\OHYHOVRIDOOSL[HOVLQHDFKDUHDLVFDOFXODWHG 7KHQWKHUHVXOWLVXVHGDVDQHOHPHQWRIWKHIHDWXUHYHFWRUZKLFKKDYHWKHVDPHVL]HRIS[T)LJVKRZVWKHPHWKRG SULQFLSOHDQGLWVUHVXOWDSSOLHGRQDH[WUDFWHGOLFHQVHSODWHLPDJH2WKHUZLVHZHUHVL]HLQWKHILUVWVWDJHWKHFKDUDFWHU LPDJHREWDLQHGDIWHUVHJPHQWDWLRQ


7KHSURFHVVRIFKDUDFWHUVQRUPDOLVDWLRQPDNHVYHU\HDVLO\WKHGHFUHDVHRIWKHLUVL]H6LQFHLWLVHQRXJKWRUHGXFH WKH QRUPDOLVDWLRQ GLPHQVLRQV YDOXHV 6HYHUDO SL[HOV RI WKH RULJLQDO LPDJH DUH EHLQJ UHSODFHG E\ WKHLU DYHUDJH DULWKPHWLF YDOXH :KHQ WKH QRUPDOLVDWLRQ GLPHQVLRQ EHFRPHV UHODWLYHO\ ORZ LW LV SUHIHUDEOH WR SUHVHUYH DIWHU UHGXFWLRQDQLPDJHLQOHYHOVRIJUD\UDWKHUWKDQELQDU\ 7KLVLVDQLPSRUWDQWVWHSWRPLQLPL]HWKHORVVRILQIRUPDWLRQ7KHQRUPDOLVDWLRQGLPHQVLRQVPXVWEHVXIILFLHQWO\ KLJKLQRUGHUWRDYRLGWKHORVVRIGLVFULPLQDWLQJLQIRUPDWLRQ )LJ$YHUDJHGSL[HOVPHWKRGSULQFLSOH

:HSHUIRUPWKHVXPRIHDFKLWHPVLQDFROXPQIRUHDFKOLQHVDQGWKHQZHFDOFXODWHWKHVXPRIWKHREWDLQHG YDOXHVLQDYHFWRUV:HUHSHDWWKLVVWHSIRUWKHQLQHIROORZLQJFROXPQ7KHQZHJHQHUDWHDQRWKHUYHFWRUkZKLFKWKH VXPRIVHOHPHQWV7KLVRSHUDWLRQZLOOEHUHSHDWHGXQWLOWKHHQGRIWKHPDWUL[VL]HRIWKHLPDJH7KHkYHFWRUZLOO FRQWDLQHOHPHQWVDVVRFLDWHWRWKHPDWUL[VL]HRIWKHLPDJH,QDODVWVWHSZHFDOFXODWHWKHIHDWXUHH[WUDFWLRQYHFWRU VcE\DSSO\LQJWKHDYHUDJHRIVHOHPHQWV

Vci

ki

i >@

3.5. Number recognition )RUWUDLQLQJZHXVHD1HXUDO1HWZRUNDVDFODVVLILHU7KHFODVVLILHUKDVLQSXWVFRUUHVSRQGLQJWRWKHYHFWRUVRI GHVFULSWRUVJHQHUDWHGXVLQJDYHUDJHGSL[HOVPHWKRGDQGLWKDVRXWSXWVFRUUHVSRQGLQJWRWHQFKDUDFWHUV7KH QHWZRUNZDVWUDLQHGZLWKWKHVFDOHGFRQMXJDWHJUDGLHQWEDFNSURSDJDWLRQIXQFWLRQ0XOWL/D\HUFROOHFWLRQZLWKEDFN SURSDJDWLRQDOJRULWKPWUDLQLQJ 7KHXVHG1HXUDO1HWZRUNVQHHGWKUHHOD\HUVRQHLQSXWRQHKLGGHQDQGRQHRXWSXW 7KHOHDUQLQJVWHSLVVXSHUYLVHGDQGLWEDVHGRQWKHJUDGLHQWEDFNSURSDJDWLRQDOJRULWKPZKLFKLVDJHQHUDWHGRQ :LGURZ+RIIOHDUQLQJUXOHE\LQZKLFKWKHHUURULVQRWUHVWULFWHGWRKDYLQJYDOXHVRIRUEXWPD\KDYHDQ\ YDOXH$GGLWLRQDOLWFDQEHGHULYHGIRUDQ\GLIIHUHQWLDEOHRXWSXWDFWLYDWLRQIXQFWLRQ ([SHULPHQWDOUHVXOWV ,QWKLVVHFWLRQZHSUHVHQWWKHUHVXOWVRIWHVWVRIH[WUDFWLRQDQGUHFRJQLWLRQPRGXOHVRIOLFHQVHSODWH ,QGHHGWKHSURSRVHGPHWKRGLVHYDOXDWHGRQD3&ZLWKu*+]&38*%5$0DQG:LQGRZVRSHUDWLQJ V\VWHP7KHPHWKRGLVLPSOHPHQWHGXVLQJWKH0DWODE7RWHVWWKHSHUIRUPDQFHRIWKLVPHWKRGZHFRPSDUHWKHUHVXOWV RIRXUPHWKRGIRUWKHERWKOLFHQVHSODWHH[WUDFWLRQDQGUHFRJQLWLRQPRGXOHV

317

318


4.1. LP and Character Image Database ([SHULPHQWVRIGHWHFWLRQDQGUHFRJQLWLRQZHUHFDUULHGRXWLQRUGHUWRHYDOXDWHWKHPHWKRGVXJJHVWHG,QGHHGWZR GDWDEDVHVZHUHHPSOR\HGLPDJHVIRUH[SHULPHQWVRIGHWHFWLRQDQGLPDJHVHPSOR\HGIRUWKHUHFRJQLWLRQ7KH LPDJHV DUH UHVL]HG WR [ SL[HOV DQG WDNHQ IURP GLIIHUHQW ORFDWLRQV W\SHV RI FDUV URDG FRQGLWLRQV OLJKWLQJ GLIIHUHQWEDFNJURXQGDQGFOHDQWOLQHVVFRQGLWLRQV7KHQXPEHURILPDJHVXVHGLQWKHH[WUDFWLRQDQGVHJPHQWDWLRQ SURFHVVLVVKRZQLQWDEOH 7DEOH,PDJHGDWDEDVHIRU/3H[WUDFWLRQPRGXOHDVZHOODVFKDUDFWHUUHFRJQLWLRQRQHDQGWKHLUVXFFHVVUDWH 0RGXOH

7RWDORILPDJHV

6XFFHVVUDWH

3ODWHH[WUDFWLRQ

&KDUDFWHUVHJPHQWDWLRQ

4.2. Detection Results 7KHH[SHULPHQWDOUHVXOWVVKRZWKDWWKHSURSRVHGPHWKRGFDQH[WUDFWDQGUHFRJQL]HHIILFLHQWO\WKHQXPEHURIOLFHQVH SODWH )URP WKLV WDEOH ZH FDQ VHH WKDW WKH SURSRVHG PHWKRG FDQ GHDO WKH LPDJHV FRUUHFWO\ ZLWK QRLVH LOOXPLQDWLRQ YDULDQFHDQGURWDWLRQ)RUWKHRWKHUWKUHHPHWKRGVPRVWPLVORFDWHGSODWHVKDSSHQHGZLWKWKHLPDJHVFRQWDLQLQJVRPH VSHFLDOREMHFWVEUDQGVUDGLDWRUVEXPSHUV RUFRPSOH[EDFNJURXQGVWUHHVELF\FOHV DQGWKHLPDJHVFDSWXUHGDJDLQVW WKHVWURQJVXQOLJKWRUXQGHUWKHJORRP\OLJKW7KHIROORZLQJWDEOHSUHVHQWVWKHFRPSDULVRQUHVXOWVZLWKDXWRFRUUHODWLRQ EDVHGPHWKRG>@DQGPDWKHPDWLFDOPRUSKRORJ\EDVHGPHWKRG>@ 7DEOH3HUIRUPDQFHRIGLIIHUHQWOLFHQVHSODWHGHWHFWLRQPHWKRGV 5HIHUHQFHV

$FFXUDF\

0RUSKRORJLFDORSHUDWRU>@

$XWRFRUUHODWLRQ>@

2XUPHWKRG

,WVKRZVWKDWWKHSURSRVHGPHWKRGDFKLHYHVH[FHOOHQWSHUIRUPDQFH7KHGHWHFWLRQUDWHLQRXUPHWKRGLVODUJHUWKDQ WKDWRIWKH0RUSKRORJLFDORSHUDWRU>@DQG'LVFUHWH:DYHOHW7UDQVIRUP>@EDVHGPHWKRGV 4.3. Recognition results ,Q WKH UHFRJQLWLRQ PRGXOH ZH ZLOO ZRUN RQ GLIIHUHQW YDULDQWV RI WKH V\VWHP LQ RUGHU WR REVHUYH WKH HIIHFW RI PRGLILFDWLRQRQWKHUHFRJQLWLRQUDWH:HDUHIRFXVLQJRQWKHERWKQXPEHURIKLGGHQOD\HUVDQGWKH(IIHFWRIQXPEHU RIQHXURQVLQWKHKLGGHQOD\HU7DEOHVKRZVWKHYDULRXVUHFRJQLWLRQUDWHVGXHWRDYDULDWLRQLQWKHQXPEHURIQHXURQ LQWKHKLGGHQOD\HU7KHFKRLFHRIWKHQXPEHURIKLGGHQOD\HUVLVQRWDUELWUDU\DVWKHDERYHYDULDWLRQV 7DEOH9DULDWLRQRIQHXUDOQHWZRUNVWUXFWXUH 5HFRJQLWLRQUDWH

+LGGHQOD\HUV

1XPEHURIQHXURQV

,QGHHGWKHFKRLFHRIRQHKLGGHQOD\HUJLYHVDUDWHKLJKHUWKDQWKHFKRLFHRIWZRKLGGHQOD\HUV7KHVDPHWKLQJIRU WKHQXPEHURIQHXURQVIRURQO\RQHKLGGHQOD\HUWKHKLJKHUUDWHLVDERXWZKHQWKHQXPEHURIQHXURQVLV 7DEOHSUHVHQWVWKHFRPSDULVRQUHVXOWVRIVHYHUDOPHWKRGVZKLFKFRQWDLQRXUDOJRULWKPDQGRWKHUVPHQWLRQHGLQ SUHYLRXVZRUNVRQWKHVDPHLPDJHGDWDEDVH2EYLRXVO\WKHSUHFLVLRQRIRXUDOJRULWKPZKLFKLVDERYHLVKLJKHU WKDQRWKHUV

Sami Ktata et al. / Procedia Computer Science 73 (2015) 312 – 319 7DEOH&RPSDULVRQRIVHYHUDOOLFHQVHSODWHUHFRJQLWLRQPHWKRGVRQWKHVDPHLPDJHGDWDEDVH 5HIHUHQFHV

$FFXUDF\

0RUSKRORJLFDO2SHUDWRU>@

&RQQHFWHG&RPSRQHQWV$QDO\VLV>@

*HQHWLF$OJRULWKP>@

7HPSODWH0DWFKLQJ>@

2XUPHWKRG

&RQFOXVLRQ ,QWKLVSDSHUZHKDYHSUHVHQWHGDUREXVWPHWKRGIRU7XQLVLDQQXPEHUSODWHUHFRJQLWLRQ7KHV\VWHPFRQWDLQVWZR ODUJHVWHSVVXFKDV/3H[WUDFWLRQDQG/3QXPEHUUHFRJQLWLRQ,QWKHVHFRQGVWHSZHXVHGDQDYHUDJHGSL[HOVPHWKRG IRUIHDWXUHVH[WUDFWLRQLQRUGHUWRJHQHUDWHDYHFWRURIWUDLQLQJGDWDIRUHDFKFKDUDFWHURISODWHQXPEHUDQGWKHWUDLQLQJ RI QHXUDO QHWZRUN :H WHVWHG WKH PHWKRG ZLWK ODUJH QXPEHU RI SODWH LPDJHV FDSWXUHG LQ GLIIHUHQW HQYLURQPHQWV FORXG\VXQQ\QLJKWWLPH« 7KHH[SHULPHQWDOUHVXOWVVKRZWKDWWKHSURSRVHGDOJRULWKPFDQGHWHFWWKHORFDWLRQRI /3DQGUHFRJQL]HLWLQGLIIHUHQWHQYLURQPHQWVZLWKUDWH 5HJDUGLQJIXWXUHZRUNVZHDUHLQYHVWLJDWLQJWRUHFRJQL]H7XQLVLDQ/3OHWWHUVVXFKDV³βϧϮΗ´DQG³Εϥ´DFTXLUHG LQVRPH/3FDWHJRULHV6RRXUIXWXUHZRUNZLOOEHLQFOXGHVYLGHRSURFHVVLQJ

5HIHUHQFHV +RQJOLDQJ%DQG&KDQJSLQJ/$K\EULGOLFHQVHSODWHH[WUDFWLRQPHWKRGEDVHGRQHGJHVWDWLVWLFVDQGPRUSKRORJ\Proceedings of the 17th International Conference on Pattern Recognition (ICPR’04)SS± =KHQJ'=KDR