Skip to content

/ lingua

Permalink
Branch: master
Find file Copy path

lingua/ACCURACY_TABLE.md

Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
1345 lines (1345 sloc) 49.9 KB
Raw Blame History
Language Average Single Words Word Pairs Sentences
Lingua   Tika   OpenNLP Optimaize Lingua   Tika   OpenNLP Optimaize Lingua   Tika   OpenNLP Optimaize Lingua   Tika   OpenNLP Optimaize
Afrikaans 77 70 72 39 60 43 41 2 80 69 75 22 91 98 99 93
Albanian 88 79 71 70 70 54 40 38 95 84 73 73 100 99 100 98
Arabic 98 97 84 89 96 94 65 72 99 99 88 94 100 100 99 100
Armenian 100 - 100 - 100 - 100 - 100 - 100 - 100 - 100 -
Azerbaijani 90 - 82 - 78 - 60 - 94 - 86 - 99 - 99 -
Basque 85 83 77 66 74 65 56 33 89 86 82 70 92 98 92 95
Belarusian 97 96 91 87 91 92 78 69 99 98 95 92 100 100 100 99
Bengali 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Bokmal 58 - 66 - 39 - 42 - 59 - 69 - 76 - 87 -
Bosnian 36 - 26 - 30 - 12 - 35 - 22 - 42 - 44 -
Bulgarian 87 73 83 48 71 52 62 18 92 69 87 36 99 96 100 91
Catalan 73 58 42 31 54 32 11 2 78 56 32 16 87 84 81 77
Chinese 100 69 78 31 100 20 40 0 100 86 94 2 100 100 100 91
Croatian 73 75 50 41 55 54 23 8 74 72 44 24 91 97 81 91
Czech 80 72 67 49 66 54 42 21 85 74 70 46 91 88 90 81
Danish 83 72 60 34 66 52 34 4 86 71 52 16 99 93 94 80
Dutch 76 60 61 39 56 31 31 6 80 51 57 19 92 98 97 91
English 82 63 52 41 57 29 10 2 90 62 46 23 99 99 99 97
Esperanto 86 - 76 - 70 - 50 - 90 - 78 - 99 - 100 -
Estonian 93 84 59 61 82 65 29 23 96 88 60 63 100 100 88 98
Finnish 97 94 86 79 92 85 68 51 98 96 91 85 100 100 100 100
French 89 78 59 54 74 54 25 18 94 80 55 48 97 99 98 97
Georgian 100 - 100 - 100 - 100 - 100 - 100 - 100 - 100 -
German 89 73 67 55 74 50 38 21 94 70 66 45 100 100 98 99
Greek 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Gujarati 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Hebrew 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Hindi 73 80 58 51 61 65 28 16 64 75 49 38 93 99 99 98
Hungarian 95 88 78 77 87 75 53 51 98 91 82 81 100 100 100 99
Icelandic 94 90 76 78 84 76 53 53 97 93 76 81 100 100 99 99
Indonesian 63 61 29 18 43 38 10 0 62 62 25 1 85 82 52 54
Irish 91 90 78 80 82 80 56 58 95 92 82 85 96 99 97 98
Italian 88 80 64 51 71 58 31 12 92 84 61 43 100 99 100 98
Japanese 99 25 95 98 100 1 87 99 100 5 100 100 98 68 100 96
Kazakh 90 - 85 - 80 - 66 - 90 - 90 - 99 - 100 -
Korean 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Latin 88 - 70 - 75 - 43 - 93 - 71 - 96 - 96 -
Latvian 89 88 84 75 80 74 67 50 93 90 86 77 94 98 98 96
Lithuanian 95 89 79 72 88 74 56 41 98 92 83 77 100 99 99 98
Macedonian 79 83 68 46 60 66 37 10 78 83 68 32 98 100 98 97
Malay 32 23 19 4 28 20 10 0 39 22 20 0 27 28 27 11
Marathi 85 90 81 71 74 81 62 43 84 92 83 74 96 98 98 96
Mongolian 95 - 84 - 93 - 66 - 97 - 88 - 96 - 99 -
Norwegian 74 60 - 31 50 32 - 3 76 54 - 9 96 95 - 81
Nynorsk 66 - 55 - 42 - 24 - 66 - 47 - 91 - 92 -
Persian 90 81 75 62 76 65 53 29 94 79 74 58 99 99 99 99
Polish 95 90 83 81 86 76 61 58 99 93 89 86 100 100 100 100
Portuguese 82 63 58 40 61 34 22 7 88 58 54 19 99 98 98 94
Punjabi 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Romanian 87 78 67 55 71 57 34 24 93 80 68 50 99 97 99 91
Russian 90 80 50 53 77 62 20 22 95 85 43 50 98 94 86 87
Serbian 83 73 73 46 69 57 46 18 82 70 74 39 98 90 98 80
Slovak 85 76 70 47 65 53 39 12 91 76 73 38 99 98 99 92
Slovene 83 74 71 37 63 53 43 3 87 72 72 18 99 98 99 90
Somali 94 91 69 80 85 79 35 52 97 94 74 88 100 100 98 100
Spanish 71 59 42 32 45 29 8 0 69 50 25 6 98 97 93 91
Swedish 86 68 69 47 68 40 41 13 90 67 69 37 99 96 97 91
Tagalog 81 77 61 61 58 54 27 24 86 79 57 62 98 99 98 97
Tamil 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Telugu 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100 100
Thai 100 100 100 100 100 100 100 100 100 100 100 100 100 100 99 100
Turkish 94 82 72 70 85 62 48 43 98 83 71 70 100 99 98 96
Ukrainian 93 81 79 68 84 62 54 39 98 84 83 69 97 97 99 94
Urdu 90 83 68 72 78 68 45 49 94 84 62 71 98 96 98 96
Vietnamese 93 85 84 87 81 64 66 65 98 92 86 95 100 100 100 100
Welsh 91 86 77 77 79 69 50 50 96 88 81 82 99 100 99 99
Mean 87 80 74 64 75 63 52 40 89 80 74 59 95 96 95 93
Median 89.58 81.1 75.17 63.87 76.4 63.16 47.9 30.85 94.25 83.9 75.3 65.8 99.0 99.1 99.0 96.85
Standard Deviation 13.68 16.46 18.83 24.63 18.74 24.31 27.63 34.41 13.83 19.15 21.67 32.6 11.77 10.76 12.84 13.72
You can’t perform that action at this time.