Here are the results of the Web Service Testing done by Ephesoft to ensure the application meets quality and stability standards.

 

These benchmark results were tested with a 4 core Ubuntu 14.04 LTS with 8 GB of RAM using Ephesoft 4.1.2.0 with MariaDB:

 

The below web services were tested with 25, 50, 100 and 150 users with the number of pages in an input file used = 10.

 

We are gauging performance for RAMP UP 0 Sec and 30 Sec and 3 cycles.
Some Background on Load Testing Metrics

Throughput: This is calculated as requests/unit of time. The time is calculated from the start of the first sample to the end of the last sample. This includes any intervals between samples, as it is supposed to represent the load on the server. The formula is: Throughput = (number of requests) / (total time).

90 % Line: 90th Percentile is the value below which 90% of the samples fall. The remaining samples too at least as long as the value. This is a standard statistical measure.

Error %: This value indicated the percentage of error. If there are any requests not received properly they are counted as errors and the percentage of error occurrence against the actual calls made is displayed in this value

Webservices
For 25 Users
Ramp up time:- 0 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 553776.6 0.00% 2.6 13.13% 1119176680
ocrClassify 208504.4 0.00% 7.2 7.38% 381190475
keywordClassification 183955.3 0.00% 7.8 18.89% 893752268
Advanced Bracode Extraction 257427.7 0.00% 5.4 63.10% 961390594
Common api for Extraction 418.6 0.00% 3415.2 1.69% 601646707
ExtractFuzzyDb 387.73 0.00% 3691.2 1.79% 573142704
ExtractFixedForm(using nuance) 73907.53 0.00% 19.2 2.00% 615021838
ExtractFieldsForFuzzyDB 4415.73 0.00% 258.8 2.93% 615153070
initiateOcrClassifyExtract 16049.93 14.67% 609 2.92% 638340663
createHOCRforBatchClass 366628.2 0.00% 4.2 2.93% 607560437
classifyImage 15289.73 0.00% 95.4 11.13% 564550891
createOCR 10496.87 0.00% 141.8 2.17% 2838899573
extrctkv 493.0667 0.00% 2911.6 3.05% 537323681
Extractfieldfromhocr 344.667 0.00% 4199.2 3.74% 532223917
createHOCRforBatchClass 366628.2 0.00% 4.2 2.93% 607560437
executeMobileUpload 67510.4 0.00% 22 1.65% 686765007
saveMobileUpload 377.8667 0.00% 4067 3.30% 661812307
searchTextFordocfuzzy 1239.93 0.00% 1205.4 13.38% 817353261
searchTextForfieldfuzzy 1433.67 0.00% 1062.4 8.81% 968440781
TableExtractionHOCR 5485.33 0.00% 273.4 29.77% 602977275

 

Webservices
For 25 Users
Ramp up time:- 30 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 503266.1 0.00% 2.8 11.50% 1141491281
ocrClassify 181730.1 0.00% 7.2 6.64% 690097217
keywordClassification 157632.5 0.00% 7.8 17.29% 1240942605
Advanced Bracode Extraction 106707.9 0.00% 10.6 40.46% 950863088
Common api for Extraction 51.87 0.00% 52.2 0.97% 587922623
ExtractFuzzyDb 60 0.00% 52.2 0.94% 581732341
ExtractFixedForm(using nuance) 45758.07 0.00% 19.4 4.19% 672092030
ExtractFieldsForFuzzyDB 3525.4 0.00% 46.8 1.30% 563227384
initiateOcrClassifyExtract 389.47 0.00% 51.6 8.87% 468348743
createHOCRforBatchClass 344454.1 0.00% 4.2 3.41% 574704558
classifyImage 2819.2 0.00% 47.6 7.21% 537944916
createOCR 1666.53 0.00% 49.2 1.11% 663640565
extrctkv 60.87 0.00% 52.2 2.30% 609987544
Extractfieldfromhocr 45 0.00% 52.2 2.02% 503407827
createHOCRforBatchClass 34454.1 0.00% 4.2 3.41% 57404558
executeMobileUpload 10595.33 0.00% 42 1.46% 648291193
saveMobileUpload 49.4 0.00% 52.2 4.48% 2623894247
searchTextFordocfuzzy 177.67 0.00% 51.6 7.66% 899127801
searchTextForfieldfuzzy 1047.4 0.00% 1425.2 7.91% 941020005
TableExtractionHOCR 705.53 0.00% 51 14.99% 525676926

 

Webservices
For 50 Users
Ramp up time:- 0 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 1067370 0.00% 2.8 13.41% 1293829716
ocrClassify 409664.6 0.00% 7.2 7.97% 639380789.4
keywordClassification 360468.2 0.00% 8.4 19.46% 1154208606
Advanced Bracode Extraction 256594.3 0.00% 10.8 52.93% 957324894.3
Common api for Extraction 797.83 0.00% 3609.6 3.65% 642469820.9
ExtractFuzzyDb 533.22 0.00% 3716.4 2.47% 596451359.8
ExtractFixedForm(using nuance) 144023 0.00% 19.2 4.43% 571636936.7
ExtractFieldsForFuzzyDB 4723.7 0.00% 460.4 4.76% 508121383.3
initiateOcrClassifyExtract 4051.57 20.00% 701.2 16.34% 700758890.7
createHOCRforBatchClass 600251.5 71.33% 4.8 3.64% 540764413.3
classifyImage 27833.13 0.00% 103.2 12.47% 584121716.9
createOCR 22304.97 0.00% 134 3.09% 619115912.5
extrctkv 988.77 0.00% 2883.4 5.12% 620052664.8
Extractfieldfromhocr 596.07 0.00% 4689.2 3.48% 557955713.3
createHOCRforBatchClass 600251.5 71.33% 4.8 3.64% 540764413.3
executeMobileUpload 52012.03 0.00% 56.6 26.30% 746330977.8
saveMobileUpload 573.47 0.00% 4826.6 10.59% 593920523.1
searchTextFordocfuzzy 2219.03 0.00% 1307.4 16.82% 887741541.3
searchTextForfieldfuzzy 1997.63 0.00% 1475.6 10.92% 984291857.5
TableExtractionHOCR 9722.83 0.00% 306.4 46.83% 697697174.2

 

Webservices
For 50 Users
Ramp up time:- 30 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 1077160 0.00% 2.8 14.72% 1306379042
ocrClassify 382486.6 0.00% 7.2 7.96% 1015871638
keywordClassification 333436.4 0.00% 8.4 19.37% 1419114078
Advanced Bracode Extraction 230081.2 0.00% 10.8 57.58% 936041470.2
Common api for Extraction 48.9 0.00% 102 1.51% 595612727.1
ExtractFuzzyDb 57.23 0.00% 102 1.76% 5696423283
ExtractFixedForm(using nuance) 116735.5 0.00% 19.2 4.47% 533651167.7
ExtractFieldsForFuzzyDB 3536.67 0.00% 91.8 1.48% 568216530
initiateOcrClassifyExtract 413.27 4.67% 100.8 10.45% 786066161.7
createHOCRforBatchClass 600046.9 87.33% 4.8 4.09% 599683653.9
classifyImage 3015.73 0.00% 93.4 13.00% 571385220.6
createOCR 1897.13 0.00% 96.2 2.24% 533879993.2
extrctkv 54.97 0.00% 102 4.35% 510830882.9
Extractfieldfromhocr 41.97 0.00% 102 2.60% 607635639.6
createHOCRforBatchClass 600046.9 87.33% 4.8 4.09% 599683653.9
executeMobileUpload 27128.5 0.00% 56.2 21.84% 816762050.5
saveMobileUpload 45.2 0.00% 102 5.63% 624072736.4
searchTextFordocfuzzy 196.23 0.00% 101.4 11.53% 990135214.1
searchTextForfieldfuzzy 217.03 0.00% 101.4 7.15% 908799551.6
TableExtractionHOCR 691.4 0.00% 100 24.13% 818633446.9

 

Webservices
For 100 Users
Ramp up time:- 0 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 2172791 0.00% 2.4 14.79% 1225828198
ocrClassify 600137.5 54.33% 10.2 8.47% 672949316
keywordClassification 601943.3 28.33% 10.2 20.41% 702079747
Advanced Bracode Extraction 509553.2 0.00% 10.8 59.04% 997450379
Common api for Extraction 1651.43 0.00% 2789.8 7.43% 555971185
ExtractFuzzyDb 1363.17 0.00% 4010.4 2.55% 580536263
ExtractFixedForm(using nuance) 281426.5 0.00% 19.2 4.58% 556881332
ExtractFieldsForFuzzyDB 6137.8 0.00% 875.4 11.82% 639988152
initiateOcrClassifyExtract 37666.1 35.33% 594.6 15.21% 594470248
createHOCRforBatchClass 600354 92.33% 10.2 4.21% 627724175
classifyImage 56569 0.00% 98.4 16.05% 620903964
createOCR 45282.67 0.00% 132 2.53% 643550092
extrctkv 1948.37 0.00% 2897.2 9.84% 590980174
Extractfieldfromhocr 1109.6 0.00% 4908.4 7.57% 645496926
createHOCRforBatchClass 600354 92.33% 10.2 4.21% 627724175
executeMobileUpload 98815.33 0.00% 59 25.40% 980289762
saveMobileUpload 865.83 0.00% 3564 6.91% 528655461
searchTextFordocfuzzy 4985.2 0.00% 1166.6 18.03% 973353759
searchTextForfieldfuzzy 4073.47 0.00% 1422 16.33% 917718605
TableExtractionHOCR 18866.78 0.00% 314.8 57.71% 1173506314

 

Webservices
For 100 Users
Ramp up time:- 30 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 2105236 0.00% 3 13.51% 1149474503
ocrClassify 600030.1 82.33% 9.6 8.75% 1147866701
keywordClassification 600044.5 46.33% 9.6 22.17% 1192569529
Advanced Bracode Extraction 479686 0.00% 10.8 59.68% 957457622
Common api for Extraction 49.33 0.00% 201.6 2.51% 586129307
ExtractFuzzyDb 54.67 0.00% 201.6 1.57% 570194344
ExtractFixedForm(using nuance) 262604.7 0.00% 19.2 4.55% 2297563991
ExtractFieldsForFuzzyDB 3372.53 0.00% 181.8 3.23% 560486984
initiateOcrClassifyExtract 507.2 2.67% 199.8 16.38% 739795891
createHOCRforBatchClass 600051.9 100.00% 9.6 4.70% 648789783
classifyImage 35199.97 0.00% 90 17.96% 714401601
createOCR 25956.8 0.00% 126.6 4.01% 576734225
extrctkv 53.63 0.00% 201.2 4.94% 536518677
Extractfieldfromhocr 40.33 0.00% 201 3.76% 591998283
createHOCRforBatchClass 600051.9 100.00% 9.6 4.70% 648789783
executeMobileUpload 70793.23 0.00% 59.4 24.53% 1134140860
saveMobileUpload 45.27 0.00% 201.6 6.36% 579608459
searchTextFordocfuzzy 149.07 0.00% 200.6 12.08% 954312275
searchTextForfieldfuzzy 195.1 0.00% 200.6 13.83% 998028022
TableExtractionHOCR 724.97 0.00% 196.8 46.24% 1496335288

 

Webservices
For 150 Users
Ramp up time:- 0 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 3089231 0.00% 3 14.01% 1310507102
ocrClassify 600126.4 83.33% 15 8.58% 854068831
keywordClassification 603013.1 87.11% 15 22.31% 1226290293
Advanced Bracode Extraction 602816.4 39.33% 15 59.88% 980336942
Common api for Extraction 2049.57 0.00% 2782.8 10.55% 567526983
ExtractFuzzyDb 1928.67 0.00% 4221.8 6.50% 655650017
ExtractFixedForm(using nuance) 278697.9 1.00% 19.2 0.36% 566696408
ExtractFieldsForFuzzyDB 12440.33 83.11% 610.2 4.49% 541480935
initiateOcrClassifyExtract 19103.67 47.11% 512.4 13.99% 785293274
createHOCRforBatchClass 603086.6 100.00% 15 21.36% 696923715
classifyImage 93573.44 0.00% 89 21.37% 2715906769
createOCR 66898.6 0.00% 133.6 4.01% 580851440
extrctkv 2880.1 0.00% 2951.4 15.58% 579534316
Extractfieldfromhocr 1601.97 0.00% 4351 9.72% 544554854
createHOCRforBatchClass 603086.6 100.00% 15 21.36% 696923715
executeMobileUpload 157815.4 0.00% 55 24.98% 1322387405
saveMobileUpload 1804.53 0.00% 2710.4 7.38% 663732946
searchTextFordocfuzzy 7411.37 0.00% 1299.6 35.92% 1003584617
searchTextForfieldfuzzy 6871.83 0.00% 1297.4 21.97% 1003230022
TableExtractionHOCR 29510.57 0.00% 301.6 63.05% 875542776

 

Webservices
For 150 Users
Ramp up time:- 30 sec
Average of 3 Test Cycles
90% line
(MilliSecs)
Error
Percentage
Throughput(per min) CPU Usage Memory Usage(Kb)
ocrClassifyExtractNew(TimeOut=10800000) 3073511 0.00% 3 13.89% 1287980385
ocrClassify 600028.3 86.44% 14.4 0.25% 933382227
keywordClassification 600086.5 100.00% 14.4 22.43% 1286061771
Advanced Bracode Extraction 600034.9 48.44% 14.4 61.39% 945380984
Common api for Extraction 49.3 0.00% 301.2 3.52% 520180905
ExtractFuzzyDb 53.67 0.00% 300.8 2.54% 627640943
ExtractFixedForm(using nuance) 285882.5 0.00% 19.2 0.33% 609713926
ExtractFieldsForFuzzyDB 3420.43 80.00% 291.6 1.69% 2990025685
initiateOcrClassifyExtract 935.47 6.22% 295.6 15.38% 971916303
createHOCRforBatchClass 600049.5 100.00% 14.4 4.66% 739816271
classifyImage 67223.43 0.00% 88.4 22.63% 742505387
createOCR 49550.27 0.00% 127.8 5.26% 593119434
extrctkv 54.63 0.00% 300.6 5.98% 485973614
Extractfieldfromhocr 38 0.00% 300.6 4.53% 580453186
createHOCRforBatchClass 600049.5 100.00% 14.4 4.66% 739816271
executeMobileUpload 137870.8 0.00% 52.8 26.18% 1534901602
saveMobileUpload 38.63 0.00% 301 5.31% 2279223228
searchTextFordocfuzzy 147.2 0.00% 299.6 13.26% 1129715113
searchTextForfieldfuzzy 231.67 0.00% 299.8 12.76% 1162358925
TableExtractionHOCR 1153.83 0.00% 294.6 65.17% 1460020120

 

 

Was this article helpful to you?

Mark Kessler

Comments are closed.