Here are the results of tests performed in May 2001 to compare lossless compression of True Color (24-bit) images by all known programs developed for such purpose, including BMF, JPEG-LS and PNG software, 7-Zip, Pkzip, and archivers with special algorithms for 24-bit images. See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net If anybody wants to start or continue such tests, or can suggest some other sets of images, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 and lossy compression of up to 10000:1, we hear about it from time to time since PC-XTs) please let us know immediately: artest@inbox.ru Thank you!
The Art of Lossless Data Compression vol. 22g [[1]] COMPRESSION QUALITY
(see also [[2]] Speed [[3]] Details [[4]] Comments) The last 13th line shows results for the sum of all 12 sets (538 images, 1.6Gb) original BMF RKIM UHIC ArHanGel NK ERI32 UHARC ACE32 LSP 301.07% 109.41 111.17 110.00 120.89 119.97 100% 118.85 124.75 126.33 289.11% 100% 124.50 104.88 114.61 132.43 118.56 112.29 121.22 136.11 245.22% 100% 101.38 107.93 112.92 109.62 122.72 118.96 114.33 111.39 238.64% 100% 112.66 104.20 110.53 118.18 117.03 116.73 114.13 122.73 472.81% 102.88 100% 112.24 113.06 117.29 134.61 125.91 120.73 235.68 238.40% 100% 102.20 105.10 109.91 107.08 113.77 117.53 112.83 112.67 284.74% 100% 103.04 104.35 110.93 107.79 109.96 113.96 115.95 124.18 337.03% 100% 102.94 105.64 111.14 110.31 116.06 119.99 119.41 116.77 227.58% 100% 104.53 104.00 108.91 109.02 112.80 114.60 111.00 110.35 547.50% 100% 104.25 104.84 107.76 122.73 120.59 127.76 156.04 132.31 379.87% 100% 130.51 104.36 113.80 145.03 124.75 133.06 138.21 158.03 330.79% 109.30 108.57 110.41 118.26 118.75 100% 110.54 126.75 127.79 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 295.73% 100% 104.34 104.48 110.44 111.41 111.81 116.46 118.03 120.41 DC SBC RK LOCO ZZip PngCrush RAR Display 7Zip PkZIP 131.22 132.19 132.25 163.81 143.51 163.00 146.10 168.36 174.15 183.23 127.16 128.32 127.76 156.41 132.25 151.37 140.60 164.86 205.21 208.56 123.53 124.68 125.13 119.20 130.83 129.36 124.25 139.53 193.86 195.64 124.69 125.42 124.76 127.45 130.68 133.56 132.94 144.00 182.24 184.71 137.84 132.69 134.12 176.37 139.34 144.49 144.52 157.12 186.38 187.70 119.39 121.69 120.96 116.52 127.01 120.21 126.14 129.91 173.17 175.08 122.14 121.71 121.60 120.84 126.77 128.63 136.31 136.56 166.25 168.95 125.68 126.36 126.23 125.50 131.75 132.36 138.56 142.03 191.87 195.38 120.30 120.58 120.62 118.45 126.10 122.06 123.23 133.10 179.79 181.12 131.15 131.16 132.38 151.17 137.53 141.64 170.38 148.74 186.28 193.32 145.19 146.36 145.35 195.34 152.55 174.54 174.25 191.18 217.05 224.13 127.68 124.43 127.46 143.37 129.13 141.13 140.38 151.05 181.11 187.88 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 123.21 123.74 123.76 128.33 129.08 130.75 135.54 140.42 179.00 182.50[[2]] Speed
A set of 23 images totalling 27,133,146 bytes from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/ was used for this test and a 400 MHz PC with 192 Mb RAM and Windows98. Programs,options Overall Average Compress Extract Compressed score, Users' time, time, size, score, seconds seconds bytes seconds % seconds % no compression 7537 276% 7537 288% 0 0 27133146 pngcrush -q 4822 177% 4175 159% 719 - 14772830 pngcrush -q -loco 4140 152% 3516 134% 693 - 12409745 eri a -3e03 2722 100% 2617 100% 116 112 8980915 eri a -3e03 -h95 2738 100% 2617 100% 135 116 8954210 sbc c -m1 -b59 3770 138% 3659 139% 123 64 12900341 sbc c -m2 -b59 3525 129% 3376 129% 166 76 11821344 sbc c -m3 -b59 3563 130% 3395 129% 187 89 11838517 sbc c -m3 -b59 -a 3590 131% 3420 130% 189 88 11926526 sbc c -m3 -b59 -oa 3563 130% 3395 129% 187 89 11838517 sbc c -m3 -b59 -on 3565 130% 3402 130% 181 90 11860841 sbc c -m3 -b59 -os 3511 128% 3279 125% 258 128 11250407 sbc c -m3 -os 3566 130% 3378 129% 209 95 11745177 7z a -tzip 4443 163% 4369 166% 83 9 15666242 7z a -mx -tzip 4487 164% 4370 166% 131 9 15649266 7z a -tufa1 4059 149% 3892 148% 186 19 13872996 7z a -mx -tufa1 4058 149% 3891 148% 185 19 13872996 ace a -d4096 3234 118% 3144 120% 99 26 11189907 ace32 a 3233 118% 3144 120% 99 26 11191619 ace32 a -d4096 3235 118% 3145 120% 100 26 11190095 ace32 a -d4096 -m1 3235 118% 3146 120% 98 26 11196635 ace32 a -d4096 -m5 3257 119% 3152 120% 117 26 11210655 ace32 a -d4096 -s- 3273 120% 3149 120% 138 26 11191243 ace32 a -d4096 -m1 -s- 3274 120% 3151 120% 137 26 11198127 ace32 a -d4096 -m5 -s- 3302 121% 3157 120% 162 26 11210935 rar a 4588 168% 4466 170% 136 9 15996627 rar a -mm 3703 136% 3663 139% 45 20 13095126 rar a -mm -m1 3703 136% 3663 139% 44 20 13098345 rar a -mm -m5 3704 136% 3662 139% 47 20 13092151 rar a -mm -mde 3703 136% 3662 139% 45 20 13095126 rar a -mm -m1 -mde 3703 136% 3663 139% 44 20 13098345 rar a -mm -m5 -mde 3704 136% 3662 139% 47 20 13092151 rar a -mm -s -mde 3700 135% 3657 139% 47 20 13077240 rar32 a -mm -s -mde 3713 136% 3664 140% 54 26 13077240 UHarc a -m1 3621 133% 3336 127% 317 71 11641810 UHarc a -m2 3664 134% 3335 127% 366 70 11620323 UHarc a -m3 4024 147% 3346 127% 752 68 11531306 UHarc a -mx 4408 161% 3707 141% 778 652 10719512 UHarc a -mx -md8192 4412 162% 3711 141% 779 655 10719503 7zip a 4440 163% 4369 166% 79 10 15666242 7zip a -mx 4490 164% 4369 166% 134 10 15649266 alch ---n 4709 172% 4419 168% 323 56 15594096 alch ---n 0 4980 182% 4889 186% 100 47 17399494 alch ---n 1 4534 166% 4365 166% 188 48 15475837 alch ---n 2 4637 170% 4470 170% 185 48 15857298 alch ---n 3 4662 171% 4459 170% 224 67 15736143 alch ---n 4 4708 172% 4418 168% 322 55 15594095 arhangel a 5672 208% 4994 190% 753 737 15057230 arhangel a -mm -1 3430 126% 3200 122% 255 157 10867001 arhangel a -mm -2 3430 126% 3200 122% 255 157 10867001 arhangel a -mm -1 -2 3429 125% 3200 122% 254 157 10867001 bmf -f 3026 111% 2953 112% 80 23 10522960 bmf -f -q9 3374 123% 2980 113% 437 22 10494756 bmf -f -s 3349 123% 3047 116% 335 283 9832328 bmf -f -s -q9 3871 142% 3100 118% 856 284 9832328 locoe -c1 4145 152% 4121 157% 26 28 14730521 locoe -c2 4163 152% 4135 158% 31 30 14770163 cbtpc 4555 167% 4517 172% 42 25 16160698 lsp 3243 119% 3199 122% 48 41 11357044 lsp -f 3318 121% 3280 125% 42 36 11667530 lsp -g 4244 155% 4207 160% 40 34 15011506 lsp -fg 4294 157% 4262 162% 35 28 15232420 dc e 3519 129% 3338 127% 200 49 11772337 dc e -b16300 3520 129% 3339 127% 201 49 11772337 dc e -b16300 -mb5 3518 129% 3338 127% 199 49 11772337 display -bpng --same 4482 164% 4245 162% 263 16 15131718 imp a -2 -s4 3806 139% 3740 142% 73 21 13365646 imp98 a 4586 168% 4528 173% 64 6 16261267 imp98 a -m3 4591 168% 4504 172% 96 7 16156757 imp98 a -mm 4327 158% 4241 162% 95 7 15212564 imp98 a -mm -m3 4357 160% 4222 161% 150 8 15118784 imp98 a -mm -2 3797 139% 3733 142% 72 19 13345236 imp98 a -mm -s4 4314 158% 4225 161% 97 7 15154706 imp98 a -2 -s4 3804 139% 3739 142% 72 20 13365818 pkzip -es 5528 203% 5511 210% 18 7 19812852 pkzip -a 4658 171% 4629 176% 32 7 16630959 pkzip -exx 4674 171% 4630 176% 48 7 16630245 pkzipc -add 4683 172% 4646 177% 40 9 16682715 pkzipc -add -max 4685 172% 4639 177% 50 9 16652375 pkzipc -add -defl 4652 170% 4604 175% 53 9 16524036 pkzipc -add -max -defl 4667 171% 4594 175% 81 9 16481369 rk -mf1 3894 143% 3785 144% 121 85 13278736 rk -mf2 4213 154% 3939 150% 304 244 13196628 rk -mf3 4457 163% 3946 150% 566 233 13166528 rk -mx1 5681 208% 4722 180% 1065 1300 11938300 rk -mx2 6218 228% 5015 191% 1336 1613 11770288 rk -mx3 6679 245% 5233 199% 1606 1842 11629912 rkim c 3276 120% 3118 119% 175 211 10405925 rkim cx 3516 129% 3067 117% 499 243 9989608 uhic e 3264 119% 3047 116% 240 243 10013246 uhic m 3609 132% 3229 123% 422 441 9887092 zzip a 3736 137% 3646 139% 100 57 12889383 zzip a -mm 3770 138% 3662 139% 119 59 12933183 zzip a -mm -mx 3770 138% 3662 139% 119 59 12932662 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. Losslessly compressed with ERI32 to 8,748,580 bytes, this set can be found at http://artest.virtualave.net/kodak/ and http://artest1.tripod.com/kodak/[[3]] Details
are no longer put to this main text (872 lines reporting 17754 results on 538 files in 12 sets), but can be found in FULL version with GRAPHICS.DAT and all *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest22.zip or http://artest1.tripod.com/artest22.zip 1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and /image2/ , converted from Sun Raster format to Windows Bitmap, (this conversion changes image headers only, 32 bytes are replaced by 54 bytes, but image data is not modified) This site www.cipr.rpi.edu is described in comp.compression FAQ, in 29 lines of "Subject: [55] Where can I find Lenna and other images?" Eight images in the 5th set are from the famous Waterloo Color Set, ( losslessly compressed to 2,850,878 bytes, it can be found at http://geocities.com/eri32 ) 6,7,8th image sets are from ftp://download.intel.com/pressroom/images/ They were converted from TIFF format to Windows Bitmap. 10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/ Some images were slightly renamed. See GRAPHICS.DAT inside artest22.zip for more details. Some new images (from download.intel.com) were not added yet.[[4]] Comments
Links to download programs:
7-Zip 2.24 :W http://www.7-zip.com/dl/7zip224.exe 463K ACE32 2.02 :W ftp://ftp.forlangs.net/pub/windows/winace/ace202.exe 587K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K BMF 1.1 :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip 132K DC 0.98b :W ftp://ftp.cdrom.com/.2/sac/pack/dc124.zip 55K ERI32 4.16fre :e http://geocities.com/eri32/eri416fr.zip 94K Imp 1.1 :e http://www.winimp.com/imp110d.zip 266K Imp-win 1.12 :W http://www.winimp.com/imp112.exe 122K Pkzip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K RKim 1.06 :W http://rksoft.virtualave.net/downloads/rkim106.zip 57K RAR32 2.80 :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx280.exe 269K WinRAR 2.80 :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar280.exe 621K UHIC 1.0 :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip 52K SBC 0.860b :e http://geocities.com/sbcarchiver/sbc0860b.zip 208K ZZip 0.36c :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 35K NK 1.0 :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP 87K JPEG-LS 1.00 :W http://www.hpl.hp.com/loco/jlsrefV100.zip 325K SPIHT Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe 72K BTPC 4.1 :W http://www.engr.mun.ca/~john/btpc4.1.zip 715K PngCrush 1.5.4:e http://download.sourceforge.net/pmt/pngcrush-1.5.4-DOS.zip 145K Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe 811K SEA 1.3 :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip 705K Alchemy 1.10 :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip 1462K :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename).Homepages:
Arhangel : http://geocities.com/SiliconValley/Lab/6606 Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK, RKim : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au mirror : http://www.winimp.com ACE,WinACE : http://www.winace.com Ufa,777,7-Zip: http://www.7-zip.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarsoft.com JPEG-LS : http://www.hpl.hp.com/loco PngCrush : http://pmt.sourceforge.net/pngcrush SPIHT : http://www.ipl.rpi.edu/research/SPIHT BTPC : http://www.engr.mun.ca/~john/btpc.html Display : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html Alchemy : http://www.handmadesw.com/Products/Image_Alchemy.htm SEA : http://www.photodex.com/products/dos SBC : http://geocities.com/sbcarchiver ZZip : http://www.zzip.f2s.comWhat's new:
3 new programs tested: ERI32 4.15fre, SBC 0.850b, PNGCrush 1.5.4. Newer versions of SBC, ZZip and ERI32 are ready, they will be tested next time. Results of BTPC, IMP and Ufa1 are in the full version only, see GRAPHICS.DAT. Latest beta versions of DC, UFA, UHARC are available from authors by e-mail: DC: EdgarBinder@t-online.de UFA: support@7-zip.com UHARC: Uwe.Herklotz@gmx.deWARNINGS:
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp, footbal* and susie* from 2nd set, moore2.bmp from 6th. ESP, Rkive and some other programs are not tested any more, their results and links can be found in previous versions: ESP - artest3...artest12 Rkive - 3...12 UFA - 3...12 777 - 13...14 BOA - 7...14 UHARC - 5...10 SEA - 12...19 CompuShow 2000! - 3...11 The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/ Send your suggestions, comments to artest@hotmail.ru With best kind regards, A.Ratushnyak, RAO Inc. Back to main ARTest page
