Here are the results of tests performed in March 2002 to compare lossless compression of True Color (24-bit) images by all known programs developed for such purpose, including BMF, JPEG-LS and PNG software, 7-Zip, Pkzip, and archivers with special algorithms for 24-bit images. See Archive Comparison Test by Jeff Gilchrist for more info: http://compression.ca If anybody wants to start or continue such tests, or can suggest some other sets of images, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 and lossy compression of up to 10000:1, we hear about it from time to time since PC-XTs) please let us know immediately: artest@inbox.ru Thank you!
The Art of Lossless Data Compression vol. 23g [[1]] COMPRESSION QUALITY
(see also [[2]] Speed [[3]] Details [[4]] Comments) The last 13th line shows results for the sum of all 12 sets (627 images, 2 Gb) Original BMF RKIM UHIC NK ERI ArHanGeL UHARC ACE LSP 312.41% 113.53 115.36 114.15 124.36 100% 125.45 122.14 129.46 131.09 289.11% 100% 124.50 104.88 132.34 114.39 114.61 112.22 121.22 136.11 245.22% 100% 101.38 107.93 109.55 119.38 112.92 118.90 114.33 111.39 238.64% 100% 112.66 104.20 118.11 115.13 110.53 116.65 114.13 122.73 472.81% 102.89 100% 112.24 114.09 136.49 113.06 125.36 120.73 235.68 234.75% 100% 101.90 104.87 106.85 111.69 109.63 116.20 112.65 112.06 300.88% 100% 104.15 104.38 108.18 111.54 111.11 114.52 117.32 123.56 342.65% 100% 102.61 106.05 110.30 116.76 111.60 120.69 118.35 116.50 227.58% 100% 104.53 104.00 108.84 110.57 108.91 114.54 111.00 110.35 547.51% 100% 104.25 104.84 122.41 119.24 107.76 127.07 156.04 132.31 298.76% 108.25 109.28 109.79 118.02 100% 121.54 116.62 124.64 126.27 336.86% 109.13 108.43 110.27 118.18 100% 118.07 110.08 127.27 127.95 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 294.01% 100% 102.57 104.48 109.04 110.21 110.53 115.21 116.54 117.36 SBC DC RK LOCO ZZip PngCrush RAR BTPC Display pkzipc 135.59 136.16 137.23 169.98 148.92 170.75 138.17 186.58 174.71 190.14 132.90 127.16 127.76 156.41 132.25 151.37 130.66 170.42 164.86 208.56 121.02 123.53 125.13 119.20 130.83 129.45 122.22 129.21 139.53 195.64 125.91 124.69 124.76 127.45 130.68 134.30 124.17 137.49 144.00 184.71 123.91 137.84 134.12 176.37 139.34 145.16 195.15 206.52 157.12 187.70 118.61 118.59 119.99 115.90 125.98 119.56 127.03 123.11 128.83 173.10 119.29 122.63 122.19 120.16 128.24 129.42 137.43 133.15 136.48 169.65 120.21 126.75 127.18 127.12 133.97 134.57 130.87 138.99 143.26 201.54 116.89 120.30 120.62 118.45 126.11 122.15 117.20 123.47 133.10 181.12 119.98 131.16 132.38 151.17 137.53 141.96 130.54 176.94 148.74 193.32 128.82 130.82 130.82 151.91 137.53 156.67 133.91 164.78 161.60 179.17 123.03 127.73 127.52 143.54 129.08 141.78 152.40 150.12 151.10 188.14 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 118.88 122.10 122.58 124.70 128.42 129.61 131.00 135.08 137.88 180.73[[2]] Speed
A set of 23 Kodak images from ftp://ftp.cipr.rpi.edu/stills/kodak/color/ was used for this test, and a 400MHz PC with 256Mb RAM and Windows98. Programs, Compression/ Overall Average Users' Compressed options Extraction, Score Score Size seconds seconds, % seconds, % bytes , % no compression 0 0 7536 291 7536 300 27133146 314 7za a -tzip 65 10 4426 171 4367 174 15666242 181 7za a -tzip -mx 110 9 4466 172 4366 174 15649266 181 7za a -t7z 208 16 4057 156 3870 154 13800689 159 7za a -t7z -mx 255 16 4080 157 3850 153 13712640 158 ace a -d4096 86 26 3219 124 3142 125 11189907 129 ace32 a -d4096 83 27 3218 124 3144 125 11190095 129 ace32 a -d4096 -m1 83 27 3220 124 3145 125 11196635 129 ace32 a -d4096 -m5 97 27 3238 125 3151 125 11210655 130 arh a 555 541 5278 204 4779 190 15057230 174 arh a -mm -1 221 134 3373 130 3174 126 10867001 126 bmf -f 67 23 3012 116 2952 117 10522960 122 bmf -f -q9 321 22 3258 126 2969 118 10494756 121 bmf -f -s 262 217 3211 124 2974 118 9832496 114 bmf -f -s -q9 685 217 3632 140 3016 120 9832496 114 dc e 143 41 3454 133 3325 132 11772337 136 dc e -b16300 -mb5 141 42 3452 133 3326 132 11772337 136 display -bpng -i --same 180 13 4396 170 4234 168 15131718 175 eri a -3h13 89 100 2593 100 2513 100 8654262 100 eri a -3f13 84 98 2602 100 2526 101 8711394 101 gcac a 116 50 3487 134 3383 135 11958076 138 gcac s 120 51 3541 137 3433 137 12133243 140 imp a -2 -s4 56 17 3785 146 3735 149 13365649 154 imp98 a -2 -s4 56 18 3786 146 3736 149 13366580 154 imp98 a -mm -2 54 18 3779 146 3730 148 13345038 154 nk 401 88 3480 134 3119 124 10770469 124 pkzip -es 15 6 5524 213 5510 219 19812852 229 pkzip -a 25 6 4650 179 4627 184 16630959 192 pkzip -exx 36 6 4661 180 4629 184 16630245 192 pkzipc -add 29 10 4672 180 4646 185 16682715 193 pkzipc -add -max 37 10 4672 180 4639 185 16652375 192 pkzipc -add -defl 40 9 4639 179 4603 183 16524036 191 pkzipc -add -max -defl 57 10 4645 179 4594 183 16481369 190 pngcrush -q 547 - 4649 179 4157 165 14772830 171 qlfc a 73 45 3660 141 3594 143 12753187 147 rar a -m2 69 10 4526 175 4463 178 16009598 185 rar a -m3 73 14 3621 140 3555 141 12722261 147 rar a -m5 73 14 3617 139 3551 141 12707651 147 rar a -m3 -mcc+ 64 14 3402 131 3344 133 11965218 138 rar a -m4 -mcc+ 67 17 3407 131 3347 133 11968818 138 rar a -m5 -mcc+ 66 17 3408 131 3348 133 11970517 138 rar a -m1 -mcc+ -s 64 15 3398 131 3341 133 11953784 138 rar a -m3 -mcc+ -s 64 14 3399 131 3341 133 11953790 138 rar a -m5 -mcc+ -s 67 16 3403 131 3343 133 11954884 138 rar32 a -m5 -mcc+ -s 77 18 3415 132 3346 133 11954884 138 rk -mf1 89 68 3845 148 3765 150 13278748 153 rk -mf2 218 167 4050 156 3854 153 13196640 152 rk -mf3 402 173 4232 163 3870 154 13166540 152 rk -mx1 993 1205 5514 213 4620 184 11938308 138 rk -mx2 1007 1194 5470 211 4563 182 11770300 136 rk -mx3 1132 1275 5637 217 4618 184 11629924 134 rkim c 185 210 3285 127 3118 124 10405925 120 rkim cx 509 241 3525 136 3067 122 9989608 115 sbc c -m1 -b63 92 51 3739 144 3656 145 12948240 150 sbc c -m2 -b63 173 111 3537 136 3381 135 11709638 135 sbc c -m3 -b63 179 113 3544 137 3383 135 11709772 135 sbc c -m3 -b63 -a 184 105 3577 138 3411 136 11836838 137 sbc c -m3 -b63 -os 214 148 3538 136 3346 133 11436104 132 sbc c -m3 -os 228 108 3591 138 3386 135 11719160 135 uharc a -m1 -md32768 340 86 3648 141 3342 133 11603482 134 uharc a -m2 -md32768 360 77 3647 141 3323 132 11557731 134 uharc a -m3 -md32768 371 87 3661 141 3326 132 11528980 133 uharc a -mz -md32768 85 94 3889 150 3813 152 13360651 154 uharc a -mx -md32768 526 487 3969 153 3496 139 10644818 123 uhic e 183 187 3151 122 2986 119 10013246 116 uhic m 347 365 3458 133 3145 125 9887092 114 zzip a 82 53 3714 143 3641 145 12889397 149 zzip a -mm 103 56 3751 145 3659 146 12933197 149 zzip a -mm -mx 98 56 3746 144 3658 146 12932675 149 zzip a -mm -mx -26m 97 57 3734 144 3647 145 12891036 149 locoe -c1 75 71 4238 163 4170 166 14730521 170 locoe -c2 82 78 4261 164 4188 167 14770163 171 cbtpc 78 60 4626 178 4556 181 16160698 187 lsp 85 85 3324 128 3247 129 11357044 131 lsp -f 77 75 3393 131 3323 132 11667530 135 lsp -g 81 78 4329 167 4256 169 15011506 173 lsp -fg 72 68 4370 169 4305 171 15232420 176 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. Losslessly compressed with ERI32 to 8,493,000 bytes, this set can be found at http://artest.virtualave.net/ki/ and http://geocities.com/rao-inc/kodak/[[3]] Details
are no longer put to this main text (967 lines reporting 23680 results on 627 files in 12 sets), but can be found in FULL version with GRAPHICS.DAT and all *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest23.zip or http://artest1.tripod.com/artest23.zip 1,2,3,4,9th image sets were taken from ftp://ftp.cipr.rpi.edu/stills/ and /sequences/ , converted from Sun Raster format to Windows Bitmap, (this conversion changes image headers only, 32 bytes are replaced by 54 bytes, but image data is not modified) This site www.cipr.rpi.edu is described in comp.compression FAQ, in 29 lines of "Subject: [55] Where can I find Lenna and other images?" Eight images in the 5th set are from the famous Waterloo Color Set, ( losslessly compressed to 2,801,690 bytes, it can be found at http://geocities.com/eri32 ) 6,7,8,12th image sets are from ftp://download.intel.com/pressroom/images/ They were converted from TIFF format to Windows Bitmap. 10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/ Some images were slightly renamed. See GRAPHICS.DAT inside artest23.zip for more details. Some new images (from download.intel.com) were not added yet.[[4]] Comments
Links to download programs:
7-Zip 2.30b17 :W http://www.7-zip.org/dl/7zip230b17.exe 891K ACE 2.04 :W http://winace.host.sk/ace204.exe 593K BMF 1.1f :e http://geocities.com/eri32/bmf11f.zip 76K ERI 5.1fre :e http://geocities.com/eri32/eri51fre.zip 89K RAR32 3.00b4 :e ftp://pubftp.slovenska.sk/pub/rarsoft/rar/rarx30b4.exe 415K WinRAR 3.00b4 :W ftp://pubftp.slovenska.sk/pub/rarsoft/rar/wrar30b4.exe 942K SBC_d 0.910b :e http://personal.inet.fi/musiikki/sjm/sbc0910b_dos.zip 195K SBC 0.910b :W http://personal.inet.fi/musiikki/sjm/sbc0910b_win32.zip 154K UHArc 0.4b :eW ftp://ftp.elf.stuba.sk/pub/pc/pack/uharc04.zip 220K ZZip 0.36c :W http://www.via.ecp.fr/~damien/downloads/zzip-win32.zip 35K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K DC 0.98b :W ftp://ftp.elf.stuba.sk/pub/pc/pack/dc124.zip 55K Imp 1.1 :e http://www.technelysium.com.au/imp110d.zip 266K Imp-win 1.12 :W http://www.technelysium.com.au/imp112.exe 122K Pkzip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K RK-dos 1.04.1 :e http://rksoft.virtualave.net/downloads/rk104a1d.exe 461K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K RKim 1.06 :W http://rksoft.virtualave.net/downloads/rkim106.zip 57K UHIC 1.0 :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip 52K NK 2.0beta :W ftp://tu.tusur.ru/pub/ImageTools/NK2beta.ZIP 52K PngCrush 1.5.8:e http://download.sourceforge.net/pmt/pngcrush-1.5.8-DOS.zip 147K JPEG-LS 1.00 :W http://www.hpl.hp.com/loco/jlsrefV100.zip 325K SPIHT Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe 72K BTPC 4.1 :W http://www.engr.mun.ca/~john/btpc4.1.zip 715K Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe 811K SEA 1.3 :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip 705K Alchemy 1.10 :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip 1462K :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename).Homepages:
Arhangel : http://geocities.com/SiliconValley/Lab/6606 Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK, RKim : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au/winimp.html ACE,WinACE : http://www.winace.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarsoft.com JPEG-LS : http://www.hpl.hp.com/loco PngCrush : http://pmt.sourceforge.net/pngcrush SPIHT : http://www.cipr.rpi.edu/research/SPIHT BTPC : http://www.engr.mun.ca/~john/btpc.html Display : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html Alchemy : http://www.handmadesw.com/Products/Image_Alchemy.htm SEA : http://www.photodex.com/products/dos SBC : http://sbcarchiver.netfirms.com ZZip : ? http://www.zzip.f2s.com Ufa,777, 7-Zip : http://www.7-zip.orgWhat's new:
10 new programs were tested: BMF 1.1f NK 2.0beta PngCrush 1.5.8 UHArc 0.4 beta 7-zip 2.30b17 RAR 3.00b4 ACE 2.04 SBC 0.910 beta ERI 5.1fre ZZip 0.36c Latest beta version of DC is available from author by e-mail: DC: EdgarBinder@t-online.de Results of IMP and 7-zip are in the full version only, see GRAPHICS.DAT.WARNINGS:
NK can't losslessly decompress some 8-bit images. BMF doesn't save all fields of bmp-headers. ESP, Rkive and some other programs are not tested any more, their results and links can be found in previous versions: ESP - artest3...artest12 Rkive - 3...12 UFA - 3...12 777 - 13...14 BOA - 7...14 IMP - 13...22 SEA - 12...19 CompuShow 2000! - 3...11 The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/ Send your suggestions, comments to artest@inbox.ru With best kind regards, A.Ratushnyak, RAO Inc. Back to main ARTest page
