Here are the results of tests performed in January 2001 to compare lossless compression of True Color (24-bit) images by all known programs developed for such purpose, including BMF, JPEG-LS and PNG software, 7-Zip, Pkzip, and archivers with special algorithms for 24-bit images. See Archive Comparison Test by Jeff Gilchrist for more info: http://act.by.net If anybody wants to start or continue such tests, or can suggest some other sets of images, or other compression programs, (not sources or algorithm descriptions, executable programs only) or knows we have missed something important, (some new fantastic technology, an algorithm or even a program capable of lossless compression of up to 1000:1 and lossy compression of up to 10000:1, we hear about it from time to time since our XTs) please let us know immediately: artest@hotmail.ru Thank you!
The Art of Lossless Data Compression vol. 20g [[1]] COMPRESSION QUALITY
(see also [[2]] Speed [[3]] Details [[4]] Comments) The last 12th line shows results for the sum of all 11 sets (492 images). original BMF UHIC RKIM Arhangel NK ERI32 ACE32 LSP DC 275.95% 100% 100.55 101.59 110.52 109.68 107.75 114.06 115.50 119.74 289.11% 100% 104.88 124.50 114.61 132.43 111.09 121.58 136.11 127.16 245.22% 100% 107.93 101.38 112.92 109.62 117.91 114.29 111.39 123.53 238.64% 100% 104.20 112.66 110.53 118.18 112.98 114.63 122.73 124.69 457.28% 101.93 110.74 100% 112.34 116.87 129.10 121.47 224.13 138.25 240.06% 100% 105.20 102.07 110.01 106.75 116.64 112.76 112.21 120.24 295.55% 100% 103.23 103.57 111.54 107.73 116.95 117.07 122.83 123.25 340.24% 100% 105.56 102.65 111.26 109.65 116.65 120.16 121.03 125.23 225.19% 100% 104.00 104.47 108.82 108.77 112.16 110.48 109.95 119.63 547.50% 100% 104.84 104.25 107.76 122.73 114.89 152.06 132.31 131.15 379.87% 100% 104.36 130.51 113.80 145.03 117.88 137.19 158.03 145.19 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 297.55% 100% 104.72 105.33 110.92 111.93 116.35 118.68 121.86 124.61 RK LOCO PNGcrush SBC RAR BTPC Display IMP 7-zip PkzipC 120.66% 149.81 150.24 130.66 133.15 164.36 153.89 133.68 159.16 167.62 127.76% 156.41 151.37 136.42 140.60 170.42 164.86 167.62 205.21 208.56 125.13% 119.20 129.45 138.25 124.25 129.21 139.53 163.29 193.86 195.64 124.76% 127.45 134.30 145.82 132.94 137.49 144.00 158.01 182.24 184.71 133.92% 172.49 144.96 141.52 146.11 201.52 156.16 160.00 185.82 187.42 121.81% 114.12 121.00 128.36 126.30 121.61 130.54 137.95 175.32 177.19 122.82% 118.49 130.69 128.14 137.72 131.14 138.27 139.31 170.52 173.47 126.19% 124.50 132.36 135.17 139.00 139.68 141.64 152.56 191.42 194.63 120.18% 117.84 121.50 128.58 122.22 122.53 132.58 146.49 179.50 180.76 132.38% 151.17 141.96 142.15 170.38 176.94 148.74 158.32 186.28 193.32 145.35% 195.34 181.85 160.76 174.25 213.33 191.18 187.48 217.05 224.13 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 125.40% 127.25 132.63 133.56 137.11 139.34 141.62 147.57 182.40 185.54[[2]] Speed
A set of 23 images totalling 27,133,146 bytes from ftp://www.cipr.rpi.edu/pub/image/still/KodakImages/color/ was used for this test and a 400 MHz pc with 192 Mb RAM and Windows98. Programs,options Overall Average Compress Extract Compressed score, Users' time, time, size, score, seconds seconds bytes seconds % seconds % 7z a -tzip 4440 152% 4368 157% 79 10 15666242 7z a -mx -tzip 4485 153% 4368 157% 130 9 15649266 7z a -tufa1 4067 139% 3877 140% 212 26 13788872 7z a -mx -tufa1 4080 139% 3886 140% 215 27 13819864 7zip a 4440 152% 4369 157% 79 10 15666242 7zip a -mx 4490 153% 4369 157% 134 10 15649266 ace32 a 3231 110% 3143 113% 97 26 11188623 ace32 a -d4096 3233 110% 3143 113% 100 26 11188111 ace32 a -d4096 -m1 3233 110% 3145 113% 97 26 11194643 ace32 a -d4096 -m5 3256 111% 3152 113% 116 26 11213031 ace32 a -d4096 -s- 3269 112% 3147 113% 136 26 11188811 ace32 a -d4096 -m1 -s- 3270 112% 3149 113% 135 26 11195591 ace32 a -d4096 -m5 -s- 3301 113% 3156 114% 161 26 11214063 alch ---n 4709 161% 4419 159% 323 56 15594096 alch ---n 0 4980 170% 4889 176% 100 47 17399494 alch ---n 1 4534 155% 4365 157% 188 48 15475837 alch ---n 2 4637 158% 4470 161% 185 48 15857298 alch ---n 3 4662 159% 4459 161% 224 67 15736143 alch ---n 4 4708 161% 4418 159% 322 55 15594095 arhangel a 5672 194% 4994 180% 753 737 15057230 arhangel a -mm -1 3430 117% 3200 115% 255 157 10867001 arhangel a -mm -2 3430 117% 3200 115% 255 157 10867001 arhangel a -mm -1 -2 3429 117% 3200 115% 254 157 10867001 bmf -f 3026 103% 2953 106% 80 23 10522960 bmf -f -q9 3374 115% 2980 107% 437 22 10494756 bmf -f -s 3349 114% 3047 110% 335 283 9832328 bmf -f -s -q9 3871 132% 3100 112% 856 284 9832328 locoe -c1 4145 142% 4121 149% 26 28 14730521 locoe -c2 4163 142% 4135 149% 31 30 14770163 cbtpc 4555 156% 4517 163% 42 25 16160698 lsp 3243 111% 3199 115% 48 41 11357044 lsp -f 3318 113% 3280 118% 42 36 11667530 lsp -g 4244 145% 4207 152% 40 34 15011506 lsp -fg 4294 147% 4262 154% 35 28 15232420 dc e 3519 120% 3338 120% 200 49 11772337 dc e -b16300 3520 120% 3339 120% 201 49 11772337 dc e -b16300 -mb5 3518 120% 3338 120% 199 49 11772337 display -bpng --same 4482 153% 4245 153% 263 16 15131718 eri a 3564 122% 3348 121% 240 56 11768488 eri a -m1 3544 121% 3419 123% 139 45 12101876 eri a -m2 3499 119% 3363 121% 152 47 11884539 eri a -m3 3516 120% 3344 120% 191 54 11777331 eri a -m5 3677 125% 3359 121% 352 56 11768450 eri a -3e23 2965 101% 2769 100% 218 56 9688919 eri a -m1 -3e23 3122 107% 3003 108% 133 45 10602311 eri a -m2 -3e23 2918 100% 2785 100% 147 50 9796177 eri a -m3 -3e23 2928 100% 2765 100% 180 55 9694703 imp a -2 -s4 3806 130% 3740 135% 73 21 13365646 imp98 a 4586 157% 4528 163% 64 6 16261267 imp98 a -m3 4591 157% 4504 162% 96 7 16156757 imp98 a -mm 4327 148% 4241 153% 95 7 15212564 imp98 a -mm -m3 4357 149% 4222 152% 150 8 15118784 imp98 a -mm -2 3797 130% 3733 134% 72 19 13345236 imp98 a -mm -s4 4314 147% 4225 152% 97 7 15154706 imp98 a -2 -s4 3804 130% 3739 135% 72 20 13365818 pkzip -es 5528 189% 5511 199% 18 7 19812852 pkzip -a 4658 159% 4629 167% 32 7 16630959 pkzip -exx 4674 160% 4630 167% 48 7 16630245 pkzipc -add 4683 160% 4646 167% 40 9 16682715 pkzipc -add -max 4685 160% 4639 167% 50 9 16652375 pkzipc -add -defl 4652 159% 4604 166% 53 9 16524036 pkzipc -add -max -defl 4667 159% 4594 166% 81 9 16481369 pngcrush -q 4822 165% 4175 150% 718 - 14772830 pngcrush -q -loco 4130 141% 3515 127% 683 - 12409745 pngcrush -q -brute 6515 223% 4313 155% 12447 - 14644577 rar a 4588 157% 4466 161% 136 10 15996627 rar a -mm 3703 126% 3662 132% 45 21 13095126 rar a -mm -m1 3703 126% 3663 132% 44 21 13098345 rar a -mm -m5 3704 126% 3661 132% 47 21 13092151 rar a -mm -mde 3703 126% 3662 132% 45 21 13095126 rar a -mm -m1 -mde 3703 126% 3663 132% 44 21 13098345 rar a -mm -m5 -mde 3704 126% 3661 132% 47 21 13092151 rar a -mm -s -mde 3699 126% 3657 132% 47 21 13077240 rar32 a -mm -s -mde 3712 127% 3664 132% 54 27 13077240 rk -mf1 3894 133% 3785 136% 121 85 13278736 rk -mf2 4213 144% 3939 142% 304 244 13196628 rk -mf3 4457 152% 3946 142% 566 233 13166528 rk -mx1 5681 194% 4722 170% 1065 1300 11938300 rk -mx2 6218 213% 5015 181% 1336 1613 11770288 rk -mx3 6679 228% 5233 189% 1606 1842 11629912 rkim c 3276 112% 3118 112% 175 211 10405925 rkim cx 3516 120% 3067 110% 499 243 9989608 sbc c 3793 129% 3666 132% 141 69 12900021 sbc c -b9 3769 129% 3639 131% 145 69 12802613 sbc c -b51 3769 129% 3639 131% 145 69 12802613 sbc c -b51 -e 3793 129% 3666 132% 141 69 12904168 sbc c -e 3802 130% 3676 132% 139 68 12941511 sbc c -b51 -os 3878 132% 3668 132% 232 102 12758356 sbc c -b51 -e -os 3795 130% 3669 132% 139 68 12918051 uhic e 3264 111% 3047 110% 240 243 10013246 uhic m 3609 123% 3229 116% 422 441 9887092 zzip a 3736 128% 3646 131% 100 57 12889383 zzip a -mm 3770 129% 3662 132% 119 59 12933183 zzip a -mm -mx 3770 129% 3662 132% 119 59 12932662 Overall score is calculated by adding compression time, extraction time, and time it would take to transfer the compressed file over a 28,800bps network: (compressed_size)/3600 , because 28800 bits_per_second is 3600 bytes_per_second Average Users' score is calculated by adding (compress_time/10)+ extract_time + time it would take to transfer the compressed file over a 28,800bps network. Compression time is divided by 10 here, because more than 90% of people would never compress anything during their life (with compression programs), but they use compressed data almost _every_ time they use computers and/or Internet. That's why compression time is not so actual for them. Losslessly compressed with ERI32 to 9,560,807 bytes, this set can be found at http://artest.lgg.ru/kodak/ and http://artest1.tripod.com/Kodak/[[3]] Details
are no longer put to this main text (790 lines reporting 15252 results on 492 files in 11 sets), but can be found in FULL version with GRAPHICS.DAT and *.BAT at http://geocities.com/SiliconValley/Bay/1995/artest20.zip or http://artest1.tripod.com/artest20.zip 1,2,3,4,9 image sets were taken from ftp://www.cipr.rpi.edu/pub/image/ and /image2/ , converted from Sun Raster format to Windows Bitmap, (this conversion changes image headers only, 32 bytes are replaced by 54 bytes, but image data is not modified) This site www.cipr.rpi.edu is described in comp.compression FAQ, in 29 lines of "Subject: [55] Where can I find Lenna and other images?" Eight images in the 5th set are from the famous Waterloo Color Set, ( losslessly compressed to 2,889,063 bytes, it can be found at http://geocities.com/eri32 ) 6,7,8th image sets are from ftp://download.intel.com/pressroom/images/ They were converted from TIFF format to Windows Bitmap. 10th and 11th sets were downloaded from ftp://ftp.kodak.com/www/images/ Some images were slightly renamed. See GRAPHICS.DAT from artest20.zip for more details. Some new images (from download.intel.com) were not added yet.[[4]] Comments
Links to download programs:
7-Zip 2.22 :W http://www.7-zip.com/dl/7zip222.exe 513K ACE32 2.0b4 :W ftp://ftp.forlangs.net/pub/windows/winace/ace20b4.exe 576K ArHanGeL 1.40 :a http://geocities.com/SiliconValley/Lab/6606/arh140.zip 50K BMF 1.1 :e ftp://ftp.simtel.net/pub/simtelnet/win95/graphics/bmf_1_10.zip 132K DC 0.98b :W ftp://ftp.cdrom.com/.3/sac/pack/dc124.zip 55K ERI32 4.9fre :e http://geocities.com/eri32/eri49fre.zip 91K Imp 1.1 :e http://www.winimp.com/imp110d.zip 266K Imp-win 1.12 :W http://www.winimp.com/imp112.exe 122K Pkzip 2.50 :a ftp://ftp.simtel.net/pub/simtelnet/msdos/arcers/pk250dos.exe 202K PkzipC 4.00 :W ftp://ftp.pkware.com/pkzc400s.exe 3470K RK 1.04.1 :W http://rksoft.virtualave.net/downloads/rk104a1w.exe 380K RKim 1.06 :W http://rksoft.virtualave.net/downloads/rkim106.zip 57K RAR32 2.80b3 :e ftp://ftp.netlab.sk/public/rarsoft/rar/rarx28b3.exe 269K WinRAR 2.80b3 :W ftp://ftp.netlab.sk/public/rarsoft/rar/wrar28b3.exe 620K SBC 0.500b :e http://geocities.com/sbcarchiver/sbc0500b.zip 187K UHIC 1.0 :e ftp://ftp.elf.stuba.sk/pub/pc/pack/uhic10.zip 52K ZZip 0.36b :W http://www.zzip.f2s.com/zzip-win32.zip 34K NK 1.0 :W ftp://tu.tusur.ru/pub/ImageTools/NK1.ZIP 87K JPEG-LS 1.00 :W http://www.hpl.hp.com/loco/jlsrefV100.zip 325K SPIHT Nov'96 :W http://www.cipr.rpi.edu/research/SPIHT/EW_Code/lsp.exe 72K BTPC 4.1 :W http://www.engr.mun.ca/~john/btpc4.1.zip 715K PngCrush 1.5.3:e http://download.sourceforge.net/pmt/pngcrush-1.5.3-DOS.zip 157K Display 1.90b5:e http://www.freenet.edmonton.ab.ca/~crnelson/disp.exe 811K SEA 1.3 :e ftp://ftp.elf.stuba.sk/pub/pc/graph/sea13.zip 705K Alchemy 1.10 :a ftp://ftp.elf.stuba.sk/pub/pc/graph/alch110.zip 1462K :a - any DOS - DOS programs, will run under pure DOS or in a DOS box :e - extender - DOS programs using DOS extenders like DOS/4GW or CWSDPMI :W - windows - Windows95/98/NT/etc programs If direct link doesn't work-most probably newer version of the program appeared at the same site: visit web page, or read the whole directory from ftp server (i.e. try the same URL, but without filename).Homepages:
Arhangel : http://geocities.com/SiliconValley/Lab/6606 Eri32 : http://geocities.com/eri32 mirror : http://artest1.tripod.com RK, RKim : http://rksoft.virtualave.net Imp,WinImp : http://www.technelysium.com.au mirror : http://www.winimp.com ACE,WinACE : http://www.winace.com Ufa,777,7-Zip: http://www.7-zip.com PkZip : http://www.pkware.com RAR,WinRAR : http://www.rarsoft.com JPEG-LS : http://www.hpl.hp.com/loco PngCrush : http://pmt.sourceforge.net/pngcrush SPIHT : http://www.ipl.rpi.edu/research/SPIHT BTPC : http://www.engr.mun.ca/~john/btpc.html Display : http://fn2.freenet.edmonton.ab.ca/~crnelson/display.html Alchemy : http://www.handmadesw.com/Products/Image_Alchemy.htm SEA : http://www.photodex.com/products/dos SBC : http://geocities.com/sbcarchiver ZZip : http://www.zzip.f2s.comWhat's new:
156 new images were added: 108 from ftp://ftp.kodak.com/www/images/pcd/ and 48 from ftp://download.intel.com/pressroom/images/ 192Mb RAM are used for ARTesting now, that's why everything was retested. 11 new programs this time: PngCrush 1.5.3, ERI32 4.9fre, 7-zip 2.22, WinRAR 2.80b3, RAR32 for DOS and OS/2 2.80b3, ZZip 0.36b, RK 1.04.1, NK ver.1, DC 0.99.158b, ACE 2.00b4, SBC 0.500b, Pkzip 4.00. Latest beta versions of DC and UFA are available from authors by e-mail: DC: EdgarBinder@t-online.de UFA: support@7-zip.comWARNINGS:
ZZip 0.36b can't losslessly decompress some images: kodak01 ... kodak17.bmp, footbal* and susie* from 2nd set, moore29.bmp from 6th. ESP, Rkive and some other programs are not tested any more, their results and links can be found in previous versions: ESP - artest3...artest12 Rkive - 3...12 UFA - 3...12 777 - 13...14 BOA - 7...14 UHARC - 5...10 SEA - 12...19 CompuShow 2000! - 3...11 The LATEST RELEASE, and all previous versions of these tests can be found at http://geocities.com/SiliconValley/Bay/1995/ and http://artest1.tripod.com/The FINAL PART
> [[5]] PLEASE read THIS before replying to this article was removed from this text, but can be easily found at http://geocities.com/SiliconValley/Bay/1995/artest10.html http://artest1.tripod.com/artest10.html Send your suggestions, comments to artest@hotmail.ru With best kind regards, A.Ratushnyak Back to main ARTest page