Commit Graph

962 Commits (bbd5bb75a647bad95fda017299e75aef63f2515e)

Author SHA1 Message Date
Yann Collet c95f899725 refactored greedy 2015-11-19 17:28:35 +01:00
Yann Collet b3a2af970e refactored decompression 2015-11-19 17:13:19 +01:00
Yann Collet 110cc14bab fixed bug #73 notified by @nemequ 2015-11-19 12:02:28 +01:00
Yann Collet dcac00e7a6 update library builder 2015-11-19 11:23:44 +01:00
Yann Collet b2549846ba more tests 2015-11-18 11:29:32 +01:00
Yann Collet 94b9d8ec8d fix compression bug in rollbuffer mode 2015-11-17 16:14:55 +01:00
Yann Collet 138e89c9c4 fix compression bug (extDict mode) 2015-11-17 14:26:54 +01:00
Yann Collet 786eb7d42e fixed repcode bug 2015-11-17 12:23:53 +01:00
Yann Collet 82368cfa1b comment 2015-11-16 19:10:56 +01:00
Yann Collet eaa5f75b99 fixed decompression bug 2015-11-15 11:13:41 +01:00
Yann Collet 93a823ccb7 fixed asan warnings 2015-11-13 15:08:43 +01:00
Yann Collet 89db5e001d rolling buffer preliminary support for fast mode 2015-11-13 11:27:46 +01:00
Yann Collet 0f366c61ed fixed streaming decoder 2015-11-12 16:19:30 +01:00
Yann Collet 5b78d2f20c basic rolling buffer support in decoder 2015-11-12 15:36:05 +01:00
Yann Collet 14983e7aed refactored compression code 2015-11-11 21:38:21 +01:00
Yann Collet 7f6e91fa98 fixed library compilation 2015-11-11 14:39:50 +01:00
Yann Collet 5be2dd25f2 Changed Library source tree
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet 530918b409 level tuning 2015-11-10 10:52:58 +01:00
Yann Collet 9f432926b4 fileio can use small blocks params 2015-11-09 17:42:17 +01:00
Yann Collet 43e0cd512a small blocks params 2015-11-09 16:38:17 +01:00
Yann Collet 4baee50728 fix bug 2015-11-09 03:19:33 +01:00
Yann Collet d1ade5a61d fix 32-bits mode 2015-11-08 15:49:20 +01:00
Yann Collet e9eba608c2 simplified bt 2015-11-08 15:08:03 +01:00
Yann Collet 31d00ba4b3 fix bt bug 2015-11-08 14:11:29 +01:00
Yann Collet 72a8e751f4 level tuning 2015-11-07 22:24:46 +01:00
Yann Collet f48e35c206 minor bt improvements 2015-11-07 01:13:31 +01:00
Yann Collet a81d9ac42d minor bt CSpeed 2015-11-06 19:03:59 +01:00
Yann Collet 628065cf98 revert 2015-11-06 18:44:54 +01:00
Yann Collet 9b8e453713 minor CRatio improvement 2015-11-06 18:28:02 +01:00
Yann Collet 47cfa9a985 minor CRatio improvement 2015-11-06 17:13:46 +01:00
Yann Collet eb283710dd minor greedy CRatio improvement 2015-11-06 16:33:11 +01:00
Yann Collet fc2afcfa64 small Cspeed increase 2015-11-06 15:40:14 +01:00
Yann Collet 444873f494 minor greedy mod 2015-11-06 11:48:56 +01:00
Yann Collet 805a52a773 fixed asan warning 2015-11-06 10:52:17 +01:00
Yann Collet 8ad12ec343 level tuning 2015-11-06 10:19:00 +01:00
Yann Collet f12c1304a8 integrate fast mode 2015-11-05 18:16:59 +01:00
Yann Collet 1f44b3f778 added fast mode 2015-11-05 17:32:18 +01:00
Yann Collet 47b68908b2 rename lazy2 2015-11-05 15:14:17 +01:00
Yann Collet 9036105b62 simplified source 2015-11-05 15:03:12 +01:00
Yann Collet 5106a76dc9 merged strats 2015-11-05 15:00:24 +01:00
Yann Collet 43ae161fe9 level tuning 2015-11-05 11:58:02 +01:00
Yann Collet 92309cb37e level tuning 2015-11-05 00:48:37 +01:00
Yann Collet 3137d1a059 fix fuzzer32 litCSize limit condition 2015-11-04 23:36:36 +01:00
Yann Collet 50c5cdb44c fixed issues reported by Maciej Adamczyk 2015-11-04 20:35:33 +01:00
Yann Collet 3e3582719c Fixed issue #62, reported by @luben 2015-11-04 18:19:39 +01:00
Yann Collet e8455f51ea fix clang warning 2015-11-04 17:41:20 +01:00
Yann Collet b241e9deb7 small compression improvement 2015-11-04 13:57:24 +01:00
Yann Collet 59d7063fbc fix and level tuning 2015-11-04 12:05:27 +01:00
Yann Collet 96b9f0ba4d btlazy2 2015-11-04 03:52:54 +01:00
Yann Collet 588d1e5fa0 Fixed asan issue reported by Maciej Adamczyk 2015-11-03 10:48:42 +01:00
Yann Collet 050efba81b level tuning 2015-11-03 09:49:30 +01:00
Yann Collet 3564487614 lazydeep 2015-11-02 16:14:46 +01:00
Yann Collet 7671f393be v0.3.2 2015-11-02 12:17:39 +01:00
Yann Collet 4e049bca8c Fixed Visual Studio issue #60, reported by @mailagentrus 2015-11-02 11:09:54 +01:00
Yann Collet 56e1092cb0 level tuning 2015-11-02 01:02:43 +01:00
Yann Collet 9b11b46f8a Fixed speed regression 2015-11-01 12:40:22 +01:00
Yann Collet be2010ea1b lazy strategy 2015-10-31 12:57:14 +01:00
Yann Collet 4b100f43b0 level tuning 2015-10-30 15:49:48 +01:00
Yann Collet ec43ba4a95 updated visual studio projects 2015-10-30 11:51:26 +01:00
Yann Collet aa074051d6 decoding support for legacy v0.2 format 2015-10-30 11:21:50 +01:00
Yann Collet fc04bcc6d7 fixed minor gcc warning 2015-10-30 07:11:07 +01:00
Yann Collet 8f9d49c092 fixed asan warning 2015-10-30 07:00:37 +01:00
Yann Collet 4114f95ce9 fix Visual Studio projects 2015-10-30 06:40:22 +01:00
Yann Collet 44fe99116e fixed hc alloc 2015-10-29 22:02:40 +01:00
Yann Collet 712def905b one less hc malloc 2015-10-29 18:41:45 +01:00
Yann Collet 3d9cf7acf2 fix include 2015-10-29 17:15:14 +01:00
Yann Collet 71bcdb5c1f sync paramgrill with HC starting at level 2 2015-10-29 17:08:03 +01:00
Yann Collet 2acb5d3d48 HC modes can be selected from command line 2015-10-29 16:49:43 +01:00
Yann Collet 76c5c2a4a0 minor tuning 2015-10-28 19:07:05 +01:00
Yann Collet 81e49e6654 fine tune & messages 2015-10-28 15:56:48 +01:00
Yann Collet b315bc86e1 srcLog 2015-10-27 13:12:25 +01:00
Yann Collet 2c6992e1dc blocksize & T 2015-10-27 12:18:00 +01:00
Yann Collet d55a7e0e4d simplified chain 2015-10-27 03:06:40 +01:00
Yann Collet 8b91abec18 can test param conf 2015-10-27 02:59:12 +01:00
Yann Collet 342892c3ae repcode+1 2015-10-26 17:44:04 +01:00
Yann Collet 786f5b554a skip slow conf faster 2015-10-26 15:45:58 +01:00
Yann Collet 3a787da419 Fixed : minor clang warning 2015-10-25 19:42:03 +01:00
Yann Collet 083fcc82fc HC params 2015-10-25 14:06:35 +01:00
Yann Collet 53fff6cd9d Individual memlog values 2015-10-24 13:48:37 +01:00
Yann Collet ed0a781246 repfirst 2015-10-23 19:25:06 +01:00
Yann Collet 83fae977e6 Added asan tests 2015-10-23 15:21:53 +01:00
Yann Collet fc60883d42 fixed issue #49, reported by Hanno Böck (@hannob) 2015-10-23 12:45:02 +01:00
Yann Collet eeb8ba18d1 uncoupled maxdlog and chainlog 2015-10-22 16:55:40 +01:00
Yann Collet f3eca25322 quick first zstdhc version 2015-10-22 15:31:46 +01:00
Yann Collet 353c5d26cf unified ctx naming convention 2015-10-21 14:39:26 +01:00
Yann Collet f42803e5b4 restored ZSTD_compressCCtx() def 2015-10-21 13:31:46 +01:00
Yann Collet 8eb50b8acf Fixed minor gcc5+ warning 2015-10-21 10:01:09 +01:00
Yann Collet 7010c27a13 Added advanced compression functions 2015-10-21 09:07:25 +01:00
Yann Collet c8a7254192 clang optimizer bug workaround 2015-10-20 03:01:38 +01:00
Yann Collet 4caefaf62f refactored literal segment 2015-10-19 19:25:44 +01:00
Yann Collet 1fbee1f483 Fixed sanitizer warning 2015-10-19 15:32:47 +01:00
Yann Collet 4d1a0ef515 minor speed improvement 2015-10-19 03:12:23 +01:00
Yann Collet c7ae9ffde3 small decompression speed improvement 2015-10-19 02:36:34 +01:00
Yann Collet 107c5755f4 small decompression speed improvement 2015-10-19 02:14:43 +01:00
Yann Collet 50174c77fd missed updated files 2015-10-18 22:26:26 +01:00
Yann Collet b1f3f4b565 update huff0 2015-10-18 22:18:32 +01:00
Yann Collet 8f86c700cd Fix uninitialized warnings reported by @nemequ 2015-10-14 17:53:44 +01:00
Yann Collet 59aac5f467 Clarified comments 2015-10-14 16:28:19 +01:00
xaphier 77ee44c7b6 Remove one malloc/free from compression
By making the buffer part of the zstd context structure, one malloc/free
can be removed from the compression.
2015-10-10 12:14:51 +02:00
Yann Collet be50aaa0ee Added : Frame concatenation ability 2015-09-10 23:26:09 +01:00
Yann Collet 5abd8203cb Fix : decompression i/o detects flush write errors 2015-08-27 03:16:04 +01:00
Yann Collet 866a3c3158 Fixed minor visual warning 2015-08-26 23:10:09 +01:00
Yann Collet 352ab88aea fixed minor issue on decoding invalid data 2015-08-26 22:45:23 +01:00
Yann Collet 6b5198fe3a Updated FSE 2015-08-26 19:22:01 +01:00
Yann Collet bf50409e05 Refactor Makefile and .travis tests 2015-08-26 00:19:06 +01:00
Yann Collet f44b2b02b4 Zstd cli : --version and --help write to stdout 2015-08-25 23:32:45 +01:00
Yann Collet c705567522 Fixed : compression error on some specific distribution 2015-08-25 22:56:42 +01:00
Yann Collet 1885029ba1 Fixed a few issues found by AFL (American Fuzzy Lop) 2015-08-24 20:17:11 +01:00
Yann Collet fee8e240c7 Fixed decoding error #11 (reported by @magv) 2015-08-24 15:47:04 +01:00
Yann Collet d5d9bc3f82 Added : ZSTD decompression : ability to resist to noisy/faulty data source 2015-08-23 23:13:49 +01:00
Yann Collet d02114e0e1 updated fse 2015-08-21 03:59:31 +01:00
Yann Collet 997f9ee2ef Added : fuzzer tests : decompressing noisy src 2015-08-21 02:44:20 +01:00
Yann Collet 7d20acd340 Fix : decoder issue in exceptionnal circumstances (dst buffer too small) 2015-08-20 15:55:50 +01:00
Yann Collet 602834f794 Fixed : bug in compression in specific conditions (too small dst size) 2015-08-20 07:46:10 +01:00
Yann Collet 23743530e0 Updated fse 2015-08-19 23:53:56 +01:00
Yann Collet f4ce8913a3 Added more strigent tests : compresson into too small buffer 2015-08-11 14:18:45 +01:00
Yann Collet f90314610d Minor decompression simplification 2015-08-08 02:54:26 +01:00
Yann Collet 8a46c159c5 minor compress sequence refactor 2015-08-08 02:16:11 +01:00
Yann Collet e9853b2cdb Fixed : ZSTD_compress() can attempt compression on a too small buffer 2015-08-07 19:07:32 +01:00
Yann Collet 96f3b2c0f7 zstd_compress() no longer requires maxDstSize >= ZSTD_compressBound(srcSize) 2015-08-07 15:50:42 +01:00
Yann Collet a787550d1c Updated FSE lib 2015-08-07 15:21:00 +01:00
Yann Collet 77c82b680b updated fse 2015-08-02 01:19:09 +01:00
Yann Collet 138db2187d Fixed some minor sanitizer warnings within huff0 2015-07-27 20:19:21 +01:00
Yann Collet fb8296f55c Updated fse (faster huff0 32-bits decoding) 2015-07-27 19:34:27 +01:00
Yann Collet e8c6bb1e42 Integrated huff0 (breaking format change) 2015-07-26 00:23:57 +01:00
Yann Collet 968f275981 Changed allocation strategy to reduce stack usage of ZSTD_compressSequences() 2015-07-07 16:54:25 -08:00
Yann Collet 858db1291f Fixed : ZSTD_compress() corrently prevents buffer overflow 2015-07-07 01:02:04 -08:00
Yann Collet dc6c1d920a Fixed clang warning 2015-07-07 00:44:22 -08:00
Yann Collet 674d91b3da Added sanitize=undefine test 2015-07-07 00:36:49 -08:00
Yann Collet 17867ced03 Fixed minor clang warnings 2015-07-07 00:14:27 -08:00
Yann Collet 7083b8a54a Travis CI : added ARM compilation tests 2015-07-06 23:58:59 -08:00
Yann Collet ee28a0def4 Fixed issue #34 and #31 2015-07-06 23:45:35 -08:00
Yann Collet 94f998b1fc Fixed a few visual analyzer warnings 2015-07-04 23:10:40 -08:00
Yann Collet 7393c5a51d Advanced API change : Cctx & DCtx are now incomplete types for stricter type checking 2015-07-04 18:20:42 -08:00
Yann Collet 1efa31fad8 Updated FSE lib 2015-07-04 15:56:41 -08:00
Yann Collet 078a9a2804 Added Wcast-qual compilation flag
Updated xxHash
Removed log traces
2015-06-20 19:37:53 -08:00
Yann Collet 213089c078 Updated FSE
Added clang and g++ tests
2015-06-18 07:43:16 -08:00
Yann Collet bbfa7d77c9 Fixed issue #28 2015-03-23 23:15:22 +01:00
Yann Collet ad68a0e5f7 "type redef fix" for gcc <= 4.4 2015-02-26 00:29:15 +01:00
Yann Collet 26aa1ec946 updated FSE 2015-02-24 09:05:58 +01:00
Yann Collet a3c75bad5a Updated FSE
Faster speed on barely compressible data
2015-02-21 03:31:59 +01:00
Yann Collet 00be3437a8 Some comments, to explain streaming decompression API 2015-02-20 18:53:31 +01:00
Yann Collet 1db6f22f34 Removed useless constants 2015-02-17 13:38:44 +01:00
Yann Collet c5d46b5c90 New streaming API behavior, to solve issue 19 (https://github.com/Cyan4973/zstd/issues/19) 2015-02-16 18:06:26 +01:00
Yann Collet fb98fd0bd4 datagen refactoring 2015-02-10 18:15:20 +01:00
Yann Collet e30c39cd1b internal refactoring - better separation between match & entropy 2015-02-09 03:50:11 +01:00
Yann Collet 2ddf7e9a28 Fixed : FSE issue with corner case distributions 2015-02-08 20:26:47 +01:00
Yann Collet d6914bfd5a fix minor Visual warning 2015-02-01 12:09:46 +01:00
Yann Collet aacace37f7 Fixed a few clang warnings 2015-02-01 11:57:30 +01:00
Yann Collet b0802817c0 avx2 mode solely detected using __AVX2__ macro 2015-02-01 10:13:22 +01:00
Yann Collet e5c25e0ebc minor fix for Visual 2015-01-31 20:10:53 +01:00
Yann Collet 936e678dda Fixed : issue 8 regarding huge input buffer (> 4 GB) 2015-01-31 15:09:51 +01:00
Yann Collet 439eb77088 Normalize all the line endings 2015-01-31 10:52:59 +01:00
Yann Collet 1cc58def2d Restored cast for C++ (fse) 2015-01-29 07:13:54 +01:00
Yann Collet 6434adcf54 Fix : no AVX2 for Visual 2008 and older 2015-01-29 07:00:43 +01:00
Yann Collet 565b81d0ba fixed : corner case (FSE) 2015-01-29 06:51:30 +01:00
Yann Collet e98ea20c37 Fix for VS2005 (AVX2 intrinsics) 2015-01-28 01:23:14 +01:00
r-lyeh 0da7941a72 Bugfixed Visual Studio errors when compiled as C++ sources 2015-01-26 10:24:04 +01:00
Yann Collet fb81417323 Fixed : minor warnings under Visual 32 bits 2015-01-25 13:19:12 +01:00
Yann Collet 759433d679 Updated fullbench tests 2015-01-24 13:31:55 +01:00
Yann Collet 04d8e15e57 fixed : file permissions 2015-01-24 11:22:13 +01:00
Yann Collet 4856a00164 Initial release 2015-01-24 01:58:16 +01:00