Commit Graph

1238 Commits (f8804d1014da44e02eaa9e83883d0eb12d6308f4)

Author SHA1 Message Date
inikep a6b942018d Merge remote-tracking branch 'refs/remotes/origin/dev' into dev070
# Conflicts:
#	.travis.yml
#	Makefile
#	lib/common/zstd_static.h
#	programs/Makefile
#	projects/VS2008/zstd/zstd.vcproj
#	projects/VS2008/zstdlib/zstdlib.vcproj
#	projects/cmake/lib/CMakeLists.txt
#	projects/cmake/programs/CMakeLists.txt
2016-06-01 00:07:09 +02:00
Yann Collet f2a3b6e7b4 added : frame content checksum 2016-05-31 22:23:45 +02:00
inikep 43aa9fe8b3 fixed skippable frame 2016-05-31 19:36:51 +02:00
inikep f772bf54a5 support for skippable frames 2016-05-31 12:43:46 +02:00
Giuseppe Ottaviano 370b751e24 Expose function to add entropy tables to pre-built dictionary.
In some cases a custom dictionary building algorithm tailored for a specific
input can be more effective than the one produced by `ZDICT_trainFromBuffer`,
but with the current API it's not possible encode the entropy tables into the
custom-built dictionary.

This commit extracts the logic to add entropy tables to a dictionary from
`ZDICT_trainFromBuffer` and exposes it as a function
`ZDICT_addEntropyTablesFromBuffer`.
2016-05-30 19:50:09 -07:00
Yann Collet 290aaa7521 Added : ability to manually select the dictionary ID of a newly created dictionary 2016-05-30 21:18:52 +02:00
Yann Collet 30009521d7 fuzzer tests dictBuilder.
Added : ability to not store dictID during compression; decompression doesn't check dictID then
2016-05-30 16:17:33 +02:00
Yann Collet c0a9bf3c2e minor code refactoring 2016-05-30 04:48:32 +02:00
Yann Collet c46fb924df added dictionary ID (incomplete) 2016-05-29 05:01:04 +02:00
Yann Collet f51e0660f4 Simplified list of `*.c` files 2016-05-29 01:39:19 +02:00
Yann Collet 0c5e8b17ad moved xxhash to lib/common 2016-05-29 01:06:30 +02:00
inikep 957823f56f zstdcli: -r (operate recursively on directories) works with dictBuilder and compression 2016-05-25 15:30:55 +02:00
inikep e75909ef93 ZBUFF_createCCtx_advanced moved to zbuff_static.h 2016-05-25 11:31:16 +02:00
inikep 02c244bf78 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-05-24 17:15:04 +02:00
inikep fb5df613cf zstd_stats.h included only in debug mode 2016-05-24 15:36:37 +02:00
inikep 71dd67cf57 fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-24 10:57:14 +02:00
inikep 13ba880b49 added ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced 2016-05-23 17:04:23 +02:00
inikep 107e243195 added ZSTD_createDCtx_advanced 2016-05-23 16:24:52 +02:00
inikep 50e82c015d added ZSTD_createCCtx_advanced 2016-05-23 15:49:09 +02:00
inikep 35b891c5b0 zstd_stats.h updated to v0.6 2016-05-20 19:42:20 +02:00
Yann Collet f22a0d653d huff0 dynamic reduction 2016-05-20 14:36:36 +02:00
Yann Collet 45f84ab7cc all programs use `ZSTD_VERSION_STRING` from `zstd.h` to display their version 2016-05-20 12:34:40 +02:00
Yann Collet de4d4da52d changed version to 0.6.2
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests
2016-05-20 12:20:12 +02:00
Yann Collet 7591a7f224 minor refactoring 2016-05-20 11:44:43 +02:00
Yann Collet 236d94fa9a reverted default compression level to 1 2016-05-18 12:06:33 +02:00
Yann Collet 78aa05228a fixed Visual warning in debug mode 2016-05-17 14:30:19 +02:00
Yann Collet c8e9c4046f Merge branch 'dev' of github.com:Cyan4973/zstd into dev 2016-05-17 12:02:35 +02:00
Yann Collet ea4daa308d added `ZSTDv05_getFrameParams()` to "zstd_v05.h" 2016-05-17 12:01:55 +02:00
klemens 268775dae8 spelling-fixes, as of lintian.debian.org 2016-05-16 22:23:24 +02:00
Yann Collet d9b3cca4d3 restore openVMS support (detected by @thatsafunnyname) 2016-05-13 12:43:36 +02:00
inikep 63ecd747de added common/entropy_common.c 2016-05-13 11:27:56 +02:00
Yann Collet ccd6e86d45 improved decoding speed by inlining x_isError() functions 2016-05-12 15:55:26 +02:00
Yann Collet 16871680e3 minor refactor : more accurate variable scope 2016-05-12 14:27:00 +02:00
Yann Collet b19d5d76ec restored inline for better decompression speed 2016-05-12 14:06:31 +02:00
Yann Collet 1ceb5a9295 restored DStream init
due to strange speed regressions and warnins on gcc 5.3
2016-05-12 13:50:13 +02:00
Yann Collet ce27e85209 fixed clang conversion warning 2016-05-11 18:55:27 +02:00
Yann Collet 1032fbe714 update FSE library 2016-05-11 18:30:24 +02:00
Yann Collet 249ae0ca99 better big-endian / little-endian r/w support 2016-05-11 16:38:18 +02:00
Yann Collet 3329d98df9 fixed minor asan warning in legacy decoder 2016-05-11 11:07:54 +02:00
Yann Collet c75e4c25e8 Added : ZSTD_getErrorString(), to get error string from error enum (#168) 2016-05-10 17:47:11 +02:00
Yann Collet b3a9938d0c Merge pull request #182 from inikep/dev
support for Visual Studio 2012, 2013, 2015
2016-05-10 17:18:12 +02:00
Yann Collet bd39d54576 zbuff supports byte-by-byte decompression scenarios 2016-05-10 14:14:19 +02:00
inikep ed9a08538c Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
# Conflicts:
#	lib/common/util.h
#	programs/paramgrill.c
#	visual/2013/fullbench/fullbench.vcxproj.filters
#	visual/2013/fuzzer/fuzzer.vcxproj.filters
2016-05-10 13:20:01 +02:00
Yann Collet 918b934a26 minor comment update 2016-05-10 07:00:07 +02:00
inikep 349fcf7ea2 fixed Linux compilation 2016-05-09 18:04:07 +02:00
inikep aaaf923a17 common/util.h moved to programs/util.h
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
inikep d44ec48b1c detection of snprintf for Visual <= 2012 2016-05-09 14:37:41 +02:00
Yann Collet 59b6ba7677 Merge pull request #180 from thatsafunnyname/patch-1
No stdint.h on OpenVMS.
2016-05-09 11:56:42 +02:00
Yann Collet 4ff73a2eff added : midipix support (#181) 2016-05-09 11:44:00 +02:00
Yann Collet d275236e6a Fixed Windows API, as detected by @KrzysFR (#171) 2016-05-09 08:19:27 +02:00
Yann Collet f6ca09b5ff Reduced console display on loading lots of files with `zstd --train`. Reported by @KrzysFR, see #177 2016-05-09 04:44:45 +02:00
Yann Collet e1a69a88c0 Expose Advanced Streaming API for v0.5.x legacy 2016-05-08 09:13:40 +02:00
Yann Collet a5dacdf551 updated fse (minor refactor) 2016-05-06 16:55:27 +02:00
Yann Collet 18dedece91 Support legacy ZSTD_decompress_usingDict() (starting v0.5+) 2016-05-06 16:43:23 +02:00
Yann Collet 8283a2f0aa Fixed decoding corruption error with quad-symbols huffman on legacy decoders 2016-05-06 01:51:31 +02:00
inikep 13c8424ea0 code cleaning 2016-05-05 13:58:56 +02:00
inikep 0bd0faec32 fixed compatibility issues 2016-05-05 13:10:57 +02:00
Yann Collet 6d1d25299a fixed Huff0 quad-symbols decoder (#173) 2016-05-05 12:41:36 +02:00
inikep 9c22e57bfb Compiler Options moved to util.h 2016-05-05 11:53:42 +02:00
Yann Collet ddb8ebd5b3 Stricter gnu90 tests 2016-05-05 04:59:53 +02:00
Yann Collet 3f8ed50bf1 Added gnu90 test
work-around : disabled automatic selection of huff0 quad-decoder (see #173)
2016-05-05 03:01:13 +02:00
inikep 3163403855 UTIL_prepareFileList 2016-05-05 00:25:38 +02:00
thatsafunnyname b0e5427d1a No stdint.h on OpenVMS.
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:43:42 +01:00
Yann Collet 6f9c056662 Fixed BMI behavior on x86 and x32 targets, reported by @tycho (#178) 2016-05-01 10:26:30 +02:00
inikep 55d047aa92 getTotalFileSize moved to common/util.h 2016-04-28 16:50:13 +02:00
inikep d5ff2c3d9a ordering of #include 2016-04-28 14:40:45 +02:00
inikep 83c76b4594 bench.c: time functions moved to common/util.h 2016-04-28 13:16:01 +02:00
inikep 69fcd7c0ae getFileSize moved to common/util.h 2016-04-28 12:23:33 +02:00
inikep 1007a1fe3d get rid of some Visual C++ warnings 2016-04-25 15:23:09 +02:00
inikep 6cb083fe3d fixed 64-bit compilation with Visual C++ 2016-04-25 14:42:15 +02:00
inikep ea4ee3eee0 added compatibility with Visual C++ 2012 2016-04-25 13:09:06 +02:00
inikep a8138fd767 updated lib/README.md part 2 2016-04-25 11:36:44 +02:00
inikep 49794316c2 updated lib/README.md 2016-04-25 11:31:28 +02:00
inikep f066816998 fix for g++ compilation 2016-04-22 18:54:05 +02:00
inikep db3964382c introduced ZSTD_NODECOMPRESS to link only compressor 2016-04-22 18:22:30 +02:00
inikep a1febea01d Error functions moved to common/zstd_common.c 2016-04-22 17:14:25 +02:00
inikep 3c7c3527d0 introduced ZSTD_NOCOMPRESS to generate decompressor only 2016-04-22 13:59:05 +02:00
inikep 23a0889301 separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/ 2016-04-22 12:43:18 +02:00
inikep 4699b3be03 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-21 12:30:58 +02:00
inikep 38654988f3 minor speed improvements 2
bench.c: block size has to be bigger than 32 bytes
zstdcli.c: support for e.g. -B16k -B16m
2016-04-21 12:18:47 +02:00
inikep ef51941822 zst_opt.h: minor compression speed improvement 2016-04-21 11:08:43 +02:00
Yann Collet e02808ffc5 bumped lib version to 0.6.1
added ZSTD_VERSION_STRING
2016-04-20 22:46:16 +02:00
inikep c5e1d295ee bench.c: force at least one compression and decompression loop
fix for -i0 with small files
2016-04-19 09:37:59 +02:00
inikep 2c5eeea635 introduced ZSTD_DEAFULT_CLEVEL for (compressionLevel<=0) 2016-04-15 13:44:46 +02:00
inikep 4b3c5eed99 removed ZSTD_compressBegin_targetSrcSize 2016-04-14 13:43:51 +02:00
inikep c70c90e8a3 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-13 10:48:26 +02:00
Yann Collet 16748729c9 Updated DICT_MAGIC, since internal dictionary format has changed (length encoding) 2016-04-12 23:26:23 +02:00
Yann Collet c5b6d9741a Added : zbuff.c to library; reported by Yipei Zhang 2016-04-12 21:46:18 +02:00
Yann Collet 389648cc6d Fixed : contentSize + copyCCtx() 2016-04-12 19:13:08 +02:00
Yann Collet 541dc7c7d4 Added : fuzzer test, checking contentLength value after copyCCtx() usage 2016-04-12 18:00:20 +02:00
Yann Collet 6236eba991 removed headerBuffer 2016-04-12 15:52:33 +02:00
Yann Collet 0085cd3138 created ZSTD_writeFrameHeader() 2016-04-12 14:14:10 +02:00
Yann Collet abb5c653f1 minor speed improvement for ZSTD_copyCCtx() 2016-04-11 20:42:31 +02:00
Yann Collet 887e7da785 Fixed copyCCtx() on uninitialized cctx (reported by Oliver Lange) 2016-04-11 20:12:27 +02:00
inikep 8844e21dff Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev 2016-04-11 16:49:27 +02:00
inikep f7d210b2e9 cache literal prices for ZSTD_btopt 2016-04-11 16:35:13 +02:00
Yann Collet 582933fde5 fixed round-trip corruption, reported by Oliver Lange 2016-04-11 16:25:56 +02:00
Yann Collet 125d81774f fixed uninitialization error, reported by Maciej Adamczyk 2016-04-11 14:22:56 +02:00
Yann Collet d673d4cf66 fixed uninitialization error, reported by Maciej Adamczyk 2016-04-11 14:10:23 +02:00
Yann Collet ccbba296e1 Fix infinite loop with invalid data (fuzzer test) 2016-04-10 14:42:26 +02:00
Yann Collet 793c649ead updated cLevels 2016-04-09 20:32:00 +02:00
Yann Collet b144bc3e1c Fixed uninitialized warning, reported by Maciej Adamczyk 2016-04-09 17:26:22 +02:00
Yann Collet 9990986bdc fixed minor warnings when compiling with `gcc -g` (aka `-std=gnu90`) 2016-04-09 16:17:18 +02:00
Yann Collet 029267ab3f Integrated Legacy v0.5.x decoder (provided by @inikep) 2016-04-09 09:42:27 +02:00
Yann Collet 7eff39f7ea fixed decoding error 2016-04-09 01:51:36 +02:00
Yann Collet ea63bb7b5e converted fuzzer timer to clock_t 2016-04-08 15:25:32 +02:00
Yann Collet 78267d1abe updated cLevel for block <= 256K 2016-04-08 12:36:19 +02:00
Yann Collet 72cc704514 Merge branch 'dev060' of github.com:Cyan4973/zstd into dev060 2016-04-08 02:02:31 +02:00
Yann Collet 0dbf2874ee faster level 1 at 256 KB 2016-04-08 02:02:12 +02:00
Yann Collet 04a4fd638b Merge pull request #164 from inikep/dev
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 20:46:13 +02:00
inikep afe1f7994b Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
2016-04-07 19:50:03 +02:00
Yann Collet 9e8b09a7bd Fixed memory initialization issue, reported by Maciej Adamczyk 2016-04-07 19:35:23 +02:00
inikep 2bf79f9bff use extDict only when needed 2016-04-07 19:24:33 +02:00
inikep 64d7bcb0dc only repcode 0 for lazy, lazy2 and btlazy2 strategies 2016-04-07 19:14:09 +02:00
inikep a69640cca1 Revert "removed void ZSTD_compressBlock_greedy"
This reverts commit 9296400a69.
2016-04-07 18:22:29 +02:00
Yann Collet d7bee33caf Fixed make install (reported by Oliver Lange) 2016-04-07 18:16:42 +02:00
Yann Collet 5d39357bc4 minor compression speed optimization 2016-04-07 17:19:00 +02:00
inikep 9296400a69 removed void ZSTD_compressBlock_greedy 2016-04-07 16:58:04 +02:00
Yann Collet 485371600a Implemented default coding table for lengths and offset 2016-04-07 15:24:29 +02:00
Yann Collet 79459da14b Merge pull request #163 from inikep/dev
3 repcodes and MINMATCH=3
2016-04-07 14:37:30 +02:00
inikep 81a345b0ce minor speed improvements 2016-04-07 11:35:17 +02:00
inikep e47f33f980 reordered code 2016-04-06 20:58:00 +02:00
inikep 2db1eb78e9 reordered functions 2016-04-06 17:14:19 +02:00
inikep e5b6e9e551 fixed support for searchLength=4 2016-04-06 13:15:38 +02:00
inikep 75716851d4 MINMATCH=3 for lazy strategy 2016-04-06 12:34:42 +02:00
inikep 7bc19b6b3e MINMATCH=3 2016-04-06 09:46:01 +02:00
inikep f8a339d274 working ZSTD_compressBlock_opt_extDict_generic 2016-04-05 23:58:51 +02:00
inikep 83417bbbd2 code formatting 2016-04-05 21:30:03 +02:00
inikep 5ce00aee37 ZSTD_compressBlock_opt_extDict_generic in progress 2016-04-05 21:03:43 +02:00
inikep faa8d8aae1 introduced ZSTD_compressBlock_greedy 2016-04-05 19:01:10 +02:00
inikep 908fcb384a 3 repcodes with ZSTD_compressBlock_lazy_extDict_generic 2016-04-05 18:16:38 +02:00
inikep a4385aa23b ZSTD_REP_NUM=3 only 2016-04-05 17:11:56 +02:00
inikep d5359b2e55 Merge remote-tracking branch 'refs/remotes/origin/repcodes' into dev 2016-04-05 17:07:36 +02:00
inikep ba73d1bb6b support for ZSTD_REP_NUM=3 2016-04-05 10:30:05 +02:00
inikep 74e3a7ba4c removed kSlotNew 2016-04-05 10:18:37 +02:00
inikep b3532793a9 experiments with ZSTD_decodeSequence 2016-04-05 10:08:25 +02:00
Yann Collet 46bdb6267e Merge pull request #161 from inikep/dev
Dev
2016-04-05 09:59:59 +02:00
inikep 2ec2698ef9 working 4 reps 2016-04-05 09:34:13 +02:00
inikep 19140cd80e zstd_stats.h moved to .debug/ 2016-04-05 08:52:57 +02:00
inikep d6f208badf improved logging 2016-04-04 21:15:23 +02:00
inikep 78e52044de Merge remote-tracking branch 'refs/remotes/origin/dev' into repcodes
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_decompress.c
#	lib/zstd_internal.h
#	lib/zstd_opt.h
#	programs/bench.c
2016-04-04 16:28:40 +02:00
inikep cb70c8ab90 fixed -Werror,-Wconversion warning 2016-04-04 15:43:45 +02:00
inikep 0c7456c5b7 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
2016-04-04 14:54:53 +02:00
Yann Collet b59bf963a8 fixed Visual conversion warnings 2016-04-04 14:53:16 +02:00
inikep 227dd4bc74 changed price estimation for optimal parser 2016-04-04 14:34:02 +02:00
Yann Collet 8a57b928ba changed `contentLog` -> `chainLog` 2016-04-04 13:49:18 +02:00
Yann Collet 1005fc1276 reduced memory usage of very hich compression levels in 32-bits mode 2016-04-04 13:28:28 +02:00
inikep 19bd48f516 Merge from Cyan4973/dev060 2016-04-04 12:10:00 +02:00
Yann Collet 1535414927 Fixed 32-bits windowLog limitation
Fixed some macro errors in zbufftest
2016-04-04 04:22:53 +02:00
Yann Collet 5a88a70f97 fixed buffer sync error in zbuff 2016-04-03 20:24:25 +02:00
Yann Collet ef36390e4a refined exception for hashlog < min 2016-04-02 00:46:40 +02:00
Yann Collet 40358d01aa Fix : rare bugs when hashLog < min in bt mode 2016-04-02 00:40:09 +02:00
Yann Collet 1d803d8deb fixed zbuff error 775-3 (internal buffer management) 2016-04-01 18:57:41 +02:00
Yann Collet efb18309ef fixed minor visual 32-64bits conversion warning 2016-04-01 18:54:13 +02:00
Yann Collet afa60e0f14 fixed decoding error, reported by Maciej Adamczyk 2016-04-01 15:49:41 +02:00
Yann Collet 27caf2afca minor variable isolation 2016-04-01 15:48:48 +02:00
Yann Collet 9bb87e5995 fixed harmless comparison warning 2016-03-30 21:28:15 +02:00
Yann Collet 51d500425f fixed paramgrill 2016-03-30 20:42:19 +02:00
Yann Collet dd6466a211 fixed clang conversion warning 2016-03-30 20:06:26 +02:00
Yann Collet 3b71925c2d separate params into compressionParams and frameParams 2016-03-30 19:48:05 +02:00
Yann Collet 21588e370b changed validateParams() into checkParams() + adjustParams() 2016-03-30 16:50:44 +02:00
Yann Collet b44be74244 Fixed zdict
more dictionary compression tests
2016-03-26 20:52:14 +01:00
Yann Collet 74bd11954b fixed ARM compatibility 2016-03-26 17:50:26 +01:00
Yann Collet b9151406de fixed 32-bits compatibility 2016-03-26 17:18:11 +01:00
inikep 97c88e716c fix for -Wshorten-64-to-32 warning in ZSTD_statsUpdatePrices 2016-03-25 13:39:14 +01:00
Yann Collet 433a5cce7e improved decompression speed (680) 2016-03-25 11:43:48 +01:00
inikep 5cc4efdaf8 created zstd_stats.h 2016-03-25 10:52:25 +01:00
Yann Collet 646693e3be support for alternate offset (fusion) 2016-03-24 02:42:15 +01:00
Yann Collet b21ce15efe minor variables isolation 2016-03-24 02:02:32 +01:00
Yann Collet 7cbe79ab25 fixed write overflow found by fuzzer 2016-03-23 22:31:57 +01:00
Yann Collet 72d706a020 fixed crash at -O3 with customized block size (wrong alignment) 2016-03-23 20:44:12 +01:00
inikep eaba91a161 added ZSTD_compressBegin_targetSrcSize 2016-03-23 20:30:26 +01:00
Yann Collet 862a85976f Added BMI instructions 2016-03-23 18:45:23 +01:00
inikep 7adceef974 hashLog3 added to ZSTD_CCtx 2016-03-23 15:53:38 +01:00
Yann Collet 6cf45dac81 shared const BIT_mask 2016-03-23 14:41:54 +01:00
Yann Collet 3c017867de minor optimization (DSpeed 665) 2016-03-23 14:09:51 +01:00
Yann Collet 2512597576 minor reordering (DSpeed 665) 2016-03-23 14:00:09 +01:00
Yann Collet afab02098a improved decoding speed (660) 2016-03-23 13:57:49 +01:00
inikep 472638c861 added mili_sleep and setHighPriority 2016-03-23 12:28:28 +01:00
Yann Collet 9c34df93b6 new decodeSequence, merging parts 2016-03-23 01:54:25 +01:00
Yann Collet add08d6f61 minor variation - DSpeed at 640 2016-03-23 01:32:41 +01:00
Yann Collet be391438ff first working version with both encoder and decode alternate LL + ML coding scheme.
decompression speed highly impacted
2016-03-22 23:19:28 +01:00
inikep 2872b6f01f Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
#	programs/bench.c
2016-03-22 14:38:34 +01:00
Yann Collet fadda6c875 first prototype with ML encoding scheme (but not yet decoding scheme) 2016-03-22 12:14:26 +01:00
inikep 2b942881ac improved 4reps in ZSTD_compressBlock_lazy_generic
kSlotNew = 0
2016-03-22 11:56:22 +01:00
Yann Collet 1dcf930f72 Merge branch 'dev060' into alternateLLcode 2016-03-22 00:29:57 +01:00
inikep f2fa0e1198 final repcodes for ZSTD_btopt 2016-03-21 20:14:03 +01:00
inikep 378be62a9e better repcodes 2016-03-21 19:48:54 +01:00
inikep fc1d7bd93b changed update logic of repcodes 2016-03-21 19:02:16 +01:00
inikep e7ec8f2b9b improved ratio 2016-03-21 17:23:02 +01:00
Yann Collet be4605d851 improved decompression speed 2016-03-21 14:29:26 +01:00
Yann Collet e91477c171 minor variable isolation 2016-03-21 14:22:38 +01:00
Yann Collet b0aec17a90 code simplification (but reduce decompression speed ...) 2016-03-21 13:24:16 +01:00
Yann Collet 6c62b7dfc8 support default LL distribution 2016-03-21 00:39:19 +01:00
Yann Collet d64f435f63 handles litLength >= 65535 2016-03-21 00:07:42 +01:00
Yann Collet 597847a2ae first emulation 2016-03-20 19:14:22 +01:00
Yann Collet ecabfe3777 Improved index overflow protection 2016-03-20 16:20:06 +01:00
Yann Collet 5244738046 minor code refactoring 2016-03-20 16:00:00 +01:00
Yann Collet de406eebcd minor code refactor 2016-03-20 15:46:10 +01:00
Yann Collet 516ba88022 updated huff0 2016-03-20 05:40:39 +01:00
Yann Collet a5c2c08c68 code refactoring 2016-03-20 01:09:18 +01:00
Yann Collet 70e4577179 minor code refactoring 2016-03-19 18:08:32 +01:00
Yann Collet c6eea2b2f2 Improved speed for small files 2016-03-19 17:18:00 +01:00
Yann Collet e74215e3c7 performance fix for small files 2016-03-19 16:09:09 +01:00
inikep 1269e2f7db working kSlotNew for ZSTD_btopt 2016-03-19 15:32:21 +01:00
Yann Collet bb604486f1 fixed clang warning 2016-03-19 15:18:42 +01:00
Yann Collet 37f3d1b2ab minor refactor 2016-03-19 15:11:42 +01:00
Yann Collet 90a03a95a1 minor performance fix (decompression) 2016-03-19 14:47:31 +01:00
Yann Collet 01e5b95199 code refactor 2016-03-19 14:14:31 +01:00
Yann Collet d1d210f3fb minor code refactor 2016-03-19 12:12:07 +01:00
Yann Collet 4db09efde4 simplifications 2016-03-18 22:23:49 +01:00
Yann Collet 39c596ca58 minor simplifications 2016-03-18 21:40:56 +01:00
inikep fade9b7ae3 ZSTD_btopt with 4 repcodes 2016-03-18 16:10:35 +01:00
inikep 1c1e6916e4 improved timer accuracy 2016-03-18 12:49:44 +01:00
Yann Collet a910dc8238 minor code refactoring 2016-03-18 12:37:45 +01:00
inikep 5b15865413 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into repcodes
# Conflicts:
#	lib/zstd_decompress.c
#	programs/bench.c
2016-03-18 11:14:58 +01:00
inikep eca2ec0b3b introduced ZSTD_REP_MOVE and ZSTD_REP_INIT 2016-03-18 11:03:43 +01:00
inikep c56e32e782 4 repcodes when litLen==0 2016-03-17 19:53:38 +01:00
inikep 3e743052cd kSlotNew 2016-03-17 17:24:17 +01:00
Yann Collet 3fd164e656 minor refactoring 2016-03-17 13:43:32 +01:00
Yann Collet b40287aaef Improved decompression speed (by @inikep) 2016-03-17 12:11:16 +01:00
inikep 7d1742825b support for ZSTD_REP_NUM == 1 and ZSTD_REP_NUM == 4 2016-03-17 11:21:00 +01:00
inikep 5945308983 working 4 reps 2016-03-16 15:35:14 +01:00
Yann Collet 569b81adb1 changed `BLOCKSIZE` into `ZSTD_BLOCKSIZE_MAX` 2016-03-16 15:26:51 +01:00
inikep 62d694795d ZSTD_compressBlock_lazy supports more reps 2016-03-16 12:57:07 +01:00
inikep 0ac4a551b9 ZSTD_REP_NUM removed from ZSTD_storeSeq 2016-03-16 12:03:07 +01:00
inikep df164e6d35 introduced U32 rep[ZSTD_REP_NUM] 2016-03-16 11:56:59 +01:00
inikep 4569667c85 ZSTD_REP_NUM 2016-03-16 11:40:09 +01:00
Yann Collet 6cb41356e8 update doc / comments 2016-03-15 15:47:38 +01:00
Yann Collet 346bffbc68 Added frame content size test within fuzzer 2016-03-15 15:24:52 +01:00
Yann Collet 09b21ee2f6 fix fileio bug with new zbuff
simplified zbuff decoding
2016-03-15 12:56:03 +01:00
inikep d700a1a8b9 ZSTD_setAdditionalParam 2016-03-15 12:18:44 +01:00
Yann Collet 1c2c2bcaff minor refactoring 2016-03-15 01:33:36 +01:00
Yann Collet d1b26849e5 Frame content size supported 2016-03-15 01:24:33 +01:00
inikep 5fdd0b46d3 added additionalParam 2016-03-14 19:51:11 +01:00
Yann Collet fb7973580f minor comments update 2016-03-13 11:08:40 +01:00
Yann Collet 03ea59b17b Decompression can decode frame content size 2016-03-12 01:25:40 +01:00
Yann Collet 0e491c01fe created ZSTD_frameParams 2016-03-11 21:58:04 +01:00
inikep cc6c283633 removed hashLog3 from ZSTD_parameters 2016-03-10 15:17:24 +01:00
inikep 260a9e3886 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 2016-03-10 15:04:12 +01:00
inikep b0c640d934 small ratio improvement with MINMATCH=3 2016-03-10 13:18:36 +01:00
Yann Collet da5be72fda update compression level parameters 2016-03-10 11:01:44 +01:00
Yann Collet dcc000f0eb minor doc clarifications 2016-03-10 01:09:41 +01:00
Yann Collet e3193c4081 update compresson levels 2016-03-09 16:57:09 +01:00
Yann Collet 4f013a2281 Merge pull request #142 from inikep/dev
Dev
2016-03-09 16:29:42 +01:00
inikep b5a519f43c improved compression speed
introduced cache in ZSTD_setLog2Prices
2016-03-09 15:45:01 +01:00
Yann Collet 95cd0c2e26 frame format can support window sizes up to 128 MB 2016-03-08 18:24:21 +01:00
Yann Collet ff14b351f5 Merge pull request #141 from inikep/dev
fix update for zstd_opt
2016-03-08 14:41:04 +01:00
Yann Collet d3a6660ad1 Update clevel table for <= 128K 2016-03-08 14:12:46 +01:00
Yann Collet 2e91dde43e improved memory size evaluation by paramgrill 2016-03-08 12:22:11 +01:00
inikep 48413765b4 fixed update of hashTable for matches with length of 4+ 2016-03-08 11:03:55 +01:00
Yann Collet dd54bbc184 Fixed large NbSeq > 32 K
Added a test in Fuzzer to check NbSeq > 32 K
2016-03-08 02:35:34 +01:00
Yann Collet 370b08e840 fix compression ratio for blocks <= 16 KB 2016-03-08 00:03:59 +01:00
Yann Collet fb7ab8b2b8 Merge pull request #140 from inikep/dev
mml3
2016-03-07 18:06:48 +01:00
inikep 4f7f79ef9d fixed update of nextToUpdate 2016-03-07 16:14:58 +01:00
inikep e2446b0e36 added support for MINMATCH=3 on big endian architecture
changed ZSTD_HASHLOG3_MIN to 2 (4 bytes for MINMACH > 3)
2016-03-07 10:07:08 +01:00
inikep 89c9e1a847 added missing "case 3:" in ZSTD_BtGetAllMatches 2016-03-06 23:21:52 +01:00
Yann Collet 1df2594bfe new compression level scale for <= 16KB 2016-03-05 18:43:21 +01:00
inikep 01060bc477 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
# Conflicts:
#	lib/zstd_compress.c
2016-03-04 20:10:09 +01:00
inikep f3c6503e55 resolve conflict in zstd_internal.h 2016-03-04 20:04:25 +01:00
inikep e29caf7d1c code cleanup 2016-03-04 19:52:23 +01:00
inikep 805d2a7465 removed zstd_opt_internal.h 2016-03-04 19:31:57 +01:00
Yann Collet 944d0d2285 updated fse version 2016-03-04 19:26:59 +01:00
inikep 4ab9c913a5 MEM_readMINMATCH replaced with inline function 2016-03-04 19:17:31 +01:00
Yann Collet 4c01580362 finer searchLength validation 2016-03-04 17:07:54 +01:00
Yann Collet d409db68d3 Support for nbSeq > 32767
tamed -Wstrict-aliasing warning
2016-03-04 14:45:31 +01:00
Yann Collet 1435335342 Merge pull request #138 from inikep/dev
reduce stack usage with optimal parsing mode
2016-03-03 02:08:34 +01:00
inikep 5cccd77c55 fix clang -Wcast-align warning (part 2) 2016-03-02 20:37:49 +01:00
inikep 51bb9a0064 fix clang -Wcast-align warning 2016-03-02 19:17:13 +01:00
inikep 87d4f3daa4 priceTable moved to heap 2016-03-02 15:56:24 +01:00
inikep 338533f741 improved price function initialization 2016-03-02 14:36:41 +01:00
Yann Collet a997654670 Merge pull request #136 from inikep/dev
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep a4dde25498 fixed repcode before lowLimit 2016-03-01 14:14:35 +01:00
inikep 2d55563b92 better logs 2016-02-29 22:07:40 +01:00
inikep f647d99d61 fixed bug with 3 or more succesive rep codes 2016-02-29 12:33:08 +01:00
inikep f414647c6b fixed ZSTD_copyCCtx 2016-02-25 22:31:07 +01:00
inikep 59493e8669 fixed paramgrill 2016-02-25 19:15:08 +01:00
inikep afa9c9f5ab turn off RTF optimization 2016-02-25 16:47:57 +01:00
Yann Collet ee0229287c changed version to v0.6.0 2016-02-25 14:53:35 +01:00
inikep 02137f8c42 more accurate gain function 2016-02-24 18:09:36 +01:00
inikep ee55628c9d combined price function 2016-02-24 14:40:30 +01:00
Yann Collet 3152a8c87a finer dictionary completion 2016-02-23 21:28:59 +01:00
inikep 4a981f7937 improved ZSTD_GETPRICE 2016-02-23 19:08:20 +01:00
inikep e0010e9baf priceFunc 2016-02-23 16:25:04 +01:00
inikep 15174b0cfb statistics of encoded sequences 2016-02-23 12:41:56 +01:00
inikep 9f754d23dc dummy levels 22-25 2016-02-22 17:00:04 +01:00
inikep 6b3739c8e5 MINMATCH=3 or 4 selected in ZSTD frame 2016-02-22 15:53:42 +01:00
inikep 84f43e2359 support for searchLength from 3 to 7 for optimal parser 2016-02-22 11:34:07 +01:00
inikep c950b78ce2 removed backward match extension 2016-02-22 10:11:39 +01:00
inikep d3b8d7a4e5 removed ZSTD_opt parser 2016-02-22 10:06:17 +01:00
inikep 6291c54006 litlen bounded to 128 bytes 2016-02-19 18:24:14 +01:00
Yann Collet f8482131d7 better compatibility with Visual <= 2012 2016-02-19 17:33:43 +01:00
Yann Collet 191b52a8dc silence array subscript warning 2016-02-19 15:16:15 +01:00
inikep fcafb26b2e speed optimiaztions 2016-02-19 11:59:44 +01:00
inikep c3a9a9ca56 ZSTD_rescaleFreqs and removed minml 2016-02-19 11:05:25 +01:00
inikep cc52a97214 added hashLog3 2016-02-19 10:09:35 +01:00
Yann Collet 4c64d51425 modified level 18 2016-02-18 01:01:42 +01:00
Yann Collet d56a4192f6 Added : README within /lib directory, to help file selection 2016-02-17 17:47:29 +01:00
Yann Collet 6062b15a07 performance fix for hash chain mode 2016-02-16 17:41:03 +01:00
Yann Collet accfd80c37 Added : option `-t` to test compressed files integrity 2016-02-15 19:33:16 +01:00
Yann Collet 0068be94d8 Faster literals cost evaluation (suggested by @inikep) 2016-02-15 18:42:13 +01:00
Yann Collet e93add0439 Removed `if (matchIndex >= current) return 0;` as recommended by @inikep 2016-02-15 17:44:14 +01:00
Yann Collet b8a6f6824b refactored fix to be more generic and applicable to both btlazy2 and btopt 2016-02-15 17:06:29 +01:00
Yann Collet b37e0a9241 performance tweak : bt search w/ long repeated segments 2016-02-15 14:07:07 +01:00
Yann Collet cefef8cde7 Change : zstd_opt_bt => zstd_btopt 2016-02-15 07:21:54 +01:00
Yann Collet 0d78a33374 updated CLevel confs for 256K 2016-02-15 06:49:09 +01:00
Yann Collet 422fd563f3 modified : compression Levels for blocks <= 16KB 2016-02-13 15:07:24 +01:00
Yann Collet 38fba56483 Changed compression level settings 2016-02-13 11:20:23 +01:00
Yann Collet e8bd73df80 Fixed : error when compressing one file 2016-02-13 03:09:48 +01:00
Yann Collet 23e8aee224 Introduced new compression level settings
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet 82f4d7da03 Fixed Visual solution 2016-02-12 22:04:49 +01:00
Yann Collet 6f3acbac0d notificationLevel into ZDICT_param_t 2016-02-12 20:19:48 +01:00
Yann Collet 09ab681328 fixed libzstd install 2016-02-12 19:00:30 +01:00
Yann Collet 62ae5fb0d2 zstd_buffered => zbuff 2016-02-12 18:59:11 +01:00
Yann Collet f4c9d75370 dictBuilder => zdict 2016-02-12 18:45:02 +01:00
Yann Collet f062436fa6 cli : added ability to compress multiple files into stdout (-c) 2016-02-12 15:56:46 +01:00
Yann Collet 71eafdd23f Integrated dictionary builder into zstd cli 2016-02-12 02:31:57 +01:00
Yann Collet fb92a78ac1 Fixed clang warnings 2016-02-12 00:32:38 +01:00
Yann Collet 7d36028078 Integrate dictBuilder into libzstd 2016-02-12 00:10:25 +01:00
Yann Collet 82260ddd8a fixed asan read error in ZSTD_HcGetAllMatches 2016-02-11 07:14:25 +01:00
Yann Collet 04b12d8bcb paramgrill can select manually targetLength
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet bd828d9cd1 changed : sufficientLength => targetLength 2016-02-11 04:38:55 +01:00
Yann Collet 4488661678 minor cosmetics 2016-02-11 04:17:50 +01:00
Yann Collet 490aa68b18 restored fast zstd_opt variant 2016-02-10 17:18:24 +01:00
Yann Collet b79a0b34f3 paramgrill supports sufficientLength
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet 62ae262771 restored currentMl>0 condition, as suggested by @inikep 2016-02-10 15:44:07 +01:00
Yann Collet 3b63f7fbb0 change zstd_opt.c into zstd_opt.h, since it's included 2016-02-10 15:05:12 +01:00
Yann Collet 0db4115f35 fixed debug print macros on Windows 2016-02-10 14:50:22 +01:00
Yann Collet 2f94d2f166 minor refactor 2016-02-10 14:26:30 +01:00
Yann Collet 768c6bc705 fix : inlining difficulties with gcc 4.6 (travis) 2016-02-10 14:01:49 +01:00
Yann Collet 70e8c389f1 Refactoring for portability 2016-02-10 13:37:52 +01:00
Yann Collet 302177a0c8 Merge pull request #125 from inikep/dev
Dev
2016-02-10 00:57:00 +01:00
inikep ce6730a740 fix for ZSTD_HcGetAllMatches_generic 2016-02-09 23:26:30 +01:00
inikep be77f3342d Revert "Revert "ZSTD_compressBlock_opt_extDict_generic""
This reverts commit 2b714dfd26.
2016-02-09 23:00:41 +01:00
inikep 2b714dfd26 Revert "ZSTD_compressBlock_opt_extDict_generic"
This reverts commit b498fc1c99.
2016-02-09 22:47:51 +01:00
inikep b498fc1c99 ZSTD_compressBlock_opt_extDict_generic 2016-02-09 22:23:48 +01:00
inikep e75621f98d dumpsEnd 2016-02-09 21:12:23 +01:00
inikep 31314ae0d1 int to U32 2016-02-09 20:47:39 +01:00
Yann Collet 6bff748e43 Fixed minor warnings in legacy modes 2016-02-09 17:55:01 +01:00
Yann Collet 4f0a3931c8 added missing patches 2016-02-07 04:00:27 +01:00
inikep da730ff092 a bugfix for backward matches 2016-02-06 15:18:26 +01:00
inikep dbade7c263 remove ZSTD_compressBlock_opt2_generic 2016-02-05 20:29:31 +01:00
inikep f2fee4c316 added params.sufficientLength 2016-02-05 19:45:25 +01:00
inikep 5b0749715d backward match extension 2016-02-05 19:25:40 +01:00
inikep 2712b69582 Merge remote-tracking branch 'refs/remotes/origin/v05x' into dev 2016-02-05 09:22:10 +01:00
inikep 3379c5df36 ZSTD_OPT_DEBUG 2016-02-05 09:21:20 +01:00
inikep f967753bc2 ssize_t -> int 2016-02-05 09:07:22 +01:00
Yann Collet 982ffc773d changed enum type name to `ZSTD_ErrorCode` 2016-02-05 02:33:10 +01:00
inikep 55a444764b sufficient_len = 32 2016-02-04 22:22:47 +01:00
inikep 34608aaa29 ssize_t 2016-02-04 22:18:02 +01:00
inikep 17712afdbc Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into v05x 2016-02-04 21:49:45 +01:00
inikep b3df71e538 code cleaning 2016-02-04 21:45:26 +01:00
inikep 4fa4098628 last match will start at a minimum distance of 8 from oend 2016-02-04 21:16:07 +01:00
inikep 08f500ca10 cur_min 2016-02-04 20:53:54 +01:00
inikep 6f07186745 clean code 2016-02-04 17:57:50 +01:00
inikep 59c9146258 40099096 2016-02-04 17:48:33 +01:00
inikep baff8d6c1f gitignore 2016-02-04 16:02:05 +01:00
inikep 40dd4739e3 removed llen 2016-02-04 15:52:35 +01:00
inikep c9483f0982 clean code 2016-02-04 15:28:55 +01:00
Yann Collet 953ce72f4a minor comments refactoring 2016-02-04 15:28:14 +01:00
inikep 158677c16a new copy rep 2016-02-04 15:25:37 +01:00
inikep d1ff7bf89a cur_rep 2016-02-04 14:57:11 +01:00
inikep eb72f5992a i != litlen 2016-02-04 14:55:23 +01:00
inikep 997fb064a6 anchor 2016-02-04 13:01:56 +01:00
inikep 75be1a412c fixes 2016-02-04 11:48:06 +01:00
inikep cb5cd16d6b 40392170 integer 2016-02-04 11:19:06 +01:00
inikep 27e1c6a51f ZSTD_resetFreqs 2016-02-04 11:11:08 +01:00
inikep 4196923dc9 40370570 ZSTD_getPriceReal 2016-02-04 10:04:33 +01:00
inikep 70b054559b MaxLit 2016-02-03 22:56:55 +01:00
inikep a98149df59 ZSTD_getLiteralPrice 2 2016-02-03 21:26:18 +01:00
inikep dbbedfbd95 ZSTD_getLiteralPrice 2016-02-03 19:53:29 +01:00
inikep 892776efd6 ZSTD_get_price2 2016-02-03 19:27:44 +01:00
inikep 1292509987 ZSTD_get_price 2016-02-03 19:13:28 +01:00
inikep 749460d9ab ZSTD_updatePrice 2016-02-03 19:08:48 +01:00
inikep 3bfcfc7bb0 ZSTD_updatePrice 2016-02-03 18:47:30 +01:00
inikep 53721f134c Merge remote-tracking branch 'refs/remotes/Cyan4973/v05x' into v05x
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
2016-02-03 17:29:40 +01:00
inikep 78e5ea3a32 ZSTD_getPrice 2016-02-03 17:25:42 +01:00
inikep d02506c186 40699855 2016-02-03 16:54:23 +01:00
inikep 85cc6b509b minml 2016-02-03 15:58:08 +01:00
inikep 7f6680e658 clean some code 2016-02-03 13:30:34 +01:00
inikep 4cb2009821 40901629 2016-02-03 13:25:34 +01:00
inikep 1b8b1f9d53 auto check of matches 2016-02-03 13:17:28 +01:00
inikep e9f30eae4b 40970636 2016-02-03 12:53:07 +01:00
Yann Collet b010b3b627 Fixed decoding error (afl) 2016-02-03 12:39:34 +01:00
Yann Collet 72bff50ecf Updated error API, following suggestions by @nemequ (#116) 2016-02-03 12:06:24 +01:00
Yann Collet ae7aa06650 lots of minor refactorings 2016-02-03 02:46:46 +01:00
Yann Collet 7d968c7bdd move _usingDict() to stable API (zstd.h) 2016-02-03 02:11:32 +01:00
Yann Collet 464fa996e9 added v0.4 legacy support 2016-02-03 01:09:46 +01:00
inikep 5391a718a4 fixed 2016-02-03 00:04:14 +01:00
inikep 55bc9a868a 41374379 2016-02-02 19:47:09 +01:00
inikep 5d4131067b update 2016-02-02 17:41:21 +01:00
Yann Collet 7d8e6bddb9 changed long length format 2016-02-02 17:30:37 +01:00
inikep d6e8cc5f0c 41403384 2016-02-02 16:43:31 +01:00
Yann Collet 7a6343fb1b fixed encoding bugs 2016-02-02 16:00:50 +01:00
inikep e1b8e53e84 better logging 2016-02-02 15:41:16 +01:00
Yann Collet 2ce4923238 modified buffer management rules 2016-02-02 14:36:49 +01:00
inikep 59140c5480 turn off: last match must start at a minimum distance of 8 from oend 2016-02-02 12:36:09 +01:00
inikep ef2706ed12 in progress 2016-01-31 15:32:01 +01:00
inikep 6b0715b8fd no "start" 2016-01-31 15:17:50 +01:00
inikep d4c3e8c595 fixed logs 2016-01-31 14:28:26 +01:00
inikep c0dc4c361d best_off 2016-01-31 12:36:41 +01:00
inikep 9bfb1a3357 working 2016-01-31 12:17:16 +01:00
inikep ee4be5e981 ZSTD_compressBlock_opt_generic 2016-01-31 11:57:01 +01:00
inikep e2bfe2407a GetAllMatches 2016-01-31 11:26:05 +01:00
inikep c71568fd44 ZSTD_opt 2016-01-31 11:26:04 +01:00
Yann Collet 35f7de52c8 fixed Visual warnings 2016-01-31 02:51:03 +01:00
Yann Collet 61e16ce07c minor optimization for small files 2016-01-31 02:04:15 +01:00
Yann Collet e93d6ced17 minor compression gain 2016-01-31 00:58:06 +01:00
Yann Collet fd416f1eaf added : ZSTD_compress_usingPreparedCCtx() 2016-01-30 03:14:15 +01:00
Yann Collet 863ec40f1e minor compression speed improvement 2016-01-28 17:56:33 +01:00
Yann Collet 9cadd0853c add basic tests 2016-01-28 15:39:52 +01:00
Yann Collet 4ddb1f5566 optimized counting of small segments 2016-01-28 03:24:53 +01:00
Yann Collet fb810d6053 changed dictionary format 2016-01-28 00:21:13 +01:00
Yann Collet 1c8e194297 modified streaming compression API 2016-01-26 16:31:22 +01:00
Yann Collet 7b51a2948f modified streaming decompression API 2016-01-26 15:58:49 +01:00
Yann Collet b923f65076 introduced dictionary format 2016-01-26 03:14:20 +01:00
Yann Collet bc4c8aa4b7 fixed new MIN_CBLOCK_SIZE 2016-01-25 17:26:01 +01:00
Yann Collet 3742219b4e fixed decompression bugs 2016-01-25 16:54:05 +01:00
Yann Collet a1249dc8da fix visual warnings 2016-01-25 04:22:03 +01:00
Yann Collet afe0709964 stream control 2016-01-25 04:10:46 +01:00
Yann Collet 59d1f79768 variable litblock header size 2016-01-23 19:28:41 +01:00
Yann Collet a768a301ba fixed VS project 2016-01-21 16:04:35 +01:00
Yann Collet ffec740d37 fixed visual and clang errors 2016-01-21 15:50:11 +01:00
Yann Collet 977f1f3600 modified error system, following suggestions by @nemequ 2016-01-21 15:38:47 +01:00
Yann Collet 74ce8e812c fixed VS 2015 'ERROR already defined', reported by Rich Geldreich 2016-01-21 14:32:41 +01:00
Yann Collet 7beaa05d81 fixed bt bug 2016-01-21 11:57:45 +01:00
Yann Collet 1840d6af33 bench pay attention to variable block sizes 2016-01-20 15:39:06 +01:00
Yann Collet fba6aed175 changed : ZSTD_LEGACY_SUPPORT set to 0 by default within `zstd_decompress.c` (#113) 2016-01-18 12:03:54 +01:00
Yann Collet a87278a4f0 small compression speed 2016-01-17 00:12:55 +01:00
Yann Collet 3a3b72f25a Implemented ZSTD_HEAPMODE for zstd_decompress.c
Reduce cmake version requirement to 2.8.7
2016-01-11 12:56:11 +01:00
Yann Collet 523b594233 fixed read error 2016-01-09 02:10:40 +01:00
Yann Collet b012510d9f dictionary with block API 2016-01-09 02:00:10 +01:00
Yann Collet bf42c8e5d8 block-level API 2016-01-09 01:08:23 +01:00
Yann Collet c64c100658 fixed : unused variable 2016-01-08 17:54:02 +01:00
Yann Collet 600962711d added duplication tests 2016-01-08 17:27:50 +01:00
Yann Collet 6e1c4c6c65 fixed context copy 2016-01-07 23:07:44 +01:00
Yann Collet ecd651bd91 added ZSTD_duplicateCCtx() 2016-01-07 15:35:18 +01:00
Yann Collet 494c786a3b fixed outstanding strict aliasing warnings 2016-01-06 12:54:02 +01:00
Yann Collet 1fdd82312d Fixed : strict aliasing warnings in legacy decoders 2016-01-06 12:35:42 +01:00
Yann Collet 218bd31942 minor strict aliasing warning 2016-01-06 02:19:55 +01:00
Yann Collet 3b994cb465 updated fse 2016-01-06 01:58:37 +01:00
Yann Collet 96ffa424eb minor fast mode improvement 2016-01-02 01:16:28 +01:00
Yann Collet 2cc12cb3cb minor refactoring 2016-01-01 07:47:58 +01:00
Yann Collet 1358f91ec4 minor refactoring 2016-01-01 07:29:39 +01:00
Yann Collet 72e84cfd0f minor simplification 2015-12-31 19:08:44 +01:00
Yann Collet 722504c2a0 update version to 0.4.6 2015-12-31 18:32:15 +01:00
Yann Collet 5f9f98768a Makefile version automatically follows zstd.h 2015-12-30 19:52:08 +01:00
Yann Collet 48da164f14 fixed clang warnings 2015-12-29 23:40:02 +01:00
Yann Collet ee3f4515c1 faster hc mode with repetitive data (experimental) 2015-12-29 22:26:09 +01:00
Yann Collet d94efbf95c fix fast mode on Windows 2015-12-29 14:29:08 +01:00
Yann Collet 1ac364d60b Merge pull request #99 from KrzysFR/dev
Update version to 0.4.5 in zstdlib resources
2015-12-21 10:19:26 +01:00
Yann Collet ed73ae8c67 fix #101 2015-12-19 19:51:42 +01:00
Christophe Chevalier 8972f13b4a Added missing ZSTDLIB_API for ZSTD_decompress_usingDict and ZSTD_decompressDCtx 2015-12-18 11:20:37 +01:00
Yann Collet 31683c0b28 benchmark can use dictionary 2015-12-18 01:26:48 +01:00
Yann Collet fdcad6d3e1 added ZSTD_compress_usingDict() 2015-12-17 23:50:15 +01:00
Yann Collet deb078b9b1 added : -m : decompress multiple files 2015-12-17 20:30:14 +01:00
Yann Collet f54f57023c update params for 256K 2015-12-16 19:38:54 +01:00
Yann Collet 0700585fb9 fixed asan warning 2015-12-12 12:54:48 +01:00
Yann Collet 188b6ed6c7 fixed g++ warning 2015-12-12 12:44:44 +01:00
Yann Collet 3a061a4c9f extended static dictionary to buffered mode 2015-12-12 11:17:42 +01:00
Yann Collet 6c3e2e7855 fixed : high compression modes for Windows 32 bits 2015-12-11 10:44:07 +01:00
Yann Collet 9f5ab1a4f5 fix 32-bits windows decoding on high-compression archives 2015-12-11 00:27:41 +01:00
Christophe Chevalier 2abb04d90d Added ZSTDLIB_API to new ZSTD_maxCLevel method 2015-12-09 23:55:23 +01:00
Christophe Chevalier 7b05324a71 Only define ZSTDLIB_API when building a Windows DLL 2015-12-09 17:12:12 +01:00
Christophe Chevalier 844baf4fc5 Merge remote-tracking branch 'upstream/dev' into zstdlib_api 2015-12-09 15:45:57 +01:00
Yann Collet d608088ca3 added : ZSTD_maxCLevel()
added : 256KB blocks mode
2015-12-09 09:05:22 +01:00
Yann Collet 0cde77bc5e fixed comment (reported by @annulen) 2015-12-08 14:47:46 +01:00
Christophe Chevalier d2199e7250 Added ZSTDLIB_API definition to zstd_buffered.h which does not seem to include zstd.h 2015-12-07 19:01:41 +01:00
Christophe Chevalier c6e845398a Add ZSTDLIB_API macro to prefix all exported methods with__declspec(dllexport) when building a DLL (on windows) 2015-12-07 17:48:53 +01:00
Yann Collet 4bfe415fa7 validated external dictionary 2015-12-06 13:18:37 +01:00
Yann Collet e47c4e5f8e strengthened bufferless streaming decompression 2015-12-05 09:23:53 +01:00
Yann Collet 417890cec2 strengthened streaming bufferless compression 2015-12-04 17:16:37 +01:00
Yann Collet 6a2f03295c update version to 0.4.2 2015-12-02 15:05:22 +01:00
Yann Collet 120230b895 compress uses less memory for small blocks 2015-12-02 14:00:45 +01:00
Yann Collet a308259afa new : parameters for <= 16KB 2015-12-02 13:38:48 +01:00
Peter Harris f06e238d6f Fix compression on Big Endian CPUs 2015-12-01 14:58:24 -05:00
Yann Collet c620b48489 revert install to normal zstd due to travis limitation (likely gcc 4.6) 2015-12-01 01:56:02 +01:00
Yann Collet 44287a3bf4 refactored decompress (#82) 2015-11-30 23:13:56 +01:00
Yann Collet aead1bf86b changed to ZSTD_LEGACY_SUPPORT=0, as suggested within #80 2015-11-30 14:18:47 +01:00
Yann Collet daa1c65500 fixed #81 : removed dead file (reported by @inikep) 2015-11-30 12:25:48 +01:00
Yann Collet a85a8dd94a Fixed #80 (reported by @luben)
Added : tests for ZSTD_LEGACY=disable build mode
extended ZSTD_LEGACY=disable to dll build
2015-11-30 11:53:11 +01:00
Yann Collet 375727310c fixed compression bug 2015-11-29 03:17:04 +01:00
Yann Collet 7fe531e7ec fixed address space overflow (32-bits mode) 2015-11-29 02:38:09 +01:00
Yann Collet 52732b505d fixed huff0 decoder (32-bits mode) 2015-11-28 22:03:08 +01:00
Yann Collet bf7aa3c14e fixed decoder error (rollbuffer mode) 2015-11-28 18:19:44 +01:00
Yann Collet ad50c59bb7 fixed decoder error (32-bits mode, malicious input) 2015-11-28 17:09:28 +01:00
Yann Collet 00fd7a2110 protect 32-bits mode 2015-11-28 16:03:22 +01:00
Yann Collet 53fbf01370 minor level change 2015-11-28 14:08:01 +01:00
Yann Collet 800fa6c378 stronger tests for zbuff decompression 2015-11-27 14:30:23 +01:00
Yann Collet 31d1806a77 zbuff properly supports small dst buffers 2015-11-27 14:07:36 +01:00
Yann Collet 944042ab7d coalesce block+header size (buffered mode) 2015-11-27 13:26:38 +01:00
Yann Collet d248aa1c62 fixed hang bug (infinite loop) in decoder, buffered mode, malicious input 2015-11-26 22:39:29 +01:00
Yann Collet 661b94fb5d fixed potential warning on undefine, reported by Maciej Adamczyk 2015-11-26 16:42:06 +01:00
Yann Collet 29a58c94f6 fixed lib makefile 2015-11-26 16:25:56 +01:00
Yann Collet 26fa696713 minor API change 2015-11-26 16:07:08 +01:00
Yann Collet 29a2c838c5 support for legacy 0.3 format 2015-11-26 16:02:04 +01:00
Yann Collet c2ce890ac2 fixed bug in legacy decoder v0.2, reported by Maciej Adamczyk 2015-11-26 14:12:23 +01:00
Yann Collet 26415d3ff2 fixed leak 2015-11-26 12:43:28 +01:00
Yann Collet 6bcdeac954 fixed asan warning 2015-11-26 11:43:00 +01:00
Yann Collet 5f2ec63852 fixed decompression bug (buffered mode) 2015-11-26 10:32:17 +01:00
Yann Collet 91a97960f7 Added zbufftest 2015-11-26 09:59:49 +01:00
Yann Collet e4fdad55dc fixed minor decompression bug in buffered mode 2015-11-25 21:09:17 +01:00
Yann Collet d3cb690156 fixed leak issue 2015-11-25 15:26:55 +01:00
Yann Collet 377b9e8b94 fixed : potential malloc error 2015-11-25 15:04:37 +01:00
Yann Collet 7b2c31043c fixed : potential malloc error 2015-11-25 15:02:46 +01:00
Yann Collet 88fcd2916e Added : zstd buffered API 2015-11-25 14:42:45 +01:00
Yann Collet c36521571e fixed large buffers bug 2015-11-24 14:06:07 +01:00
Yann Collet 225179dd05 more tests (bt modes) 2015-11-23 16:52:22 +01:00
Yann Collet 239cc289d3 fixed asan bugs 2015-11-23 16:17:21 +01:00
Yann Collet 03526e18fa preliminary rollbuffer support for bt mode 2015-11-23 15:29:15 +01:00
Yann Collet c1e52f0f05 hc simplication 2015-11-23 14:37:59 +01:00
Yann Collet 06eade5102 comments 2015-11-23 14:23:47 +01:00
Yann Collet 5054ee0cc0 rollbuffer refactor 2015-11-23 13:34:21 +01:00
Yann Collet d7233d6e14 more compression tests 2015-11-22 14:40:51 +01:00
Yann Collet 287b7d9607 small hc speed improvement 2015-11-22 13:24:05 +01:00
Yann Collet 428619ccd7 small cLevel update 2015-11-22 12:46:30 +01:00
Yann Collet a85c77b9d3 fixed roll buffer lazy2 mode 2015-11-22 12:22:04 +01:00
Yann Collet b7fc88eec7 fixed roll buffer lazy mode 2015-11-22 03:12:28 +01:00
Yann Collet 734aa92ed5 fixed roll buffer greedy mode 2015-11-22 03:01:33 +01:00
Yann Collet 9a24e5986b fixed roll buffer in fast mode 2015-11-22 02:53:43 +01:00
Yann Collet 007c1c6ff0 minor cr improvement 2015-11-22 02:42:28 +01:00
Yann Collet 7a23179779 small fast compression improvement 2015-11-21 15:27:35 +01:00
Yann Collet 402fdcf1a3 fixed asan 2015-11-20 12:46:08 +01:00
Yann Collet 55aa7f94e3 modified format 2015-11-20 12:04:52 +01:00
Yann Collet 743402cb23 modified format 2015-11-20 12:03:53 +01:00
Yann Collet 7dfd56be4a restored fix small blocks 2015-11-19 17:46:29 +01:00
Yann Collet c95f899725 refactored greedy 2015-11-19 17:28:35 +01:00
Yann Collet b3a2af970e refactored decompression 2015-11-19 17:13:19 +01:00
Yann Collet 110cc14bab fixed bug #73 notified by @nemequ 2015-11-19 12:02:28 +01:00
Yann Collet dcac00e7a6 update library builder 2015-11-19 11:23:44 +01:00
Yann Collet b2549846ba more tests 2015-11-18 11:29:32 +01:00
Yann Collet 94b9d8ec8d fix compression bug in rollbuffer mode 2015-11-17 16:14:55 +01:00
Yann Collet 138e89c9c4 fix compression bug (extDict mode) 2015-11-17 14:26:54 +01:00
Yann Collet 786eb7d42e fixed repcode bug 2015-11-17 12:23:53 +01:00
Yann Collet 82368cfa1b comment 2015-11-16 19:10:56 +01:00
Yann Collet eaa5f75b99 fixed decompression bug 2015-11-15 11:13:41 +01:00
Yann Collet 93a823ccb7 fixed asan warnings 2015-11-13 15:08:43 +01:00
Yann Collet 89db5e001d rolling buffer preliminary support for fast mode 2015-11-13 11:27:46 +01:00
Yann Collet 0f366c61ed fixed streaming decoder 2015-11-12 16:19:30 +01:00
Yann Collet 5b78d2f20c basic rolling buffer support in decoder 2015-11-12 15:36:05 +01:00
Yann Collet 14983e7aed refactored compression code 2015-11-11 21:38:21 +01:00
Yann Collet 7f6e91fa98 fixed library compilation 2015-11-11 14:39:50 +01:00
Yann Collet 5be2dd25f2 Changed Library source tree
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet 530918b409 level tuning 2015-11-10 10:52:58 +01:00
Yann Collet 9f432926b4 fileio can use small blocks params 2015-11-09 17:42:17 +01:00
Yann Collet 43e0cd512a small blocks params 2015-11-09 16:38:17 +01:00
Yann Collet 4baee50728 fix bug 2015-11-09 03:19:33 +01:00
Yann Collet d1ade5a61d fix 32-bits mode 2015-11-08 15:49:20 +01:00
Yann Collet e9eba608c2 simplified bt 2015-11-08 15:08:03 +01:00
Yann Collet 31d00ba4b3 fix bt bug 2015-11-08 14:11:29 +01:00
Yann Collet 72a8e751f4 level tuning 2015-11-07 22:24:46 +01:00
Yann Collet f48e35c206 minor bt improvements 2015-11-07 01:13:31 +01:00
Yann Collet a81d9ac42d minor bt CSpeed 2015-11-06 19:03:59 +01:00
Yann Collet 628065cf98 revert 2015-11-06 18:44:54 +01:00
Yann Collet 9b8e453713 minor CRatio improvement 2015-11-06 18:28:02 +01:00
Yann Collet 47cfa9a985 minor CRatio improvement 2015-11-06 17:13:46 +01:00
Yann Collet eb283710dd minor greedy CRatio improvement 2015-11-06 16:33:11 +01:00
Yann Collet fc2afcfa64 small Cspeed increase 2015-11-06 15:40:14 +01:00
Yann Collet 444873f494 minor greedy mod 2015-11-06 11:48:56 +01:00
Yann Collet 805a52a773 fixed asan warning 2015-11-06 10:52:17 +01:00
Yann Collet 8ad12ec343 level tuning 2015-11-06 10:19:00 +01:00
Yann Collet f12c1304a8 integrate fast mode 2015-11-05 18:16:59 +01:00
Yann Collet 1f44b3f778 added fast mode 2015-11-05 17:32:18 +01:00
Yann Collet 47b68908b2 rename lazy2 2015-11-05 15:14:17 +01:00
Yann Collet 9036105b62 simplified source 2015-11-05 15:03:12 +01:00
Yann Collet 5106a76dc9 merged strats 2015-11-05 15:00:24 +01:00
Yann Collet 43ae161fe9 level tuning 2015-11-05 11:58:02 +01:00
Yann Collet 92309cb37e level tuning 2015-11-05 00:48:37 +01:00
Yann Collet 3137d1a059 fix fuzzer32 litCSize limit condition 2015-11-04 23:36:36 +01:00
Yann Collet 50c5cdb44c fixed issues reported by Maciej Adamczyk 2015-11-04 20:35:33 +01:00
Yann Collet 3e3582719c Fixed issue #62, reported by @luben 2015-11-04 18:19:39 +01:00
Yann Collet e8455f51ea fix clang warning 2015-11-04 17:41:20 +01:00
Yann Collet b241e9deb7 small compression improvement 2015-11-04 13:57:24 +01:00
Yann Collet 59d7063fbc fix and level tuning 2015-11-04 12:05:27 +01:00
Yann Collet 96b9f0ba4d btlazy2 2015-11-04 03:52:54 +01:00
Yann Collet 588d1e5fa0 Fixed asan issue reported by Maciej Adamczyk 2015-11-03 10:48:42 +01:00
Yann Collet 050efba81b level tuning 2015-11-03 09:49:30 +01:00
Yann Collet 3564487614 lazydeep 2015-11-02 16:14:46 +01:00
Yann Collet 7671f393be v0.3.2 2015-11-02 12:17:39 +01:00
Yann Collet 4e049bca8c Fixed Visual Studio issue #60, reported by @mailagentrus 2015-11-02 11:09:54 +01:00
Yann Collet 56e1092cb0 level tuning 2015-11-02 01:02:43 +01:00
Yann Collet 9b11b46f8a Fixed speed regression 2015-11-01 12:40:22 +01:00
Yann Collet be2010ea1b lazy strategy 2015-10-31 12:57:14 +01:00
Yann Collet 4b100f43b0 level tuning 2015-10-30 15:49:48 +01:00
Yann Collet ec43ba4a95 updated visual studio projects 2015-10-30 11:51:26 +01:00
Yann Collet aa074051d6 decoding support for legacy v0.2 format 2015-10-30 11:21:50 +01:00
Yann Collet fc04bcc6d7 fixed minor gcc warning 2015-10-30 07:11:07 +01:00
Yann Collet 8f9d49c092 fixed asan warning 2015-10-30 07:00:37 +01:00
Yann Collet 4114f95ce9 fix Visual Studio projects 2015-10-30 06:40:22 +01:00
Yann Collet 44fe99116e fixed hc alloc 2015-10-29 22:02:40 +01:00
Yann Collet 712def905b one less hc malloc 2015-10-29 18:41:45 +01:00
Yann Collet 3d9cf7acf2 fix include 2015-10-29 17:15:14 +01:00
Yann Collet 71bcdb5c1f sync paramgrill with HC starting at level 2 2015-10-29 17:08:03 +01:00
Yann Collet 2acb5d3d48 HC modes can be selected from command line 2015-10-29 16:49:43 +01:00
Yann Collet 76c5c2a4a0 minor tuning 2015-10-28 19:07:05 +01:00
Yann Collet 81e49e6654 fine tune & messages 2015-10-28 15:56:48 +01:00
Yann Collet b315bc86e1 srcLog 2015-10-27 13:12:25 +01:00
Yann Collet 2c6992e1dc blocksize & T 2015-10-27 12:18:00 +01:00
Yann Collet d55a7e0e4d simplified chain 2015-10-27 03:06:40 +01:00
Yann Collet 8b91abec18 can test param conf 2015-10-27 02:59:12 +01:00