inikep
a6b942018d
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev070
...
# Conflicts:
# .travis.yml
# Makefile
# lib/common/zstd_static.h
# programs/Makefile
# projects/VS2008/zstd/zstd.vcproj
# projects/VS2008/zstdlib/zstdlib.vcproj
# projects/cmake/lib/CMakeLists.txt
# projects/cmake/programs/CMakeLists.txt
2016-06-01 00:07:09 +02:00
Yann Collet
f2a3b6e7b4
added : frame content checksum
2016-05-31 22:23:45 +02:00
inikep
43aa9fe8b3
fixed skippable frame
2016-05-31 19:36:51 +02:00
inikep
f772bf54a5
support for skippable frames
2016-05-31 12:43:46 +02:00
Giuseppe Ottaviano
370b751e24
Expose function to add entropy tables to pre-built dictionary.
...
In some cases a custom dictionary building algorithm tailored for a specific
input can be more effective than the one produced by `ZDICT_trainFromBuffer`,
but with the current API it's not possible encode the entropy tables into the
custom-built dictionary.
This commit extracts the logic to add entropy tables to a dictionary from
`ZDICT_trainFromBuffer` and exposes it as a function
`ZDICT_addEntropyTablesFromBuffer`.
2016-05-30 19:50:09 -07:00
Yann Collet
290aaa7521
Added : ability to manually select the dictionary ID of a newly created dictionary
2016-05-30 21:18:52 +02:00
Yann Collet
30009521d7
fuzzer tests dictBuilder.
...
Added : ability to not store dictID during compression; decompression doesn't check dictID then
2016-05-30 16:17:33 +02:00
Yann Collet
c0a9bf3c2e
minor code refactoring
2016-05-30 04:48:32 +02:00
Yann Collet
c46fb924df
added dictionary ID (incomplete)
2016-05-29 05:01:04 +02:00
Yann Collet
f51e0660f4
Simplified list of `*.c` files
2016-05-29 01:39:19 +02:00
Yann Collet
0c5e8b17ad
moved xxhash to lib/common
2016-05-29 01:06:30 +02:00
inikep
957823f56f
zstdcli: -r (operate recursively on directories) works with dictBuilder and compression
2016-05-25 15:30:55 +02:00
inikep
e75909ef93
ZBUFF_createCCtx_advanced moved to zbuff_static.h
2016-05-25 11:31:16 +02:00
inikep
02c244bf78
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-05-24 17:15:04 +02:00
inikep
fb5df613cf
zstd_stats.h included only in debug mode
2016-05-24 15:36:37 +02:00
inikep
71dd67cf57
fullbench: tests for ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced
2016-05-24 10:57:14 +02:00
inikep
13ba880b49
added ZBUFF_createCCtx_advanced and ZBUFF_createDCtx_advanced
2016-05-23 17:04:23 +02:00
inikep
107e243195
added ZSTD_createDCtx_advanced
2016-05-23 16:24:52 +02:00
inikep
50e82c015d
added ZSTD_createCCtx_advanced
2016-05-23 15:49:09 +02:00
inikep
35b891c5b0
zstd_stats.h updated to v0.6
2016-05-20 19:42:20 +02:00
Yann Collet
f22a0d653d
huff0 dynamic reduction
2016-05-20 14:36:36 +02:00
Yann Collet
45f84ab7cc
all programs use `ZSTD_VERSION_STRING` from `zstd.h` to display their version
2016-05-20 12:34:40 +02:00
Yann Collet
de4d4da52d
changed version to 0.6.2
...
removed make-controlled version (now used from zstd.h)
removed std=c99 by default
added : c90/gno90/c99/gnu99/c11 tests
2016-05-20 12:20:12 +02:00
Yann Collet
7591a7f224
minor refactoring
2016-05-20 11:44:43 +02:00
Yann Collet
236d94fa9a
reverted default compression level to 1
2016-05-18 12:06:33 +02:00
Yann Collet
78aa05228a
fixed Visual warning in debug mode
2016-05-17 14:30:19 +02:00
Yann Collet
c8e9c4046f
Merge branch 'dev' of github.com:Cyan4973/zstd into dev
2016-05-17 12:02:35 +02:00
Yann Collet
ea4daa308d
added `ZSTDv05_getFrameParams()` to "zstd_v05.h"
2016-05-17 12:01:55 +02:00
klemens
268775dae8
spelling-fixes, as of lintian.debian.org
2016-05-16 22:23:24 +02:00
Yann Collet
d9b3cca4d3
restore openVMS support (detected by @thatsafunnyname)
2016-05-13 12:43:36 +02:00
inikep
63ecd747de
added common/entropy_common.c
2016-05-13 11:27:56 +02:00
Yann Collet
ccd6e86d45
improved decoding speed by inlining x_isError() functions
2016-05-12 15:55:26 +02:00
Yann Collet
16871680e3
minor refactor : more accurate variable scope
2016-05-12 14:27:00 +02:00
Yann Collet
b19d5d76ec
restored inline for better decompression speed
2016-05-12 14:06:31 +02:00
Yann Collet
1ceb5a9295
restored DStream init
...
due to strange speed regressions and warnins on gcc 5.3
2016-05-12 13:50:13 +02:00
Yann Collet
ce27e85209
fixed clang conversion warning
2016-05-11 18:55:27 +02:00
Yann Collet
1032fbe714
update FSE library
2016-05-11 18:30:24 +02:00
Yann Collet
249ae0ca99
better big-endian / little-endian r/w support
2016-05-11 16:38:18 +02:00
Yann Collet
3329d98df9
fixed minor asan warning in legacy decoder
2016-05-11 11:07:54 +02:00
Yann Collet
c75e4c25e8
Added : ZSTD_getErrorString(), to get error string from error enum ( #168 )
2016-05-10 17:47:11 +02:00
Yann Collet
b3a9938d0c
Merge pull request #182 from inikep/dev
...
support for Visual Studio 2012, 2013, 2015
2016-05-10 17:18:12 +02:00
Yann Collet
bd39d54576
zbuff supports byte-by-byte decompression scenarios
2016-05-10 14:14:19 +02:00
inikep
ed9a08538c
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
...
# Conflicts:
# lib/common/util.h
# programs/paramgrill.c
# visual/2013/fullbench/fullbench.vcxproj.filters
# visual/2013/fuzzer/fuzzer.vcxproj.filters
2016-05-10 13:20:01 +02:00
Yann Collet
918b934a26
minor comment update
2016-05-10 07:00:07 +02:00
inikep
349fcf7ea2
fixed Linux compilation
2016-05-09 18:04:07 +02:00
inikep
aaaf923a17
common/util.h moved to programs/util.h
...
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
inikep
d44ec48b1c
detection of snprintf for Visual <= 2012
2016-05-09 14:37:41 +02:00
Yann Collet
59b6ba7677
Merge pull request #180 from thatsafunnyname/patch-1
...
No stdint.h on OpenVMS.
2016-05-09 11:56:42 +02:00
Yann Collet
4ff73a2eff
added : midipix support ( #181 )
2016-05-09 11:44:00 +02:00
Yann Collet
d275236e6a
Fixed Windows API, as detected by @KrzysFR ( #171 )
2016-05-09 08:19:27 +02:00
Yann Collet
f6ca09b5ff
Reduced console display on loading lots of files with `zstd --train`. Reported by @KrzysFR, see #177
2016-05-09 04:44:45 +02:00
Yann Collet
e1a69a88c0
Expose Advanced Streaming API for v0.5.x legacy
2016-05-08 09:13:40 +02:00
Yann Collet
a5dacdf551
updated fse (minor refactor)
2016-05-06 16:55:27 +02:00
Yann Collet
18dedece91
Support legacy ZSTD_decompress_usingDict() (starting v0.5+)
2016-05-06 16:43:23 +02:00
Yann Collet
8283a2f0aa
Fixed decoding corruption error with quad-symbols huffman on legacy decoders
2016-05-06 01:51:31 +02:00
inikep
13c8424ea0
code cleaning
2016-05-05 13:58:56 +02:00
inikep
0bd0faec32
fixed compatibility issues
2016-05-05 13:10:57 +02:00
Yann Collet
6d1d25299a
fixed Huff0 quad-symbols decoder ( #173 )
2016-05-05 12:41:36 +02:00
inikep
9c22e57bfb
Compiler Options moved to util.h
2016-05-05 11:53:42 +02:00
Yann Collet
ddb8ebd5b3
Stricter gnu90 tests
2016-05-05 04:59:53 +02:00
Yann Collet
3f8ed50bf1
Added gnu90 test
...
work-around : disabled automatic selection of huff0 quad-decoder (see #173 )
2016-05-05 03:01:13 +02:00
inikep
3163403855
UTIL_prepareFileList
2016-05-05 00:25:38 +02:00
thatsafunnyname
b0e5427d1a
No stdint.h on OpenVMS.
...
No stdint.h on OpenVMS, it is inttypes.h instead, some projects use HAVE_STDINT_H.
2016-05-04 15:43:42 +01:00
Yann Collet
6f9c056662
Fixed BMI behavior on x86 and x32 targets, reported by @tycho ( #178 )
2016-05-01 10:26:30 +02:00
inikep
55d047aa92
getTotalFileSize moved to common/util.h
2016-04-28 16:50:13 +02:00
inikep
d5ff2c3d9a
ordering of #include
2016-04-28 14:40:45 +02:00
inikep
83c76b4594
bench.c: time functions moved to common/util.h
2016-04-28 13:16:01 +02:00
inikep
69fcd7c0ae
getFileSize moved to common/util.h
2016-04-28 12:23:33 +02:00
inikep
1007a1fe3d
get rid of some Visual C++ warnings
2016-04-25 15:23:09 +02:00
inikep
6cb083fe3d
fixed 64-bit compilation with Visual C++
2016-04-25 14:42:15 +02:00
inikep
ea4ee3eee0
added compatibility with Visual C++ 2012
2016-04-25 13:09:06 +02:00
inikep
a8138fd767
updated lib/README.md part 2
2016-04-25 11:36:44 +02:00
inikep
49794316c2
updated lib/README.md
2016-04-25 11:31:28 +02:00
inikep
f066816998
fix for g++ compilation
2016-04-22 18:54:05 +02:00
inikep
db3964382c
introduced ZSTD_NODECOMPRESS to link only compressor
2016-04-22 18:22:30 +02:00
inikep
a1febea01d
Error functions moved to common/zstd_common.c
2016-04-22 17:14:25 +02:00
inikep
3c7c3527d0
introduced ZSTD_NOCOMPRESS to generate decompressor only
2016-04-22 13:59:05 +02:00
inikep
23a0889301
separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/
2016-04-22 12:43:18 +02:00
inikep
4699b3be03
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-21 12:30:58 +02:00
inikep
38654988f3
minor speed improvements 2
...
bench.c: block size has to be bigger than 32 bytes
zstdcli.c: support for e.g. -B16k -B16m
2016-04-21 12:18:47 +02:00
inikep
ef51941822
zst_opt.h: minor compression speed improvement
2016-04-21 11:08:43 +02:00
Yann Collet
e02808ffc5
bumped lib version to 0.6.1
...
added ZSTD_VERSION_STRING
2016-04-20 22:46:16 +02:00
inikep
c5e1d295ee
bench.c: force at least one compression and decompression loop
...
fix for -i0 with small files
2016-04-19 09:37:59 +02:00
inikep
2c5eeea635
introduced ZSTD_DEAFULT_CLEVEL for (compressionLevel<=0)
2016-04-15 13:44:46 +02:00
inikep
4b3c5eed99
removed ZSTD_compressBegin_targetSrcSize
2016-04-14 13:43:51 +02:00
inikep
c70c90e8a3
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-13 10:48:26 +02:00
Yann Collet
16748729c9
Updated DICT_MAGIC, since internal dictionary format has changed (length encoding)
2016-04-12 23:26:23 +02:00
Yann Collet
c5b6d9741a
Added : zbuff.c to library; reported by Yipei Zhang
2016-04-12 21:46:18 +02:00
Yann Collet
389648cc6d
Fixed : contentSize + copyCCtx()
2016-04-12 19:13:08 +02:00
Yann Collet
541dc7c7d4
Added : fuzzer test, checking contentLength value after copyCCtx() usage
2016-04-12 18:00:20 +02:00
Yann Collet
6236eba991
removed headerBuffer
2016-04-12 15:52:33 +02:00
Yann Collet
0085cd3138
created ZSTD_writeFrameHeader()
2016-04-12 14:14:10 +02:00
Yann Collet
abb5c653f1
minor speed improvement for ZSTD_copyCCtx()
2016-04-11 20:42:31 +02:00
Yann Collet
887e7da785
Fixed copyCCtx() on uninitialized cctx (reported by Oliver Lange)
2016-04-11 20:12:27 +02:00
inikep
8844e21dff
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
2016-04-11 16:49:27 +02:00
inikep
f7d210b2e9
cache literal prices for ZSTD_btopt
2016-04-11 16:35:13 +02:00
Yann Collet
582933fde5
fixed round-trip corruption, reported by Oliver Lange
2016-04-11 16:25:56 +02:00
Yann Collet
125d81774f
fixed uninitialization error, reported by Maciej Adamczyk
2016-04-11 14:22:56 +02:00
Yann Collet
d673d4cf66
fixed uninitialization error, reported by Maciej Adamczyk
2016-04-11 14:10:23 +02:00
Yann Collet
ccbba296e1
Fix infinite loop with invalid data (fuzzer test)
2016-04-10 14:42:26 +02:00
Yann Collet
793c649ead
updated cLevels
2016-04-09 20:32:00 +02:00
Yann Collet
b144bc3e1c
Fixed uninitialized warning, reported by Maciej Adamczyk
2016-04-09 17:26:22 +02:00
Yann Collet
9990986bdc
fixed minor warnings when compiling with `gcc -g` (aka `-std=gnu90`)
2016-04-09 16:17:18 +02:00
Yann Collet
029267ab3f
Integrated Legacy v0.5.x decoder (provided by @inikep)
2016-04-09 09:42:27 +02:00
Yann Collet
7eff39f7ea
fixed decoding error
2016-04-09 01:51:36 +02:00
Yann Collet
ea63bb7b5e
converted fuzzer timer to clock_t
2016-04-08 15:25:32 +02:00
Yann Collet
78267d1abe
updated cLevel for block <= 256K
2016-04-08 12:36:19 +02:00
Yann Collet
72cc704514
Merge branch 'dev060' of github.com:Cyan4973/zstd into dev060
2016-04-08 02:02:31 +02:00
Yann Collet
0dbf2874ee
faster level 1 at 256 KB
2016-04-08 02:02:12 +02:00
Yann Collet
04a4fd638b
Merge pull request #164 from inikep/dev
...
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 20:46:13 +02:00
inikep
afe1f7994b
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
2016-04-07 19:50:03 +02:00
Yann Collet
9e8b09a7bd
Fixed memory initialization issue, reported by Maciej Adamczyk
2016-04-07 19:35:23 +02:00
inikep
2bf79f9bff
use extDict only when needed
2016-04-07 19:24:33 +02:00
inikep
64d7bcb0dc
only repcode 0 for lazy, lazy2 and btlazy2 strategies
2016-04-07 19:14:09 +02:00
inikep
a69640cca1
Revert "removed void ZSTD_compressBlock_greedy"
...
This reverts commit 9296400a69
.
2016-04-07 18:22:29 +02:00
Yann Collet
d7bee33caf
Fixed make install (reported by Oliver Lange)
2016-04-07 18:16:42 +02:00
Yann Collet
5d39357bc4
minor compression speed optimization
2016-04-07 17:19:00 +02:00
inikep
9296400a69
removed void ZSTD_compressBlock_greedy
2016-04-07 16:58:04 +02:00
Yann Collet
485371600a
Implemented default coding table for lengths and offset
2016-04-07 15:24:29 +02:00
Yann Collet
79459da14b
Merge pull request #163 from inikep/dev
...
3 repcodes and MINMATCH=3
2016-04-07 14:37:30 +02:00
inikep
81a345b0ce
minor speed improvements
2016-04-07 11:35:17 +02:00
inikep
e47f33f980
reordered code
2016-04-06 20:58:00 +02:00
inikep
2db1eb78e9
reordered functions
2016-04-06 17:14:19 +02:00
inikep
e5b6e9e551
fixed support for searchLength=4
2016-04-06 13:15:38 +02:00
inikep
75716851d4
MINMATCH=3 for lazy strategy
2016-04-06 12:34:42 +02:00
inikep
7bc19b6b3e
MINMATCH=3
2016-04-06 09:46:01 +02:00
inikep
f8a339d274
working ZSTD_compressBlock_opt_extDict_generic
2016-04-05 23:58:51 +02:00
inikep
83417bbbd2
code formatting
2016-04-05 21:30:03 +02:00
inikep
5ce00aee37
ZSTD_compressBlock_opt_extDict_generic in progress
2016-04-05 21:03:43 +02:00
inikep
faa8d8aae1
introduced ZSTD_compressBlock_greedy
2016-04-05 19:01:10 +02:00
inikep
908fcb384a
3 repcodes with ZSTD_compressBlock_lazy_extDict_generic
2016-04-05 18:16:38 +02:00
inikep
a4385aa23b
ZSTD_REP_NUM=3 only
2016-04-05 17:11:56 +02:00
inikep
d5359b2e55
Merge remote-tracking branch 'refs/remotes/origin/repcodes' into dev
2016-04-05 17:07:36 +02:00
inikep
ba73d1bb6b
support for ZSTD_REP_NUM=3
2016-04-05 10:30:05 +02:00
inikep
74e3a7ba4c
removed kSlotNew
2016-04-05 10:18:37 +02:00
inikep
b3532793a9
experiments with ZSTD_decodeSequence
2016-04-05 10:08:25 +02:00
Yann Collet
46bdb6267e
Merge pull request #161 from inikep/dev
...
Dev
2016-04-05 09:59:59 +02:00
inikep
2ec2698ef9
working 4 reps
2016-04-05 09:34:13 +02:00
inikep
19140cd80e
zstd_stats.h moved to .debug/
2016-04-05 08:52:57 +02:00
inikep
d6f208badf
improved logging
2016-04-04 21:15:23 +02:00
inikep
78e52044de
Merge remote-tracking branch 'refs/remotes/origin/dev' into repcodes
...
# Conflicts:
# lib/zstd_compress.c
# lib/zstd_decompress.c
# lib/zstd_internal.h
# lib/zstd_opt.h
# programs/bench.c
2016-04-04 16:28:40 +02:00
inikep
cb70c8ab90
fixed -Werror,-Wconversion warning
2016-04-04 15:43:45 +02:00
inikep
0c7456c5b7
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
# lib/zstd_static.h
2016-04-04 14:54:53 +02:00
Yann Collet
b59bf963a8
fixed Visual conversion warnings
2016-04-04 14:53:16 +02:00
inikep
227dd4bc74
changed price estimation for optimal parser
2016-04-04 14:34:02 +02:00
Yann Collet
8a57b928ba
changed `contentLog` -> `chainLog`
2016-04-04 13:49:18 +02:00
Yann Collet
1005fc1276
reduced memory usage of very hich compression levels in 32-bits mode
2016-04-04 13:28:28 +02:00
inikep
19bd48f516
Merge from Cyan4973/dev060
2016-04-04 12:10:00 +02:00
Yann Collet
1535414927
Fixed 32-bits windowLog limitation
...
Fixed some macro errors in zbufftest
2016-04-04 04:22:53 +02:00
Yann Collet
5a88a70f97
fixed buffer sync error in zbuff
2016-04-03 20:24:25 +02:00
Yann Collet
ef36390e4a
refined exception for hashlog < min
2016-04-02 00:46:40 +02:00
Yann Collet
40358d01aa
Fix : rare bugs when hashLog < min in bt mode
2016-04-02 00:40:09 +02:00
Yann Collet
1d803d8deb
fixed zbuff error 775-3 (internal buffer management)
2016-04-01 18:57:41 +02:00
Yann Collet
efb18309ef
fixed minor visual 32-64bits conversion warning
2016-04-01 18:54:13 +02:00
Yann Collet
afa60e0f14
fixed decoding error, reported by Maciej Adamczyk
2016-04-01 15:49:41 +02:00
Yann Collet
27caf2afca
minor variable isolation
2016-04-01 15:48:48 +02:00
Yann Collet
9bb87e5995
fixed harmless comparison warning
2016-03-30 21:28:15 +02:00
Yann Collet
51d500425f
fixed paramgrill
2016-03-30 20:42:19 +02:00
Yann Collet
dd6466a211
fixed clang conversion warning
2016-03-30 20:06:26 +02:00
Yann Collet
3b71925c2d
separate params into compressionParams and frameParams
2016-03-30 19:48:05 +02:00
Yann Collet
21588e370b
changed validateParams() into checkParams() + adjustParams()
2016-03-30 16:50:44 +02:00
Yann Collet
b44be74244
Fixed zdict
...
more dictionary compression tests
2016-03-26 20:52:14 +01:00
Yann Collet
74bd11954b
fixed ARM compatibility
2016-03-26 17:50:26 +01:00
Yann Collet
b9151406de
fixed 32-bits compatibility
2016-03-26 17:18:11 +01:00
inikep
97c88e716c
fix for -Wshorten-64-to-32 warning in ZSTD_statsUpdatePrices
2016-03-25 13:39:14 +01:00
Yann Collet
433a5cce7e
improved decompression speed (680)
2016-03-25 11:43:48 +01:00
inikep
5cc4efdaf8
created zstd_stats.h
2016-03-25 10:52:25 +01:00
Yann Collet
646693e3be
support for alternate offset (fusion)
2016-03-24 02:42:15 +01:00
Yann Collet
b21ce15efe
minor variables isolation
2016-03-24 02:02:32 +01:00
Yann Collet
7cbe79ab25
fixed write overflow found by fuzzer
2016-03-23 22:31:57 +01:00
Yann Collet
72d706a020
fixed crash at -O3 with customized block size (wrong alignment)
2016-03-23 20:44:12 +01:00
inikep
eaba91a161
added ZSTD_compressBegin_targetSrcSize
2016-03-23 20:30:26 +01:00
Yann Collet
862a85976f
Added BMI instructions
2016-03-23 18:45:23 +01:00
inikep
7adceef974
hashLog3 added to ZSTD_CCtx
2016-03-23 15:53:38 +01:00
Yann Collet
6cf45dac81
shared const BIT_mask
2016-03-23 14:41:54 +01:00
Yann Collet
3c017867de
minor optimization (DSpeed 665)
2016-03-23 14:09:51 +01:00
Yann Collet
2512597576
minor reordering (DSpeed 665)
2016-03-23 14:00:09 +01:00
Yann Collet
afab02098a
improved decoding speed (660)
2016-03-23 13:57:49 +01:00
inikep
472638c861
added mili_sleep and setHighPriority
2016-03-23 12:28:28 +01:00
Yann Collet
9c34df93b6
new decodeSequence, merging parts
2016-03-23 01:54:25 +01:00
Yann Collet
add08d6f61
minor variation - DSpeed at 640
2016-03-23 01:32:41 +01:00
Yann Collet
be391438ff
first working version with both encoder and decode alternate LL + ML coding scheme.
...
decompression speed highly impacted
2016-03-22 23:19:28 +01:00
inikep
2872b6f01f
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
# programs/bench.c
2016-03-22 14:38:34 +01:00
Yann Collet
fadda6c875
first prototype with ML encoding scheme (but not yet decoding scheme)
2016-03-22 12:14:26 +01:00
inikep
2b942881ac
improved 4reps in ZSTD_compressBlock_lazy_generic
...
kSlotNew = 0
2016-03-22 11:56:22 +01:00
Yann Collet
1dcf930f72
Merge branch 'dev060' into alternateLLcode
2016-03-22 00:29:57 +01:00
inikep
f2fa0e1198
final repcodes for ZSTD_btopt
2016-03-21 20:14:03 +01:00
inikep
378be62a9e
better repcodes
2016-03-21 19:48:54 +01:00
inikep
fc1d7bd93b
changed update logic of repcodes
2016-03-21 19:02:16 +01:00
inikep
e7ec8f2b9b
improved ratio
2016-03-21 17:23:02 +01:00
Yann Collet
be4605d851
improved decompression speed
2016-03-21 14:29:26 +01:00
Yann Collet
e91477c171
minor variable isolation
2016-03-21 14:22:38 +01:00
Yann Collet
b0aec17a90
code simplification (but reduce decompression speed ...)
2016-03-21 13:24:16 +01:00
Yann Collet
6c62b7dfc8
support default LL distribution
2016-03-21 00:39:19 +01:00
Yann Collet
d64f435f63
handles litLength >= 65535
2016-03-21 00:07:42 +01:00
Yann Collet
597847a2ae
first emulation
2016-03-20 19:14:22 +01:00
Yann Collet
ecabfe3777
Improved index overflow protection
2016-03-20 16:20:06 +01:00
Yann Collet
5244738046
minor code refactoring
2016-03-20 16:00:00 +01:00
Yann Collet
de406eebcd
minor code refactor
2016-03-20 15:46:10 +01:00
Yann Collet
516ba88022
updated huff0
2016-03-20 05:40:39 +01:00
Yann Collet
a5c2c08c68
code refactoring
2016-03-20 01:09:18 +01:00
Yann Collet
70e4577179
minor code refactoring
2016-03-19 18:08:32 +01:00
Yann Collet
c6eea2b2f2
Improved speed for small files
2016-03-19 17:18:00 +01:00
Yann Collet
e74215e3c7
performance fix for small files
2016-03-19 16:09:09 +01:00
inikep
1269e2f7db
working kSlotNew for ZSTD_btopt
2016-03-19 15:32:21 +01:00
Yann Collet
bb604486f1
fixed clang warning
2016-03-19 15:18:42 +01:00
Yann Collet
37f3d1b2ab
minor refactor
2016-03-19 15:11:42 +01:00
Yann Collet
90a03a95a1
minor performance fix (decompression)
2016-03-19 14:47:31 +01:00
Yann Collet
01e5b95199
code refactor
2016-03-19 14:14:31 +01:00
Yann Collet
d1d210f3fb
minor code refactor
2016-03-19 12:12:07 +01:00
Yann Collet
4db09efde4
simplifications
2016-03-18 22:23:49 +01:00
Yann Collet
39c596ca58
minor simplifications
2016-03-18 21:40:56 +01:00
inikep
fade9b7ae3
ZSTD_btopt with 4 repcodes
2016-03-18 16:10:35 +01:00
inikep
1c1e6916e4
improved timer accuracy
2016-03-18 12:49:44 +01:00
Yann Collet
a910dc8238
minor code refactoring
2016-03-18 12:37:45 +01:00
inikep
5b15865413
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into repcodes
...
# Conflicts:
# lib/zstd_decompress.c
# programs/bench.c
2016-03-18 11:14:58 +01:00
inikep
eca2ec0b3b
introduced ZSTD_REP_MOVE and ZSTD_REP_INIT
2016-03-18 11:03:43 +01:00
inikep
c56e32e782
4 repcodes when litLen==0
2016-03-17 19:53:38 +01:00
inikep
3e743052cd
kSlotNew
2016-03-17 17:24:17 +01:00
Yann Collet
3fd164e656
minor refactoring
2016-03-17 13:43:32 +01:00
Yann Collet
b40287aaef
Improved decompression speed (by @inikep)
2016-03-17 12:11:16 +01:00
inikep
7d1742825b
support for ZSTD_REP_NUM == 1 and ZSTD_REP_NUM == 4
2016-03-17 11:21:00 +01:00
inikep
5945308983
working 4 reps
2016-03-16 15:35:14 +01:00
Yann Collet
569b81adb1
changed `BLOCKSIZE` into `ZSTD_BLOCKSIZE_MAX`
2016-03-16 15:26:51 +01:00
inikep
62d694795d
ZSTD_compressBlock_lazy supports more reps
2016-03-16 12:57:07 +01:00
inikep
0ac4a551b9
ZSTD_REP_NUM removed from ZSTD_storeSeq
2016-03-16 12:03:07 +01:00
inikep
df164e6d35
introduced U32 rep[ZSTD_REP_NUM]
2016-03-16 11:56:59 +01:00
inikep
4569667c85
ZSTD_REP_NUM
2016-03-16 11:40:09 +01:00
Yann Collet
6cb41356e8
update doc / comments
2016-03-15 15:47:38 +01:00
Yann Collet
346bffbc68
Added frame content size test within fuzzer
2016-03-15 15:24:52 +01:00
Yann Collet
09b21ee2f6
fix fileio bug with new zbuff
...
simplified zbuff decoding
2016-03-15 12:56:03 +01:00
inikep
d700a1a8b9
ZSTD_setAdditionalParam
2016-03-15 12:18:44 +01:00
Yann Collet
1c2c2bcaff
minor refactoring
2016-03-15 01:33:36 +01:00
Yann Collet
d1b26849e5
Frame content size supported
2016-03-15 01:24:33 +01:00
inikep
5fdd0b46d3
added additionalParam
2016-03-14 19:51:11 +01:00
Yann Collet
fb7973580f
minor comments update
2016-03-13 11:08:40 +01:00
Yann Collet
03ea59b17b
Decompression can decode frame content size
2016-03-12 01:25:40 +01:00
Yann Collet
0e491c01fe
created ZSTD_frameParams
2016-03-11 21:58:04 +01:00
inikep
cc6c283633
removed hashLog3 from ZSTD_parameters
2016-03-10 15:17:24 +01:00
inikep
260a9e3886
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
2016-03-10 15:04:12 +01:00
inikep
b0c640d934
small ratio improvement with MINMATCH=3
2016-03-10 13:18:36 +01:00
Yann Collet
da5be72fda
update compression level parameters
2016-03-10 11:01:44 +01:00
Yann Collet
dcc000f0eb
minor doc clarifications
2016-03-10 01:09:41 +01:00
Yann Collet
e3193c4081
update compresson levels
2016-03-09 16:57:09 +01:00
Yann Collet
4f013a2281
Merge pull request #142 from inikep/dev
...
Dev
2016-03-09 16:29:42 +01:00
inikep
b5a519f43c
improved compression speed
...
introduced cache in ZSTD_setLog2Prices
2016-03-09 15:45:01 +01:00
Yann Collet
95cd0c2e26
frame format can support window sizes up to 128 MB
2016-03-08 18:24:21 +01:00
Yann Collet
ff14b351f5
Merge pull request #141 from inikep/dev
...
fix update for zstd_opt
2016-03-08 14:41:04 +01:00
Yann Collet
d3a6660ad1
Update clevel table for <= 128K
2016-03-08 14:12:46 +01:00
Yann Collet
2e91dde43e
improved memory size evaluation by paramgrill
2016-03-08 12:22:11 +01:00
inikep
48413765b4
fixed update of hashTable for matches with length of 4+
2016-03-08 11:03:55 +01:00
Yann Collet
dd54bbc184
Fixed large NbSeq > 32 K
...
Added a test in Fuzzer to check NbSeq > 32 K
2016-03-08 02:35:34 +01:00
Yann Collet
370b08e840
fix compression ratio for blocks <= 16 KB
2016-03-08 00:03:59 +01:00
Yann Collet
fb7ab8b2b8
Merge pull request #140 from inikep/dev
...
mml3
2016-03-07 18:06:48 +01:00
inikep
4f7f79ef9d
fixed update of nextToUpdate
2016-03-07 16:14:58 +01:00
inikep
e2446b0e36
added support for MINMATCH=3 on big endian architecture
...
changed ZSTD_HASHLOG3_MIN to 2 (4 bytes for MINMACH > 3)
2016-03-07 10:07:08 +01:00
inikep
89c9e1a847
added missing "case 3:" in ZSTD_BtGetAllMatches
2016-03-06 23:21:52 +01:00
Yann Collet
1df2594bfe
new compression level scale for <= 16KB
2016-03-05 18:43:21 +01:00
inikep
01060bc477
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev
...
# Conflicts:
# lib/zstd_compress.c
2016-03-04 20:10:09 +01:00
inikep
f3c6503e55
resolve conflict in zstd_internal.h
2016-03-04 20:04:25 +01:00
inikep
e29caf7d1c
code cleanup
2016-03-04 19:52:23 +01:00
inikep
805d2a7465
removed zstd_opt_internal.h
2016-03-04 19:31:57 +01:00
Yann Collet
944d0d2285
updated fse version
2016-03-04 19:26:59 +01:00
inikep
4ab9c913a5
MEM_readMINMATCH replaced with inline function
2016-03-04 19:17:31 +01:00
Yann Collet
4c01580362
finer searchLength validation
2016-03-04 17:07:54 +01:00
Yann Collet
d409db68d3
Support for nbSeq > 32767
...
tamed -Wstrict-aliasing warning
2016-03-04 14:45:31 +01:00
Yann Collet
1435335342
Merge pull request #138 from inikep/dev
...
reduce stack usage with optimal parsing mode
2016-03-03 02:08:34 +01:00
inikep
5cccd77c55
fix clang -Wcast-align warning (part 2)
2016-03-02 20:37:49 +01:00
inikep
51bb9a0064
fix clang -Wcast-align warning
2016-03-02 19:17:13 +01:00
inikep
87d4f3daa4
priceTable moved to heap
2016-03-02 15:56:24 +01:00
inikep
338533f741
improved price function initialization
2016-03-02 14:36:41 +01:00
Yann Collet
a997654670
Merge pull request #136 from inikep/dev
...
merging mml3 mode
2016-03-01 17:31:03 +01:00
inikep
a4dde25498
fixed repcode before lowLimit
2016-03-01 14:14:35 +01:00
inikep
2d55563b92
better logs
2016-02-29 22:07:40 +01:00
inikep
f647d99d61
fixed bug with 3 or more succesive rep codes
2016-02-29 12:33:08 +01:00
inikep
f414647c6b
fixed ZSTD_copyCCtx
2016-02-25 22:31:07 +01:00
inikep
59493e8669
fixed paramgrill
2016-02-25 19:15:08 +01:00
inikep
afa9c9f5ab
turn off RTF optimization
2016-02-25 16:47:57 +01:00
Yann Collet
ee0229287c
changed version to v0.6.0
2016-02-25 14:53:35 +01:00
inikep
02137f8c42
more accurate gain function
2016-02-24 18:09:36 +01:00
inikep
ee55628c9d
combined price function
2016-02-24 14:40:30 +01:00
Yann Collet
3152a8c87a
finer dictionary completion
2016-02-23 21:28:59 +01:00
inikep
4a981f7937
improved ZSTD_GETPRICE
2016-02-23 19:08:20 +01:00
inikep
e0010e9baf
priceFunc
2016-02-23 16:25:04 +01:00
inikep
15174b0cfb
statistics of encoded sequences
2016-02-23 12:41:56 +01:00
inikep
9f754d23dc
dummy levels 22-25
2016-02-22 17:00:04 +01:00
inikep
6b3739c8e5
MINMATCH=3 or 4 selected in ZSTD frame
2016-02-22 15:53:42 +01:00
inikep
84f43e2359
support for searchLength from 3 to 7 for optimal parser
2016-02-22 11:34:07 +01:00
inikep
c950b78ce2
removed backward match extension
2016-02-22 10:11:39 +01:00
inikep
d3b8d7a4e5
removed ZSTD_opt parser
2016-02-22 10:06:17 +01:00
inikep
6291c54006
litlen bounded to 128 bytes
2016-02-19 18:24:14 +01:00
Yann Collet
f8482131d7
better compatibility with Visual <= 2012
2016-02-19 17:33:43 +01:00
Yann Collet
191b52a8dc
silence array subscript warning
2016-02-19 15:16:15 +01:00
inikep
fcafb26b2e
speed optimiaztions
2016-02-19 11:59:44 +01:00
inikep
c3a9a9ca56
ZSTD_rescaleFreqs and removed minml
2016-02-19 11:05:25 +01:00
inikep
cc52a97214
added hashLog3
2016-02-19 10:09:35 +01:00
Yann Collet
4c64d51425
modified level 18
2016-02-18 01:01:42 +01:00
Yann Collet
d56a4192f6
Added : README within /lib directory, to help file selection
2016-02-17 17:47:29 +01:00
Yann Collet
6062b15a07
performance fix for hash chain mode
2016-02-16 17:41:03 +01:00
Yann Collet
accfd80c37
Added : option `-t` to test compressed files integrity
2016-02-15 19:33:16 +01:00
Yann Collet
0068be94d8
Faster literals cost evaluation (suggested by @inikep)
2016-02-15 18:42:13 +01:00
Yann Collet
e93add0439
Removed `if (matchIndex >= current) return 0;` as recommended by @inikep
2016-02-15 17:44:14 +01:00
Yann Collet
b8a6f6824b
refactored fix to be more generic and applicable to both btlazy2 and btopt
2016-02-15 17:06:29 +01:00
Yann Collet
b37e0a9241
performance tweak : bt search w/ long repeated segments
2016-02-15 14:07:07 +01:00
Yann Collet
cefef8cde7
Change : zstd_opt_bt => zstd_btopt
2016-02-15 07:21:54 +01:00
Yann Collet
0d78a33374
updated CLevel confs for 256K
2016-02-15 06:49:09 +01:00
Yann Collet
422fd563f3
modified : compression Levels for blocks <= 16KB
2016-02-13 15:07:24 +01:00
Yann Collet
38fba56483
Changed compression level settings
2016-02-13 11:20:23 +01:00
Yann Collet
e8bd73df80
Fixed : error when compressing one file
2016-02-13 03:09:48 +01:00
Yann Collet
23e8aee224
Introduced new compression level settings
...
Changed position of parameter TargetLength
2016-02-13 02:08:46 +01:00
Yann Collet
82f4d7da03
Fixed Visual solution
2016-02-12 22:04:49 +01:00
Yann Collet
6f3acbac0d
notificationLevel into ZDICT_param_t
2016-02-12 20:19:48 +01:00
Yann Collet
09ab681328
fixed libzstd install
2016-02-12 19:00:30 +01:00
Yann Collet
62ae5fb0d2
zstd_buffered => zbuff
2016-02-12 18:59:11 +01:00
Yann Collet
f4c9d75370
dictBuilder => zdict
2016-02-12 18:45:02 +01:00
Yann Collet
f062436fa6
cli : added ability to compress multiple files into stdout (-c)
2016-02-12 15:56:46 +01:00
Yann Collet
71eafdd23f
Integrated dictionary builder into zstd cli
2016-02-12 02:31:57 +01:00
Yann Collet
fb92a78ac1
Fixed clang warnings
2016-02-12 00:32:38 +01:00
Yann Collet
7d36028078
Integrate dictBuilder into libzstd
2016-02-12 00:10:25 +01:00
Yann Collet
82260ddd8a
fixed asan read error in ZSTD_HcGetAllMatches
2016-02-11 07:14:25 +01:00
Yann Collet
04b12d8bcb
paramgrill can select manually targetLength
...
new compression levels
2016-02-11 06:23:24 +01:00
Yann Collet
bd828d9cd1
changed : sufficientLength => targetLength
2016-02-11 04:38:55 +01:00
Yann Collet
4488661678
minor cosmetics
2016-02-11 04:17:50 +01:00
Yann Collet
490aa68b18
restored fast zstd_opt variant
2016-02-10 17:18:24 +01:00
Yann Collet
b79a0b34f3
paramgrill supports sufficientLength
...
stronger variation for ZSTD_opt
2016-02-10 17:07:37 +01:00
Yann Collet
62ae262771
restored currentMl>0 condition, as suggested by @inikep
2016-02-10 15:44:07 +01:00
Yann Collet
3b63f7fbb0
change zstd_opt.c into zstd_opt.h, since it's included
2016-02-10 15:05:12 +01:00
Yann Collet
0db4115f35
fixed debug print macros on Windows
2016-02-10 14:50:22 +01:00
Yann Collet
2f94d2f166
minor refactor
2016-02-10 14:26:30 +01:00
Yann Collet
768c6bc705
fix : inlining difficulties with gcc 4.6 (travis)
2016-02-10 14:01:49 +01:00
Yann Collet
70e8c389f1
Refactoring for portability
2016-02-10 13:37:52 +01:00
Yann Collet
302177a0c8
Merge pull request #125 from inikep/dev
...
Dev
2016-02-10 00:57:00 +01:00
inikep
ce6730a740
fix for ZSTD_HcGetAllMatches_generic
2016-02-09 23:26:30 +01:00
inikep
be77f3342d
Revert "Revert "ZSTD_compressBlock_opt_extDict_generic""
...
This reverts commit 2b714dfd26
.
2016-02-09 23:00:41 +01:00
inikep
2b714dfd26
Revert "ZSTD_compressBlock_opt_extDict_generic"
...
This reverts commit b498fc1c99
.
2016-02-09 22:47:51 +01:00
inikep
b498fc1c99
ZSTD_compressBlock_opt_extDict_generic
2016-02-09 22:23:48 +01:00
inikep
e75621f98d
dumpsEnd
2016-02-09 21:12:23 +01:00
inikep
31314ae0d1
int to U32
2016-02-09 20:47:39 +01:00
Yann Collet
6bff748e43
Fixed minor warnings in legacy modes
2016-02-09 17:55:01 +01:00
Yann Collet
4f0a3931c8
added missing patches
2016-02-07 04:00:27 +01:00
inikep
da730ff092
a bugfix for backward matches
2016-02-06 15:18:26 +01:00
inikep
dbade7c263
remove ZSTD_compressBlock_opt2_generic
2016-02-05 20:29:31 +01:00
inikep
f2fee4c316
added params.sufficientLength
2016-02-05 19:45:25 +01:00
inikep
5b0749715d
backward match extension
2016-02-05 19:25:40 +01:00
inikep
2712b69582
Merge remote-tracking branch 'refs/remotes/origin/v05x' into dev
2016-02-05 09:22:10 +01:00
inikep
3379c5df36
ZSTD_OPT_DEBUG
2016-02-05 09:21:20 +01:00
inikep
f967753bc2
ssize_t -> int
2016-02-05 09:07:22 +01:00
Yann Collet
982ffc773d
changed enum type name to `ZSTD_ErrorCode`
2016-02-05 02:33:10 +01:00
inikep
55a444764b
sufficient_len = 32
2016-02-04 22:22:47 +01:00
inikep
34608aaa29
ssize_t
2016-02-04 22:18:02 +01:00
inikep
17712afdbc
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into v05x
2016-02-04 21:49:45 +01:00
inikep
b3df71e538
code cleaning
2016-02-04 21:45:26 +01:00
inikep
4fa4098628
last match will start at a minimum distance of 8 from oend
2016-02-04 21:16:07 +01:00
inikep
08f500ca10
cur_min
2016-02-04 20:53:54 +01:00
inikep
6f07186745
clean code
2016-02-04 17:57:50 +01:00
inikep
59c9146258
40099096
2016-02-04 17:48:33 +01:00
inikep
baff8d6c1f
gitignore
2016-02-04 16:02:05 +01:00
inikep
40dd4739e3
removed llen
2016-02-04 15:52:35 +01:00
inikep
c9483f0982
clean code
2016-02-04 15:28:55 +01:00
Yann Collet
953ce72f4a
minor comments refactoring
2016-02-04 15:28:14 +01:00
inikep
158677c16a
new copy rep
2016-02-04 15:25:37 +01:00
inikep
d1ff7bf89a
cur_rep
2016-02-04 14:57:11 +01:00
inikep
eb72f5992a
i != litlen
2016-02-04 14:55:23 +01:00
inikep
997fb064a6
anchor
2016-02-04 13:01:56 +01:00
inikep
75be1a412c
fixes
2016-02-04 11:48:06 +01:00
inikep
cb5cd16d6b
40392170 integer
2016-02-04 11:19:06 +01:00
inikep
27e1c6a51f
ZSTD_resetFreqs
2016-02-04 11:11:08 +01:00
inikep
4196923dc9
40370570 ZSTD_getPriceReal
2016-02-04 10:04:33 +01:00
inikep
70b054559b
MaxLit
2016-02-03 22:56:55 +01:00
inikep
a98149df59
ZSTD_getLiteralPrice 2
2016-02-03 21:26:18 +01:00
inikep
dbbedfbd95
ZSTD_getLiteralPrice
2016-02-03 19:53:29 +01:00
inikep
892776efd6
ZSTD_get_price2
2016-02-03 19:27:44 +01:00
inikep
1292509987
ZSTD_get_price
2016-02-03 19:13:28 +01:00
inikep
749460d9ab
ZSTD_updatePrice
2016-02-03 19:08:48 +01:00
inikep
3bfcfc7bb0
ZSTD_updatePrice
2016-02-03 18:47:30 +01:00
inikep
53721f134c
Merge remote-tracking branch 'refs/remotes/Cyan4973/v05x' into v05x
...
# Conflicts:
# lib/zstd_compress.c
# lib/zstd_static.h
2016-02-03 17:29:40 +01:00
inikep
78e5ea3a32
ZSTD_getPrice
2016-02-03 17:25:42 +01:00
inikep
d02506c186
40699855
2016-02-03 16:54:23 +01:00
inikep
85cc6b509b
minml
2016-02-03 15:58:08 +01:00
inikep
7f6680e658
clean some code
2016-02-03 13:30:34 +01:00
inikep
4cb2009821
40901629
2016-02-03 13:25:34 +01:00
inikep
1b8b1f9d53
auto check of matches
2016-02-03 13:17:28 +01:00
inikep
e9f30eae4b
40970636
2016-02-03 12:53:07 +01:00
Yann Collet
b010b3b627
Fixed decoding error (afl)
2016-02-03 12:39:34 +01:00
Yann Collet
72bff50ecf
Updated error API, following suggestions by @nemequ ( #116 )
2016-02-03 12:06:24 +01:00
Yann Collet
ae7aa06650
lots of minor refactorings
2016-02-03 02:46:46 +01:00
Yann Collet
7d968c7bdd
move _usingDict() to stable API (zstd.h)
2016-02-03 02:11:32 +01:00
Yann Collet
464fa996e9
added v0.4 legacy support
2016-02-03 01:09:46 +01:00
inikep
5391a718a4
fixed
2016-02-03 00:04:14 +01:00
inikep
55bc9a868a
41374379
2016-02-02 19:47:09 +01:00
inikep
5d4131067b
update
2016-02-02 17:41:21 +01:00
Yann Collet
7d8e6bddb9
changed long length format
2016-02-02 17:30:37 +01:00
inikep
d6e8cc5f0c
41403384
2016-02-02 16:43:31 +01:00
Yann Collet
7a6343fb1b
fixed encoding bugs
2016-02-02 16:00:50 +01:00
inikep
e1b8e53e84
better logging
2016-02-02 15:41:16 +01:00
Yann Collet
2ce4923238
modified buffer management rules
2016-02-02 14:36:49 +01:00
inikep
59140c5480
turn off: last match must start at a minimum distance of 8 from oend
2016-02-02 12:36:09 +01:00
inikep
ef2706ed12
in progress
2016-01-31 15:32:01 +01:00
inikep
6b0715b8fd
no "start"
2016-01-31 15:17:50 +01:00
inikep
d4c3e8c595
fixed logs
2016-01-31 14:28:26 +01:00
inikep
c0dc4c361d
best_off
2016-01-31 12:36:41 +01:00
inikep
9bfb1a3357
working
2016-01-31 12:17:16 +01:00
inikep
ee4be5e981
ZSTD_compressBlock_opt_generic
2016-01-31 11:57:01 +01:00
inikep
e2bfe2407a
GetAllMatches
2016-01-31 11:26:05 +01:00
inikep
c71568fd44
ZSTD_opt
2016-01-31 11:26:04 +01:00
Yann Collet
35f7de52c8
fixed Visual warnings
2016-01-31 02:51:03 +01:00
Yann Collet
61e16ce07c
minor optimization for small files
2016-01-31 02:04:15 +01:00
Yann Collet
e93d6ced17
minor compression gain
2016-01-31 00:58:06 +01:00
Yann Collet
fd416f1eaf
added : ZSTD_compress_usingPreparedCCtx()
2016-01-30 03:14:15 +01:00
Yann Collet
863ec40f1e
minor compression speed improvement
2016-01-28 17:56:33 +01:00
Yann Collet
9cadd0853c
add basic tests
2016-01-28 15:39:52 +01:00
Yann Collet
4ddb1f5566
optimized counting of small segments
2016-01-28 03:24:53 +01:00
Yann Collet
fb810d6053
changed dictionary format
2016-01-28 00:21:13 +01:00
Yann Collet
1c8e194297
modified streaming compression API
2016-01-26 16:31:22 +01:00
Yann Collet
7b51a2948f
modified streaming decompression API
2016-01-26 15:58:49 +01:00
Yann Collet
b923f65076
introduced dictionary format
2016-01-26 03:14:20 +01:00
Yann Collet
bc4c8aa4b7
fixed new MIN_CBLOCK_SIZE
2016-01-25 17:26:01 +01:00
Yann Collet
3742219b4e
fixed decompression bugs
2016-01-25 16:54:05 +01:00
Yann Collet
a1249dc8da
fix visual warnings
2016-01-25 04:22:03 +01:00
Yann Collet
afe0709964
stream control
2016-01-25 04:10:46 +01:00
Yann Collet
59d1f79768
variable litblock header size
2016-01-23 19:28:41 +01:00
Yann Collet
a768a301ba
fixed VS project
2016-01-21 16:04:35 +01:00
Yann Collet
ffec740d37
fixed visual and clang errors
2016-01-21 15:50:11 +01:00
Yann Collet
977f1f3600
modified error system, following suggestions by @nemequ
2016-01-21 15:38:47 +01:00
Yann Collet
74ce8e812c
fixed VS 2015 'ERROR already defined', reported by Rich Geldreich
2016-01-21 14:32:41 +01:00
Yann Collet
7beaa05d81
fixed bt bug
2016-01-21 11:57:45 +01:00
Yann Collet
1840d6af33
bench pay attention to variable block sizes
2016-01-20 15:39:06 +01:00
Yann Collet
fba6aed175
changed : ZSTD_LEGACY_SUPPORT set to 0 by default within `zstd_decompress.c` ( #113 )
2016-01-18 12:03:54 +01:00
Yann Collet
a87278a4f0
small compression speed
2016-01-17 00:12:55 +01:00
Yann Collet
3a3b72f25a
Implemented ZSTD_HEAPMODE for zstd_decompress.c
...
Reduce cmake version requirement to 2.8.7
2016-01-11 12:56:11 +01:00
Yann Collet
523b594233
fixed read error
2016-01-09 02:10:40 +01:00
Yann Collet
b012510d9f
dictionary with block API
2016-01-09 02:00:10 +01:00
Yann Collet
bf42c8e5d8
block-level API
2016-01-09 01:08:23 +01:00
Yann Collet
c64c100658
fixed : unused variable
2016-01-08 17:54:02 +01:00
Yann Collet
600962711d
added duplication tests
2016-01-08 17:27:50 +01:00
Yann Collet
6e1c4c6c65
fixed context copy
2016-01-07 23:07:44 +01:00
Yann Collet
ecd651bd91
added ZSTD_duplicateCCtx()
2016-01-07 15:35:18 +01:00
Yann Collet
494c786a3b
fixed outstanding strict aliasing warnings
2016-01-06 12:54:02 +01:00
Yann Collet
1fdd82312d
Fixed : strict aliasing warnings in legacy decoders
2016-01-06 12:35:42 +01:00
Yann Collet
218bd31942
minor strict aliasing warning
2016-01-06 02:19:55 +01:00
Yann Collet
3b994cb465
updated fse
2016-01-06 01:58:37 +01:00
Yann Collet
96ffa424eb
minor fast mode improvement
2016-01-02 01:16:28 +01:00
Yann Collet
2cc12cb3cb
minor refactoring
2016-01-01 07:47:58 +01:00
Yann Collet
1358f91ec4
minor refactoring
2016-01-01 07:29:39 +01:00
Yann Collet
72e84cfd0f
minor simplification
2015-12-31 19:08:44 +01:00
Yann Collet
722504c2a0
update version to 0.4.6
2015-12-31 18:32:15 +01:00
Yann Collet
5f9f98768a
Makefile version automatically follows zstd.h
2015-12-30 19:52:08 +01:00
Yann Collet
48da164f14
fixed clang warnings
2015-12-29 23:40:02 +01:00
Yann Collet
ee3f4515c1
faster hc mode with repetitive data (experimental)
2015-12-29 22:26:09 +01:00
Yann Collet
d94efbf95c
fix fast mode on Windows
2015-12-29 14:29:08 +01:00
Yann Collet
1ac364d60b
Merge pull request #99 from KrzysFR/dev
...
Update version to 0.4.5 in zstdlib resources
2015-12-21 10:19:26 +01:00
Yann Collet
ed73ae8c67
fix #101
2015-12-19 19:51:42 +01:00
Christophe Chevalier
8972f13b4a
Added missing ZSTDLIB_API for ZSTD_decompress_usingDict and ZSTD_decompressDCtx
2015-12-18 11:20:37 +01:00
Yann Collet
31683c0b28
benchmark can use dictionary
2015-12-18 01:26:48 +01:00
Yann Collet
fdcad6d3e1
added ZSTD_compress_usingDict()
2015-12-17 23:50:15 +01:00
Yann Collet
deb078b9b1
added : -m : decompress multiple files
2015-12-17 20:30:14 +01:00
Yann Collet
f54f57023c
update params for 256K
2015-12-16 19:38:54 +01:00
Yann Collet
0700585fb9
fixed asan warning
2015-12-12 12:54:48 +01:00
Yann Collet
188b6ed6c7
fixed g++ warning
2015-12-12 12:44:44 +01:00
Yann Collet
3a061a4c9f
extended static dictionary to buffered mode
2015-12-12 11:17:42 +01:00
Yann Collet
6c3e2e7855
fixed : high compression modes for Windows 32 bits
2015-12-11 10:44:07 +01:00
Yann Collet
9f5ab1a4f5
fix 32-bits windows decoding on high-compression archives
2015-12-11 00:27:41 +01:00
Christophe Chevalier
2abb04d90d
Added ZSTDLIB_API to new ZSTD_maxCLevel method
2015-12-09 23:55:23 +01:00
Christophe Chevalier
7b05324a71
Only define ZSTDLIB_API when building a Windows DLL
2015-12-09 17:12:12 +01:00
Christophe Chevalier
844baf4fc5
Merge remote-tracking branch 'upstream/dev' into zstdlib_api
2015-12-09 15:45:57 +01:00
Yann Collet
d608088ca3
added : ZSTD_maxCLevel()
...
added : 256KB blocks mode
2015-12-09 09:05:22 +01:00
Yann Collet
0cde77bc5e
fixed comment (reported by @annulen)
2015-12-08 14:47:46 +01:00
Christophe Chevalier
d2199e7250
Added ZSTDLIB_API definition to zstd_buffered.h which does not seem to include zstd.h
2015-12-07 19:01:41 +01:00
Christophe Chevalier
c6e845398a
Add ZSTDLIB_API macro to prefix all exported methods with__declspec(dllexport) when building a DLL (on windows)
2015-12-07 17:48:53 +01:00
Yann Collet
4bfe415fa7
validated external dictionary
2015-12-06 13:18:37 +01:00
Yann Collet
e47c4e5f8e
strengthened bufferless streaming decompression
2015-12-05 09:23:53 +01:00
Yann Collet
417890cec2
strengthened streaming bufferless compression
2015-12-04 17:16:37 +01:00
Yann Collet
6a2f03295c
update version to 0.4.2
2015-12-02 15:05:22 +01:00
Yann Collet
120230b895
compress uses less memory for small blocks
2015-12-02 14:00:45 +01:00
Yann Collet
a308259afa
new : parameters for <= 16KB
2015-12-02 13:38:48 +01:00
Peter Harris
f06e238d6f
Fix compression on Big Endian CPUs
2015-12-01 14:58:24 -05:00
Yann Collet
c620b48489
revert install to normal zstd due to travis limitation (likely gcc 4.6)
2015-12-01 01:56:02 +01:00
Yann Collet
44287a3bf4
refactored decompress ( #82 )
2015-11-30 23:13:56 +01:00
Yann Collet
aead1bf86b
changed to ZSTD_LEGACY_SUPPORT=0, as suggested within #80
2015-11-30 14:18:47 +01:00
Yann Collet
daa1c65500
fixed #81 : removed dead file (reported by @inikep)
2015-11-30 12:25:48 +01:00
Yann Collet
a85a8dd94a
Fixed #80 (reported by @luben)
...
Added : tests for ZSTD_LEGACY=disable build mode
extended ZSTD_LEGACY=disable to dll build
2015-11-30 11:53:11 +01:00
Yann Collet
375727310c
fixed compression bug
2015-11-29 03:17:04 +01:00
Yann Collet
7fe531e7ec
fixed address space overflow (32-bits mode)
2015-11-29 02:38:09 +01:00
Yann Collet
52732b505d
fixed huff0 decoder (32-bits mode)
2015-11-28 22:03:08 +01:00
Yann Collet
bf7aa3c14e
fixed decoder error (rollbuffer mode)
2015-11-28 18:19:44 +01:00
Yann Collet
ad50c59bb7
fixed decoder error (32-bits mode, malicious input)
2015-11-28 17:09:28 +01:00
Yann Collet
00fd7a2110
protect 32-bits mode
2015-11-28 16:03:22 +01:00
Yann Collet
53fbf01370
minor level change
2015-11-28 14:08:01 +01:00
Yann Collet
800fa6c378
stronger tests for zbuff decompression
2015-11-27 14:30:23 +01:00
Yann Collet
31d1806a77
zbuff properly supports small dst buffers
2015-11-27 14:07:36 +01:00
Yann Collet
944042ab7d
coalesce block+header size (buffered mode)
2015-11-27 13:26:38 +01:00
Yann Collet
d248aa1c62
fixed hang bug (infinite loop) in decoder, buffered mode, malicious input
2015-11-26 22:39:29 +01:00
Yann Collet
661b94fb5d
fixed potential warning on undefine, reported by Maciej Adamczyk
2015-11-26 16:42:06 +01:00
Yann Collet
29a58c94f6
fixed lib makefile
2015-11-26 16:25:56 +01:00
Yann Collet
26fa696713
minor API change
2015-11-26 16:07:08 +01:00
Yann Collet
29a2c838c5
support for legacy 0.3 format
2015-11-26 16:02:04 +01:00
Yann Collet
c2ce890ac2
fixed bug in legacy decoder v0.2, reported by Maciej Adamczyk
2015-11-26 14:12:23 +01:00
Yann Collet
26415d3ff2
fixed leak
2015-11-26 12:43:28 +01:00
Yann Collet
6bcdeac954
fixed asan warning
2015-11-26 11:43:00 +01:00
Yann Collet
5f2ec63852
fixed decompression bug (buffered mode)
2015-11-26 10:32:17 +01:00
Yann Collet
91a97960f7
Added zbufftest
2015-11-26 09:59:49 +01:00
Yann Collet
e4fdad55dc
fixed minor decompression bug in buffered mode
2015-11-25 21:09:17 +01:00
Yann Collet
d3cb690156
fixed leak issue
2015-11-25 15:26:55 +01:00
Yann Collet
377b9e8b94
fixed : potential malloc error
2015-11-25 15:04:37 +01:00
Yann Collet
7b2c31043c
fixed : potential malloc error
2015-11-25 15:02:46 +01:00
Yann Collet
88fcd2916e
Added : zstd buffered API
2015-11-25 14:42:45 +01:00
Yann Collet
c36521571e
fixed large buffers bug
2015-11-24 14:06:07 +01:00
Yann Collet
225179dd05
more tests (bt modes)
2015-11-23 16:52:22 +01:00
Yann Collet
239cc289d3
fixed asan bugs
2015-11-23 16:17:21 +01:00
Yann Collet
03526e18fa
preliminary rollbuffer support for bt mode
2015-11-23 15:29:15 +01:00
Yann Collet
c1e52f0f05
hc simplication
2015-11-23 14:37:59 +01:00
Yann Collet
06eade5102
comments
2015-11-23 14:23:47 +01:00
Yann Collet
5054ee0cc0
rollbuffer refactor
2015-11-23 13:34:21 +01:00
Yann Collet
d7233d6e14
more compression tests
2015-11-22 14:40:51 +01:00
Yann Collet
287b7d9607
small hc speed improvement
2015-11-22 13:24:05 +01:00
Yann Collet
428619ccd7
small cLevel update
2015-11-22 12:46:30 +01:00
Yann Collet
a85c77b9d3
fixed roll buffer lazy2 mode
2015-11-22 12:22:04 +01:00
Yann Collet
b7fc88eec7
fixed roll buffer lazy mode
2015-11-22 03:12:28 +01:00
Yann Collet
734aa92ed5
fixed roll buffer greedy mode
2015-11-22 03:01:33 +01:00
Yann Collet
9a24e5986b
fixed roll buffer in fast mode
2015-11-22 02:53:43 +01:00
Yann Collet
007c1c6ff0
minor cr improvement
2015-11-22 02:42:28 +01:00
Yann Collet
7a23179779
small fast compression improvement
2015-11-21 15:27:35 +01:00
Yann Collet
402fdcf1a3
fixed asan
2015-11-20 12:46:08 +01:00
Yann Collet
55aa7f94e3
modified format
2015-11-20 12:04:52 +01:00
Yann Collet
743402cb23
modified format
2015-11-20 12:03:53 +01:00
Yann Collet
7dfd56be4a
restored fix small blocks
2015-11-19 17:46:29 +01:00
Yann Collet
c95f899725
refactored greedy
2015-11-19 17:28:35 +01:00
Yann Collet
b3a2af970e
refactored decompression
2015-11-19 17:13:19 +01:00
Yann Collet
110cc14bab
fixed bug #73 notified by @nemequ
2015-11-19 12:02:28 +01:00
Yann Collet
dcac00e7a6
update library builder
2015-11-19 11:23:44 +01:00
Yann Collet
b2549846ba
more tests
2015-11-18 11:29:32 +01:00
Yann Collet
94b9d8ec8d
fix compression bug in rollbuffer mode
2015-11-17 16:14:55 +01:00
Yann Collet
138e89c9c4
fix compression bug (extDict mode)
2015-11-17 14:26:54 +01:00
Yann Collet
786eb7d42e
fixed repcode bug
2015-11-17 12:23:53 +01:00
Yann Collet
82368cfa1b
comment
2015-11-16 19:10:56 +01:00
Yann Collet
eaa5f75b99
fixed decompression bug
2015-11-15 11:13:41 +01:00
Yann Collet
93a823ccb7
fixed asan warnings
2015-11-13 15:08:43 +01:00
Yann Collet
89db5e001d
rolling buffer preliminary support for fast mode
2015-11-13 11:27:46 +01:00
Yann Collet
0f366c61ed
fixed streaming decoder
2015-11-12 16:19:30 +01:00
Yann Collet
5b78d2f20c
basic rolling buffer support in decoder
2015-11-12 15:36:05 +01:00
Yann Collet
14983e7aed
refactored compression code
2015-11-11 21:38:21 +01:00
Yann Collet
7f6e91fa98
fixed library compilation
2015-11-11 14:39:50 +01:00
Yann Collet
5be2dd25f2
Changed Library source tree
...
- no more zstdhc ; zstd.h is enough
- ZSTD_compress() now needs a compressionLevel
- separated zstd_compress.c and zstd_decompress.c
- updated zstdcli, fullbench, fuzzer with new API
2015-11-11 13:43:58 +01:00
Yann Collet
530918b409
level tuning
2015-11-10 10:52:58 +01:00
Yann Collet
9f432926b4
fileio can use small blocks params
2015-11-09 17:42:17 +01:00
Yann Collet
43e0cd512a
small blocks params
2015-11-09 16:38:17 +01:00
Yann Collet
4baee50728
fix bug
2015-11-09 03:19:33 +01:00
Yann Collet
d1ade5a61d
fix 32-bits mode
2015-11-08 15:49:20 +01:00
Yann Collet
e9eba608c2
simplified bt
2015-11-08 15:08:03 +01:00
Yann Collet
31d00ba4b3
fix bt bug
2015-11-08 14:11:29 +01:00
Yann Collet
72a8e751f4
level tuning
2015-11-07 22:24:46 +01:00
Yann Collet
f48e35c206
minor bt improvements
2015-11-07 01:13:31 +01:00
Yann Collet
a81d9ac42d
minor bt CSpeed
2015-11-06 19:03:59 +01:00
Yann Collet
628065cf98
revert
2015-11-06 18:44:54 +01:00
Yann Collet
9b8e453713
minor CRatio improvement
2015-11-06 18:28:02 +01:00
Yann Collet
47cfa9a985
minor CRatio improvement
2015-11-06 17:13:46 +01:00
Yann Collet
eb283710dd
minor greedy CRatio improvement
2015-11-06 16:33:11 +01:00
Yann Collet
fc2afcfa64
small Cspeed increase
2015-11-06 15:40:14 +01:00
Yann Collet
444873f494
minor greedy mod
2015-11-06 11:48:56 +01:00
Yann Collet
805a52a773
fixed asan warning
2015-11-06 10:52:17 +01:00
Yann Collet
8ad12ec343
level tuning
2015-11-06 10:19:00 +01:00
Yann Collet
f12c1304a8
integrate fast mode
2015-11-05 18:16:59 +01:00
Yann Collet
1f44b3f778
added fast mode
2015-11-05 17:32:18 +01:00
Yann Collet
47b68908b2
rename lazy2
2015-11-05 15:14:17 +01:00
Yann Collet
9036105b62
simplified source
2015-11-05 15:03:12 +01:00
Yann Collet
5106a76dc9
merged strats
2015-11-05 15:00:24 +01:00
Yann Collet
43ae161fe9
level tuning
2015-11-05 11:58:02 +01:00
Yann Collet
92309cb37e
level tuning
2015-11-05 00:48:37 +01:00
Yann Collet
3137d1a059
fix fuzzer32 litCSize limit condition
2015-11-04 23:36:36 +01:00
Yann Collet
50c5cdb44c
fixed issues reported by Maciej Adamczyk
2015-11-04 20:35:33 +01:00
Yann Collet
3e3582719c
Fixed issue #62 , reported by @luben
2015-11-04 18:19:39 +01:00
Yann Collet
e8455f51ea
fix clang warning
2015-11-04 17:41:20 +01:00
Yann Collet
b241e9deb7
small compression improvement
2015-11-04 13:57:24 +01:00
Yann Collet
59d7063fbc
fix and level tuning
2015-11-04 12:05:27 +01:00
Yann Collet
96b9f0ba4d
btlazy2
2015-11-04 03:52:54 +01:00
Yann Collet
588d1e5fa0
Fixed asan issue reported by Maciej Adamczyk
2015-11-03 10:48:42 +01:00
Yann Collet
050efba81b
level tuning
2015-11-03 09:49:30 +01:00
Yann Collet
3564487614
lazydeep
2015-11-02 16:14:46 +01:00
Yann Collet
7671f393be
v0.3.2
2015-11-02 12:17:39 +01:00
Yann Collet
4e049bca8c
Fixed Visual Studio issue #60 , reported by @mailagentrus
2015-11-02 11:09:54 +01:00
Yann Collet
56e1092cb0
level tuning
2015-11-02 01:02:43 +01:00
Yann Collet
9b11b46f8a
Fixed speed regression
2015-11-01 12:40:22 +01:00
Yann Collet
be2010ea1b
lazy strategy
2015-10-31 12:57:14 +01:00
Yann Collet
4b100f43b0
level tuning
2015-10-30 15:49:48 +01:00
Yann Collet
ec43ba4a95
updated visual studio projects
2015-10-30 11:51:26 +01:00
Yann Collet
aa074051d6
decoding support for legacy v0.2 format
2015-10-30 11:21:50 +01:00
Yann Collet
fc04bcc6d7
fixed minor gcc warning
2015-10-30 07:11:07 +01:00
Yann Collet
8f9d49c092
fixed asan warning
2015-10-30 07:00:37 +01:00
Yann Collet
4114f95ce9
fix Visual Studio projects
2015-10-30 06:40:22 +01:00
Yann Collet
44fe99116e
fixed hc alloc
2015-10-29 22:02:40 +01:00
Yann Collet
712def905b
one less hc malloc
2015-10-29 18:41:45 +01:00
Yann Collet
3d9cf7acf2
fix include
2015-10-29 17:15:14 +01:00
Yann Collet
71bcdb5c1f
sync paramgrill with HC starting at level 2
2015-10-29 17:08:03 +01:00
Yann Collet
2acb5d3d48
HC modes can be selected from command line
2015-10-29 16:49:43 +01:00
Yann Collet
76c5c2a4a0
minor tuning
2015-10-28 19:07:05 +01:00
Yann Collet
81e49e6654
fine tune & messages
2015-10-28 15:56:48 +01:00
Yann Collet
b315bc86e1
srcLog
2015-10-27 13:12:25 +01:00
Yann Collet
2c6992e1dc
blocksize & T
2015-10-27 12:18:00 +01:00
Yann Collet
d55a7e0e4d
simplified chain
2015-10-27 03:06:40 +01:00
Yann Collet
8b91abec18
can test param conf
2015-10-27 02:59:12 +01:00