Commit Graph

2811 Commits (bd7fa21deb289fb252aadb6adb10b635f5d89732)

Author SHA1 Message Date
Yann Collet bd7fa21deb added ZSTD_refDDict()
Now DDict does no longer depends on DCtx duplication
2017-02-26 14:43:07 -08:00
Yann Collet d73eebc00f loadEntropy works on new ZSTD_entropy_t type 2017-02-26 10:16:42 -08:00
Yann Collet 8629f0e41f created entropy structure type 2017-02-25 18:33:31 -08:00
Yann Collet 8dff956dbf Added DDict unit test in fuzzer
also : slightly modified loadEntropy :
know src must points at start of dictionary
2017-02-25 10:11:15 -08:00
Yann Collet 0990d79476 Merge pull request #566 from facebook/forceRawDict
Force raw dict
2017-02-24 16:59:24 -08:00
Yann Collet df9f9296e3 attempt to fix pthreat linking error
replacing -lpthread by -pthread
2017-02-24 00:16:05 -08:00
Yann Collet 14312d833e zstdmt : fix : loading prefix from previous segments
There used to be a (very small) chance that
loading prefix from previous segment
would be confused with a real zstd dictionary.
For that to happen, the prefix needs to start
with the same value as dictionary magic.
That's 1 chance in 4 billions if all values have equal probability.
But in fact, since some values are more common (0x00000000 for example)
others are less common, and dictionary magic was selected to be one of them,
so probabilities are likely even lower.

Anyway, this risk is no down to zero
by adding a new CCtx parameter : ZSTD_p_forceRawDict

Current parameter policy : the parameter "stick" to its CCtx,
so any dictionary loading after ZSTD_p_forceRawDict is set
will be loaded in "raw" ("content only") mode,
even if CCtx is re-used multiple times with multiple different dictionary.
It's up to the user to reset this value differently if it needs so.
2017-02-23 23:42:12 -08:00
Yann Collet 831b4890ce minor tests/Makefile refactoring
and update of zstd_manual,html
2017-02-23 23:09:10 -08:00
Yann Collet 571a68dcda Merge pull request #565 from iburinoc/testcorpus
Fix 32-bit -Wsign-compare issues in decodecorpus.c
2017-02-23 16:28:37 -08:00
Yann Collet 805943ccaa Merge pull request #564 from iburinoc/doc
Move educational_decoder to doc/ and add doc README
2017-02-23 16:27:54 -08:00
Sean Purcell d590291d86 Fix -Wsign-compare issues in decodecorpus.c
https://travis-ci.org/facebook/zstd/jobs/204423280
2017-02-23 16:11:08 -08:00
Sean Purcell 822c7187d4 Merge branch 'dev' into doc 2017-02-23 15:23:24 -08:00
Yann Collet 7e224ea03e Merge pull request #562 from iburinoc/testcorpus
Create a tool that generates random, valid, Zstd frames for decoder testing
2017-02-23 15:19:36 -08:00
Sean Purcell 1d1932480e Move educational_decoder to doc/ and add doc README
- Also make some minor bugfixes to educational decoder
2017-02-23 14:34:52 -08:00
Yann Collet db478ad27e Merge pull request #558 from facebook/manual
Manual
2017-02-23 13:39:36 -08:00
Yann Collet cce8d8ba2b Merge pull request #560 from iburinoc/findcompressedsize
Change name to to findFrameCompressedSize and add skippable support
2017-02-23 13:39:23 -08:00
Sean Purcell 3cd8d50c34 Update CLI and link from educational decoder 2017-02-23 13:06:50 -08:00
Sean Purcell 485ca8c352 Update tests/README.md 2017-02-23 10:27:00 -08:00
Sean Purcell f119b62055 Create a tool that generates random, valid, Zstd frames for decoder testing
Note: Does not handle dictionaries currently
2017-02-22 16:08:34 -08:00
Yann Collet a395fdbaf0 Merge pull request #561 from iburinoc/fsefix
Fix bug in FSE distribution normalization
2017-02-22 15:32:22 -08:00
Sean Purcell 83038d236a Fix bug in FSE distribution normalization 2017-02-22 13:52:48 -08:00
Sean Purcell 64417cd2ff Describe ambiguity around skippable frames 2017-02-22 13:29:01 -08:00
Sean Purcell 9757cc811b Update comment 2017-02-22 12:28:21 -08:00
Sean Purcell 9050e1925e Change name to to findFrameCompressedSize and add skippable support 2017-02-22 12:12:34 -08:00
Yann Collet 1f3d54ddb4 fixed malloc(0) potential issue
Added test cases to cover #556 patch
2017-02-22 11:08:00 -08:00
Yann Collet e68dbdaf67 Merge pull request #556 from sjnam/size_unknown
original size unknown
2017-02-22 10:53:35 -08:00
Yann Collet 88ba64702e fixed c90/gnu90/gnu99 tests 2017-02-22 10:52:36 -08:00
Yann Collet 9bef0ebb1d Merge pull request #559 from inikep/arm-ppc-compilation
Reduced number of Travis tests to 7
2017-02-22 10:19:33 -08:00
Przemyslaw Skibinski bbbd435099 travis.yml: test arm-ppc-compilation target 2017-02-22 11:21:34 +01:00
Przemyslaw Skibinski d41c048394 added arm-ppc-compilation Makefile target 2017-02-22 11:07:28 +01:00
Przemyslaw Skibinski 337ec875b6 minor tweaks 2017-02-22 10:31:30 +01:00
Yann Collet 7757577341 added `manual` target in root Makefile
`manual` target is added to `all` target
2017-02-22 01:10:43 -08:00
Yann Collet 508404514c added `manual` target to contrib/gen_html/Makefile 2017-02-22 00:57:50 -08:00
Przemyslaw Skibinski 3d836bfd18 travis.yml: fix versionsTest target 2017-02-22 09:36:42 +01:00
Przemyslaw Skibinski 2e8ae51f8c travis.yml: set "dist: trusty" as default 2017-02-22 09:21:04 +01:00
Przemyslaw Skibinski 21911ad6cb move Ubuntu packages install to Makefile 2017-02-22 08:54:56 +01:00
Przemyslaw Skibinski 5dd18b314b travis.yml: reduce number of jobs to 7 2017-02-22 08:15:17 +01:00
Przemyslaw Skibinski 0df0901b3a Merge remote-tracking branch 'refs/remotes/facebook/dev' into asan 2017-02-22 08:14:54 +01:00
Soojin Nam 971c161318 test for fail to decompress 2017-02-22 16:04:48 +09:00
Yann Collet e37d9e2d8f Merge pull request #557 from inikep/dev11
travis.yml: remove tests that overlap with Circle CI
2017-02-21 17:53:28 -08:00
Yann Collet 73fcbe86c7 Merge pull request #552 from iburinoc/spec
Restructure Format Specification
2017-02-21 17:52:25 -08:00
Przemyslaw Skibinski f58ac79f51 fix uasan-test32 2017-02-21 23:40:21 +01:00
Przemyslaw Skibinski 8a51c69218 travis.yml: added uasan-test and uasan-test32 2017-02-21 22:48:04 +01:00
Przemyslaw Skibinski 7704c3ca1a travis.yml: use CFLAGS=-Og with -fsanitize 2017-02-21 21:48:14 +01:00
Przemyslaw Skibinski 4d7a24328b travis.yml: added LDFLAGS=-fuse-ld=gold 2017-02-21 21:12:09 +01:00
Przemyslaw Skibinski 97cfec5e12 travis.yml: reduce number of jobs 2017-02-21 20:44:35 +01:00
Przemyslaw Skibinski 346ce32ade legacy.c: fix memory leaks 2017-02-21 20:10:21 +01:00
Sean Purcell 3bee41a70e Add default distributions and fix typos 2017-02-21 10:20:36 -08:00
Przemyslaw Skibinski d8114e5802 zstd_compress.c: fix memory leaks 2017-02-21 18:59:56 +01:00
Przemyslaw Skibinski 684858e7b7 fix memory leaks 2017-02-21 18:17:24 +01:00