facebook/zstd
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,953 Commits 2 Branches 0 Tags
Commit Graph

7953 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sen Huang
6ce335371b Add error forwarding to loadCEntropy(), make check for dictSize >= 8 from bad merge 2019-11-08 13:57:26 -05:00
Sen Huang
4a61aaf368 Remove redundant comment 2019-11-08 13:57:26 -05:00
Sen Huang
c787b351ea Use ZSTD Error codes, improve explanation of ZSTD_loadCEntropy() and ZSTD_loadDEntropy() 2019-11-08 13:57:26 -05:00
Sen Huang
04fb42b4f3 Integrated refactor into getDictHeaderSize, now passes tests 2019-11-08 13:57:26 -05:00
Sen Huang
0bcaf6db08 First working pass at refactor of loadZstdDictionary() 2019-11-08 13:57:26 -05:00
Sen Huang
4b141b63e0 Revert "Move decompress symbols into zstd_internal.h, remove dependency" 
This reverts commit a152b4c67a5266f611db4a2eac4a79003852a795.
 2019-11-08 13:57:26 -05:00
Sen Huang
84404cff6e Move decompress symbols into zstd_internal.h, remove dependency 2019-11-08 13:57:26 -05:00
Sen Huang
341e0641ed Checks malloc() for failure, returns 0 if so 2019-11-08 13:57:26 -05:00
Sen Huang
97b7f712f3 Change to heap allocation, remove implicit type conversion 2019-11-08 13:57:25 -05:00
Sen Huang
e1edc554a3 Added 2 unit tests: one for sanity, one for correctnesson fixed dict 2019-11-08 13:57:25 -05:00
Sen Huang
3c36a7f13a Add ZDICT_getHeaderSize() 2019-11-08 13:57:08 -05:00
Ryan Schmidt
6ddb783c3e Change c90 to c89 
c89 and c90 are the same language. Old compilers like gcc 4.2.1 don't
know the c90 alias.
 2019-11-07 11:04:31 -06:00
Nick Terrell
8c474f9845 Fix parameter selection and adjustment with srcSize == 0 2019-11-07 08:58:43 -08:00
Yann Collet
2ed5344e84 added target zstd-dictBuilder 
check that the dictBuilder can be compiled
with only lib/common and lib/compress as dependencies.
 2019-11-06 15:46:58 -08:00
Yann Collet
9df49dc50a Visual compiler bug work-around 2019-11-06 15:23:44 -08:00
Yann Collet
be34969e5c minor man page fix 2019-11-06 15:07:35 -08:00
Yann Collet
aea2ff5d8d fixed wrong assert() in regression driver 2019-11-06 14:56:21 -08:00
Yann Collet
485fec5665 removed experimental_dict_builders 
no longer required,
can still be accessed by going to back to an earlier commit or release (<= v1.4.4)
 2019-11-06 14:43:14 -08:00
Yann Collet
a7e33e3e10 updated fuzz tests to use FileNamesTable* abstraction 2019-11-06 14:42:13 -08:00
Felix Handte
5688447758
Merge pull request #1873 from felixhandte/make-overlap-log-multithread-only 
Fix #1861: Restrict overlapLog Parameter When Not Built With Multithreading
 2019-11-06 16:56:37 -05:00
Felix Handte
ba4613602f
Merge pull request #1843 from moozzyk/issue-1637 
Take ZSTD_parameters as a const pointer
 2019-11-06 16:56:14 -05:00
Felix Handte
32f989c39a
Merge pull request #1869 from bket/openbsd 
'head -c BYTES' is non-portable.
 2019-11-06 16:54:03 -05:00
Felix Handte
cba922f3e6
Merge pull request #1870 from bket/portable 
'date -r FILE' is non-portable.
 2019-11-06 16:52:24 -05:00
W. Felix Handte
c13f81905a Fix #1861: Restrict overlapLog Parameter When Not Built With Multithreading 
This parameter is unused in single-threaded compression. We should make it
behave like the other multithread-only parameters, for which we only accept
zero when we are not built with multithreading.
 2019-11-06 16:05:02 -05:00
Yann Collet
31a0abbfda updated pzstd and largeNbDicts to use the new FileNamesTable* abstraction 2019-11-06 09:10:05 -08:00
Björn Ketelaars
e488cabf25 'date -r FILE' is non-portable. 
date(1) is used to display the last modification time of a file, which
is not supported on OpenBSD, FreeBSD and Darwin. Instead use stat(1).

Tested on OpenBSD.
 2019-11-06 13:55:59 +01:00
Björn Ketelaars
66b6688274 'head -c BYTES' is non-portable. 
Similar to #1321: The '-c' option for 'head' is non-portable (not in
POSIX).
 2019-11-06 11:39:59 +01:00
Yann Collet
7977899538 updated zwrapbench to use FileNamesTable* abstraction 2019-11-05 17:25:20 -08:00
Yann Collet
b09f59390b refactor code to only use FileNamesTable* 2019-11-05 17:02:43 -08:00
Yann Collet
76b9e42b0b refactoring (simplification) of util.h public API 2019-11-05 14:59:45 -08:00
Yann Collet
81c51483e9 Merge branch 'dev' into ahmed_file 2019-11-05 14:44:12 -08:00
Sen Huang
e21a8bbecd Fix FUZZ_rand32() bug 2019-11-05 16:43:24 -05:00
Sen Huang
13bb7500e8 Fix frame argument to compression 2019-11-05 16:15:55 -05:00
Sen Huang
f2932fb5eb Fix more merge conflicts 2019-11-05 15:54:05 -05:00
Sen Huang
7ce891870c Fix merge conflicts 2019-11-05 15:51:25 -05:00
Yann Collet
73f8905b83
Merge pull request #1867 from bimbashrestha/dict_load_fuzz_err 
[clean up] Replacing some literals with constants in zstd_compress_literals.c
 2019-11-05 12:24:54 -08:00
Bimba Shrestha
3fb5b106da Replacing some literals with constants 2019-11-05 10:26:57 -08:00
Bimba Shrestha
cf62c31f82
Merge pull request #15 from facebook/dev 
Merging facebook/dev into bimbashrestha/dev
 2019-11-04 11:23:44 -08:00
Yann Collet
305ac2653e update table benchmark with zstd v1.4.4 2019-11-04 10:59:59 -08:00
Yann Collet
10f0e6993f
Merge pull request #1865 from facebook/dev 
fix dictionary edge case
 2019-11-04 09:54:32 -08:00
Nick Terrell
332aade370
Merge pull request #1864 from terrelln/dict-fix 
Fix 2 bugs in dictionary loading
 2019-11-01 20:01:12 -07:00
Nick Terrell
60205fec02 Fix 2 bugs in dictionary loading 
* Silently skip dictionaries less than 8 bytes, unless using `ZSTD_dct_fullDict`.
  This changes the compressor, which silently skips dictionaries <= 8 bytes.
* Allow repcodes that are equal to the dictionary content size, since it is in bounds.
 2019-11-01 16:52:07 -07:00
Nick Terrell
75e7c0d107 [fuzz] Add dictionary_loader fuzzer 
* Adds the fuzzer
* Adds an additional `InputType` for the fuzzer

I ran the fuzzer for about 10 minutes and it found 2 bugs:

* Catches the original bug without any help
* Catches an additional bug with 8-byte dictionaries
 2019-11-01 15:54:24 -07:00
Yann Collet
529f0cba85
Merge pull request #1859 from facebook/dev 
v1.4.4
 2019-10-31 15:02:55 -07:00
Yann Collet
d770a2a89f fixed zlibwrapper build script 2019-10-31 10:47:06 -07:00
Yann Collet
94dcce2bd8
Merge pull request #1860 from senhuang42/streaming_compression_using_cdict 
Disable reloading dictionary when there is no known srcSize
 2019-10-30 16:27:58 -07:00
Sen Huang
b9ede1c8c2 Make sure contentsize is known 2019-10-30 16:03:58 -04:00
Felix Handte
f9d867e79f
Merge pull request #1857 from 0x123456789A/link-shared 
Add CMake flag for linking programs dynamically
 2019-10-30 15:43:11 -04:00
Yann Collet
47034cd6c3
Merge pull request #1850 from bimbashrestha/named_pipes 
Gating named pipe support on windows
 2019-10-30 12:18:58 -07:00
Yann Collet
ae3d35dc8e updated CHANGELOG for v1.4.4 2019-10-30 12:16:45 -07:00