3b0e24c06b
added error message to catch case where size not given
2017-06-14 12:04:22 -07:00
aa95bc0a5f
code refactoring and adding some print statements for debugging
2017-06-14 10:54:47 -07:00
07cfc975bb
debugging error with finalizeDictionary() not writing dictionary properly
2017-06-13 17:27:02 -07:00
8dd621f788
changed makefile to include zdict functions, wrote out dictionary to path
2017-06-13 14:19:35 -07:00
f35f252e36
added code to generate dictionary using finalizeDictionary
2017-06-13 11:54:43 -07:00
37e1b1488b
removed previous double free crash, used new crash function
2017-06-09 13:57:18 -07:00
be9b0ae627
added error function for different compilation modes
2017-06-09 13:41:34 -07:00
11c3987baf
added code to extend the offset when a dictionary is detected
2017-06-09 09:48:56 -07:00
125ed59968
made sure dictionary ID was being written in the frame header of each file
2017-06-08 17:27:15 -07:00
233ee5334e
set the lower bits of frame header descriptor if dictionary is needed
2017-06-08 17:11:33 -07:00
c2d909e396
added code for generating dictionary/test files randomly. Still need to make sure dictionary ID matches
2017-06-08 17:06:30 -07:00
8c910d2097
updated ZSTDMT streaming API
...
ZSTDMT streaming API is now similar
and has same capabilites as single-thread streaming API.
It makes it easier to blend them together.
2017-06-03 01:15:02 -07:00
cdf7e82222
Added ZSTD_initStaticCDict()
2017-05-25 18:05:49 -07:00
57827f906f
added ZSTD_initStaticDDict()
2017-05-25 15:44:06 -07:00
25989e361c
updated ZSTD_estimate?DictSize() to pass parameter byReference
...
resulting ?Dict object is smaller when created byReference.
Seems better than a documentation note.
2017-05-25 15:07:37 -07:00
0fdc71c3dc
added ZSTD_initStaticDCtx()
2017-05-24 17:41:41 -07:00
c7fe262dc9
added ZSTD_initStaticCCtx()
...
makes it possible to statically or externally allocate CCtx.
static CCtx will only use provided memory area,
it will never resize nor malloc.
2017-05-23 13:20:41 -07:00
60a557e7fd
fixing symbol.c test
...
I believe it would be better to rely on fuzzer tests compiled with dll
2017-05-19 11:27:43 -07:00
fa3671eac7
changed ZSTD_BLOCKSIZE_ABSOLUTEMAX into ZSTD_BLOCKSIZE_MAX
...
Also :
change ZSTD_getBlockSizeMax() into ZSTD_getBlockSize()
created ZSTD_BLOCKSIZELOG_MAX
2017-05-19 10:51:30 -07:00
009d604e00
ZSTD_compress_generic() supports multiple successive frames
...
also : clarified streaming API implementation
2017-05-19 10:17:59 -07:00
0bdb575c31
Merge branch 'dev' into advancedAPI2
2017-05-16 16:32:29 -07:00
2d4d31c18a
removed gcc compilation flag -Wbad-function-cast
...
It makes it more difficult to directly cast the result of a function,
requiring to store the result in an intermediate variable.
It does not necessarily help readability,
and this restriction can be difficult to overcome in some constructions,
like some macros.
also : fixed minor Visual conversion warnings in datagencli.c
2017-05-16 11:34:38 -07:00
83d0c764dc
added several compilation flags
2017-05-15 17:15:46 -07:00
a5ffe3d370
pushed enum values for strategy by one (ZSTD_fast==1)
...
this makes it possible to use `0` to mean:
"do not change strategy"
2017-05-12 16:29:19 -07:00
5f2c7213c7
Merge remote-tracking branch 'upstream/dev' into btopt
...
* upstream/dev: (305 commits)
added test for ZSTD_estimateCStreamSize()
changed variable name, for clarity
fixed ZSTD_estimateCStreamSize()
shortened ZSTD_createCStream_Advanced()
fixed symbols test
added ZSTD_estimateDStreamSize()
changed name frameParams into frameHeader
regroup memory usage function declarations
separated ZSTD_estimateCStreamSize() from ZSTD_estimateCCtxSize()
bumped version number
added ZSTD_estimateCDictSize() and ZSTD_estimateDDictSize()
Updated ZSTD_freeCCtx()
updated ZSTD_estimateCCtxSize()
Updated ZSTD_sizeof_CCtx()
merged CCtx and CStream as a single same object
cli : -d and -t do not stop after a failed decompression
added dev branch CircleCI badge
added dev branch Appveyor badge
keep dev branch status only
creates a binary archive without the `programs` directory
...
2017-05-10 16:49:58 -07:00
30ab64e21d
added test for ZSTD_estimateCStreamSize()
2017-05-10 11:30:19 -07:00
461a9cc7c6
fixed symbols test
2017-05-09 16:53:09 -07:00
f16f4497ca
added ZSTD_estimateDStreamSize()
2017-05-09 16:18:17 -07:00
542c9dfcf8
changed name frameParams into frameHeader
...
ZSTD_frameParams => ZSTD_frameHeader
ZSTD_getFrameParams() -> ZSTD_getFrameHeader()
The new naming is more distinctive from ZSTD_frameParameters,
which is used during compression.
ZSTD_frameHeader is clearer in its intention to described frame header content.
It also implies we are decoding a ZSTD frame, hence we are at decoding stage.
2017-05-09 15:46:07 -07:00
fa8dadb294
separated ZSTD_estimateCStreamSize() from ZSTD_estimateCCtxSize()
...
for clarity
2017-05-08 18:24:16 -07:00
a1d6704d7f
added ZSTD_estimateCDictSize() and ZSTD_estimateDDictSize()
...
it complements ZSTD_estimateCCtxSize()
for the special case of ZSTD_initCStream_usingDict()
2017-05-08 17:51:49 -07:00
fc5145955a
updated ZSTD_estimateCCtxSize()
...
added a parameter streaming,
to estimate memory allocation size
when the CCtx is used for streaming (CStream).
Note : this function is not able to estimate
memory cost of a potential internal CDict
which can only happen when starting with ZSTD_initCStream_usingDict()
2017-05-08 17:07:59 -07:00
0be6fd3429
merged CCtx and CStream as a single same object
...
To be changed : ZSTD_sizeof_CCtx(), ZSTD_estimateCCtxSize()
2017-05-08 16:08:01 -07:00
01a1abfdb5
cli : -d and -t do not stop after a failed decompression
...
The problematic srcfile will be named on console/log,
but decompression/test will continue onto next file in the list.
2017-05-05 19:15:24 -07:00
f376d47c11
[CLI] Switch dictionary builder on CLI to cover
2017-05-02 11:18:27 -07:00
a51cab6e68
Merge pull request #678 from facebook/apiChange
...
Breaking API Change around CDict
2017-04-28 10:02:45 -07:00
36e79a1a1f
tests : -g is part of DEBUGFLAGS
2017-04-27 17:29:40 -07:00
c6915429f2
shortened Appveyor release tests
...
fuzzer supports time suffix `s` for "seconds"
2017-04-27 16:24:53 -07:00
a92cbb7004
Added a secondary test, checking dictID presence after setting noDictIdFLag=1
2017-04-27 15:08:56 -07:00
7d283cdfa2
added test for ZSTD_initCStream_usingCDict_advanced()
2017-04-27 14:48:34 -07:00
2f73427d35
added test for ZSTD_compress_usingCDict_advanced()
2017-04-27 14:39:39 -07:00
7321345fd2
fixed another VS2008 init error
2017-04-27 14:19:34 -07:00
f4bd857d81
created ZSTD_compress_usingCDict_advanced()
2017-04-27 11:31:55 -07:00
31533bacce
Changed ZSTD_createCDict_advanced()
...
It now only uses compressionParameters as argument.
It produces many changes throughout user code,
though hopefully they tend to be simple :
just provide the cParams part from existing ZSTD_parameters.
Some programs might depend on ZSTD_createCDict_advanced() to pass frame parameters.
This change will force them to revisit this strategy and fix it,
since frame parameters are effectively silently ignored in current version.
2017-04-27 00:29:04 -07:00
4de8632957
Add LZ4 compress/decompress support to CLI
2017-04-24 16:48:25 -07:00
230d7acc7d
cli : add support for --threads=# command
...
updated documentation
add relevant test case
2017-04-21 11:38:13 -07:00
c17e020c9a
disable assert when compiling paramgrill
...
paramgrill is a benchmark calibration function.
Speed accuracy is critical, it cannot be altered by assert.
2017-04-20 12:50:02 -07:00
2c5514c759
fixed ZSTDMT_initCStream_advanced()
...
Must use the new ZSTD_compressBegin_usingCDict_advanced()
to enforce correct frame parameters
2017-04-18 22:52:41 -07:00
0bb381dad8
added test for ZSTD_initCStream_advanced()
...
when params.fParams.contentSizeFlags = 1
and pledgedSrcSize = 0
then srcSize should be considered 0 (empty), and not "unknown"
2017-04-18 15:08:52 -07:00
4f818182b8
clarified frame parameters for ZSTD_compress*_usingCDict()
...
created ZSTD_compressBegin_usingCDict_internal(),
which gives direct control to frame Parameters.
ZSTD_resetCStream_internal() now points into it.
2017-04-17 18:29:06 -07:00
9c4c970399
Merge branch 'dev' into compressionFlow
2017-04-17 16:33:09 -07:00
d845dab69c
Fix input size too small to trigger zstdmt
2017-04-17 12:10:58 -07:00
c424ec2eae
Add multithreading tests to playTests.sh
2017-04-17 11:41:46 -07:00
2afb075382
Merge branch 'dev' into compressionFlow
2017-04-14 15:08:31 -07:00
f913cbed33
fixed : memory leak in fuzzer test
2017-04-13 22:46:51 -07:00
20d5e03893
content size is controlled at bufferless level
...
so it's active for all entry points
Also : added relevant test (wrong content size) in fuzzer
2017-04-11 18:34:02 -07:00
d37e1df2ab
Fix message
2017-04-11 17:33:26 -07:00
eb70d219fd
Add test of file > 4GB to playTests
2017-04-11 17:15:13 -07:00
4ee6b15dac
force contentSizeFlag=0 when using ZSTD_initCStream_usingCDict()
...
because by definition srcSize is not known when using this prototype.
added relevant test
Note : this use was already working, because at a later stage
(both ZSTD_compressBegin_usingCDict() and ZSTD_copyCCtx())
pledgedSrcSize=0 is translated into "unknown", no matter the frame parameter.
This is not correct, but of little importance,
as the medium term plan is to no longer set fParams within CDict
2017-04-11 11:59:44 -07:00
4b987ad8ce
Introduce ZSTD_initCStream_internal()
...
This is now the regroup point for ZSTD_initCStream*() functions
ZSTD_initCStream_advanced() now properly checks for parameters validity.
Also : added <assert.h> usage inside zstd_compress.c
Needs ZSTD_DEBUG=1 macro to be triggered.
Will be triggered by default from `tests` directory
2017-04-10 17:50:44 -07:00
1fa3b75369
Merge pull request #648 from facebook/zstdmt
...
improved zstreamtest --mt to trap bug #644
2017-04-07 06:09:52 -07:00
1652172b2d
Add refuse to overwrite test and fix format
2017-04-06 17:06:30 -07:00
9da11c6aae
Add test for overwriting read-only
2017-04-06 12:58:49 -07:00
ce80098f14
improved zstreamtest --mt to trap bug #644
2017-04-05 16:34:09 -07:00
9631e603ae
paramgrill : results from optimizer use cli format
...
Best found configuration is displayed
using documented cli advanced parameter syntax.
2017-04-04 16:54:33 -07:00
89b32f3db0
fix paramgrill -O#
...
ensure proposed config does not require more memory than necessary
2017-04-04 16:41:11 -07:00
2724f25567
fixed paramgrill -O#
...
find optimal settings for a minimum speed
2017-04-04 16:31:17 -07:00
c2007388a5
fixed bench.c : optional advanced parameters applied
...
before creating cdict
2017-04-04 15:35:06 -07:00
39a6cc5172
Make ZSTD_compress_usingCDict() respect contentSizeFlag
2017-04-03 21:09:55 -07:00
62ecad3819
Fix ZSTD_initCStream_usingCDict() to use dictionary
2017-04-03 21:05:59 -07:00
30c7698970
optimize ZSTDMT_compress() memory usage
...
does no longer allocate temporary buffers
when there is enough room in dstBuffer to decompress directly there.
(previous method would skip that for 1st chunk only).
Also : fix ZSTD_compressBound() for small srcSize
2017-03-31 18:27:03 -07:00
6476c51b86
Merge pull request #637 from facebook/zstdmt
...
Zstdmt
2017-03-30 14:18:37 -07:00
5152fb2cb2
Convert all tabs to spaces
2017-03-29 18:51:58 -07:00
1e1e26f2ac
fixed #634 : ZSTDMT_compressCCtx() doesn't provide frame content size in header
2017-03-29 17:09:59 -07:00
0ef6803707
added ZSTD_getFrameContentSize() to ZSTDMT unit test in fuzzer
...
Now tests fail, because ZSTDMT_compress() doesn't fill frame content size correctly.
2017-03-29 16:58:57 -07:00
41fefd573a
Improved speed tests
...
Better compatibility with Mac OS-X
Force attribution to a selected core # (Linux)
2017-03-26 23:52:19 -07:00
4c41d37fcc
changed test for new syntax
...
--dictID= and --maxdict=
2017-03-24 18:36:56 -07:00
f332ece468
dictBuilder fails to create dictionary on certain input
...
Properly expressed with an error code (see zstd_errors.h)
and a cli return code != 0
2017-03-23 16:24:02 -07:00
680e4e0953
Ignore symbolic links unless --force specified
2017-03-23 11:52:09 -07:00
042ba122ae
Change g_displayLevel to int and fix DISPLAYUPDATE flush
2017-03-23 11:21:59 -07:00
1b418bd3da
Merge remote-tracking branch 'origin/dev' into appveyor
2017-03-21 10:59:54 -07:00
5a2b857029
Update appveyor.yml to have short and long tests
2017-03-20 17:04:44 -07:00
c771977489
Fix decodecorpus clang compile errors
2017-03-20 16:02:24 -07:00
2f6c7e6a53
Fix windows compiler warnings for decodecorpus
2017-03-20 13:45:12 -07:00
170861da70
Merge pull request #610 from iburinoc/slowfuzzer
...
Strongly limit compression level when source is large for tests running on QEMU
2017-03-20 13:36:01 -07:00
0b0b10ec83
Add --no-big-tests flag for qemu fuzz-tests
2017-03-20 11:32:24 -07:00
7ebf2de02d
Add ability to strongly limit fuzzer test size with flag
2017-03-20 11:25:00 -07:00
35c147ab6a
Merge pull request #605 from iburinoc/term
...
Fix zstd not erroring on compressing to terminal without forceStdout
2017-03-17 14:02:48 -07:00
9a38dfa794
Only run IS_CONSOLE tests with a TTY
2017-03-17 12:32:18 -07:00
d973071e90
Add tests for compressed data on console
2017-03-16 16:25:19 -07:00
f5e50519e0
Prevent fuzz testers from combining large dicts with high clevel
2017-03-15 15:04:54 -07:00
3773bd318f
Merge pull request #601 from terrelln/nxz
...
Add xz and lzma support.
2017-03-13 22:00:03 -07:00
aa8bcf360f
Add xz and lzma support.
...
Finish feature started by @inikep.
* Add xz and lzma compression and decompression support to target `xzstd`.
* Fix bug in gzip decompression that silently accepted truncated files.
* Add gzip frame composition tests.
* Add xz/lzma compatibility tests.
* Add xz/lzma frame composition tests.
2017-03-13 18:45:41 -07:00
120df494e9
Update builds to not support legacy v01-v03
2017-03-13 14:44:08 -07:00
7c8f5d5bc7
Make test times overwritable
2017-03-09 16:05:23 -08:00
daec40db24
Update .travis.yml and Makefile for medium tests
2017-03-09 16:05:22 -08:00
eeb31eed39
s/ZSTD_btopt2/ZSTD_btultra/g
2017-03-09 11:44:25 -08:00
8b1d004031
added -Wformat-security flag, as recommended by @pixelb
2017-03-05 21:17:32 -08:00
27526c7201
make : added target shortest
...
shortest only run fast part of playTests.sh .
cc @iburinoc
2017-03-01 17:02:49 -08:00
c1c040eae1
added gzip tests
...
also : made sure zstd --format=gzip -V
would fail if gzip compatibility is not supported
2017-03-01 16:49:20 -08:00
51598510c0
Merge pull request #580 from facebook/speedStream
...
Improve streaming decompression speed
2017-03-01 10:59:51 -08:00
a33ae64204
fixed decoding skippable frames
2017-02-28 01:15:28 -08:00
c0b1731bce
added test for decompression with NULL dict and NULL DDict
...
previous version of ZSTD_decompressMultiFrame() would fail that test
2017-02-28 01:02:46 -08:00
8b3560e196
update gzip tests
2017-02-28 09:41:23 +01:00
1d7f30f9d4
Merge branch 'decompressStream' into dev
2017-02-27 20:55:22 -08:00
a81c2e7e44
Merge pull request #573 from facebook/ddict
...
Improved DDict memory usage
2017-02-27 20:54:42 -08:00
952d06fa9c
fullbench : -i0 displays list of functions to bench
2017-02-27 17:58:02 -08:00
67d86a74a5
added test case : --rm on stdin
...
must remain silent (instead of failing)
2017-02-27 16:09:20 -08:00
ea7589ce07
Merge pull request #571 from inikep/dev11
...
gzip tests
2017-02-27 13:54:33 -08:00
5d848527e6
use "./gzip" for gzip tests
2017-02-27 22:02:03 +01:00
b43d75154d
update gzip tests
2017-02-27 09:07:35 +01:00
1479c98661
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2017-02-27 08:56:43 +01:00
2302bfa4bf
Merge branch 'dev' into testcorpus
2017-02-26 22:27:31 -08:00
bd7fa21deb
added ZSTD_refDDict()
...
Now DDict does no longer depends on DCtx duplication
2017-02-26 14:43:07 -08:00
8dff956dbf
Added DDict unit test in fuzzer
...
also : slightly modified loadEntropy :
know src must points at start of dictionary
2017-02-25 10:11:15 -08:00
682ae8a10e
Merge pull request #567 from inikep/dev11
...
faster Travis tests
2017-02-25 06:57:31 -08:00
22468b0cc3
Fix some more ARM compile errors
...
https://travis-ci.org/facebook/zstd/jobs/204807461
Can't get them to reproduce the compile errors locally,
tested fix by forcing that test to run on Travis.
2017-02-24 10:55:42 -08:00
a66b764d79
added tests for gzip
2017-02-24 16:09:17 +01:00
8740d6bcf5
fix uninitialized value warning
2017-02-24 09:24:55 +01:00
df9f9296e3
attempt to fix pthreat linking error
...
replacing -lpthread by -pthread
2017-02-24 00:16:05 -08:00
831b4890ce
minor tests/Makefile refactoring
...
and update of zstd_manual,html
2017-02-23 23:09:10 -08:00
d590291d86
Fix -Wsign-compare issues in decodecorpus.c
...
https://travis-ci.org/facebook/zstd/jobs/204423280
2017-02-23 16:11:08 -08:00
7e224ea03e
Merge pull request #562 from iburinoc/testcorpus
...
Create a tool that generates random, valid, Zstd frames for decoder testing
2017-02-23 15:19:36 -08:00
3cd8d50c34
Update CLI and link from educational decoder
2017-02-23 13:06:50 -08:00
485ca8c352
Update tests/README.md
2017-02-23 10:27:00 -08:00
f119b62055
Create a tool that generates random, valid, Zstd frames for decoder testing
...
Note: Does not handle dictionaries currently
2017-02-22 16:08:34 -08:00
9050e1925e
Change name to to findFrameCompressedSize and add skippable support
2017-02-22 12:12:34 -08:00
337ec875b6
minor tweaks
2017-02-22 10:31:30 +01:00
3d836bfd18
travis.yml: fix versionsTest target
2017-02-22 09:36:42 +01:00
346ce32ade
legacy.c: fix memory leaks
2017-02-21 20:10:21 +01:00
684858e7b7
fix memory leaks
2017-02-21 18:17:24 +01:00
f2da1b1f22
Merge pull request #550 from iburinoc/matchoverlenwrite
...
execSequence copies up to 2*WILDCOPY_OVERLENGTH extra
2017-02-16 18:14:47 -08:00
ff176d3208
Merge pull request #548 from inikep/gz_compress
...
Circle CI tests
2017-02-16 14:57:59 -08:00
0ed3901b05
Update overlength match test case
2017-02-16 13:36:57 -08:00
887eaa9e21
Fix wildcopy overwriting data still in window
2017-02-15 16:43:45 -08:00
9b5a1e9d97
added circle.yml
2017-02-14 20:06:41 +01:00
74b81ada25
Don't run test-pool with QEMU
...
> make test -n
...
./pool
> make test -n QEMU_SYS=valgrind
...
./legacy
# ./pool not run
2017-02-14 10:08:18 -08:00
5069b6c2c3
Merge branch 'dev' into multiframe
2017-02-10 10:08:55 -08:00
a28c34cb7a
Merge pull request #538 from iburinoc/errorstring
...
Fix ZSTD_getErrorString and add tests
2017-02-10 03:59:56 -08:00
84b37cc1f1
Fix failing unit test
2017-02-09 12:27:39 -08:00
478d7174e5
Merge branch 'dev' into multiframe
2017-02-09 11:54:22 -08:00
2db7249265
Make pledgedSrcSize meaning clear for other functions
...
- Added tests
- Moved new size functions to static link only
2017-02-09 11:49:58 -08:00
80c1e04c33
Merge branch 'dev' into dev11
2017-02-09 09:42:16 +01:00
e0b3265e87
Fix ZSTD_getErrorString and add tests
2017-02-08 17:28:49 -08:00
f07ddf88e8
Test multiframe legacy decoding with simple and streaming APIs
2017-02-08 15:13:20 -08:00
ba2ad9f25c
ZSTD_decompress now handles multiple frames
2017-02-08 14:50:10 -08:00
4e709712e1
Decompressed size functions now handle multiframes and distinguish cases
...
- Add ZSTD_findDecompressedSize
- Traverses multiple frames to find total output size
- Add ZSTD_getFrameContentSize
- Gets the decompressed size of a single frame by reading header
- Deprecate ZSTD_getDecompressedSize
2017-02-08 14:50:10 -08:00
b5e46b1255
Remove test-longmatch from test target and only run it once
2017-02-08 12:00:21 -08:00
4b4f8c2d71
turn off test-pool for qemu-ppc64-static
2017-02-08 13:58:04 +01:00
48bed91606
Merge pull request #527 from facebook/zstdmt
...
zstdmt refinements
2017-01-31 16:36:46 -08:00
92c98a5b21
zstreamtest uses random section sizes for fuzzing
2017-01-30 12:50:31 -08:00
cd23dd24af
zstreamtest uses random overlapLog for fuzzing
2017-01-30 12:46:35 -08:00
64bf8ffce6
report @terrelln patch to ST fuzzer tests
2017-01-27 17:25:07 -08:00
d98bf49224
Fix segfault in zstreamtest MT
...
It was reading beyond the end of the input buffer because no errors were
detected. Once that was fixed, it wasn't making forward progress because
no errors were detected and it was waiting for input.
2017-01-27 15:42:36 -08:00
717c65d690
Merge pull request #519 from inikep/dev11
...
Dev11
2017-01-26 14:23:44 -08:00
8dafb1acf5
CLI : automatically set overlap size to max (windowSize) for max compression level
2017-01-25 17:01:13 -08:00
06e7697f96
added test of new parameter ZSTD_p_forceWindow
2017-01-25 16:39:03 -08:00
bb0027405a
fixed zstdmt corruption issue when enabling overlapped sections
...
see Asana board for detailed explanation on why and how to fix it
2017-01-25 16:25:38 -08:00
3bb010a667
.travis.yml: optimized order of short tests
2017-01-25 11:19:35 +01:00
bd6bc22612
playtest.sh : changed sdiff into $DIFF
2017-01-22 15:54:14 -08:00
317604e0ad
fixed : compilation of zstreamtest in dll mode
2017-01-20 17:18:41 -08:00
d7e3cb58c5
Resolved merge conflict dev+zstdmt
2017-01-20 16:44:50 -08:00
19d670ba9d
Added ZSTDMT_initCStream_advanced() variant
...
Correctly compress with custom params and dictionary
Added relevant fuzzer test in zstreamtest
Also :
new macro ZSTDMT_SECTION_LOGSIZE_MIN, which sets a minimum size for a full job
(note : a flush() command can still generate a partial job anytime)
2017-01-19 15:32:07 -08:00
0f984d94c4
changed MT enabling macro to ZSTD_MULTITHREAD
2017-01-19 14:05:07 -08:00
f22adae984
fixed minor warning (unused variable) in fuzzer
2017-01-19 13:46:30 -08:00
736788f8e8
added streaming fuzzer tests for MT API
...
Also : fixed corner case, where nb of jobs completed becomes > jobQueueSize
which is possible when many flushes are issued
while there is not enough dst buffer to flush completed ones.
2017-01-19 12:15:29 -08:00
8a0bc30a2d
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev11
2017-01-17 13:02:29 +01:00
d72f4b6b7a
added "Makefile is validated"
2017-01-17 12:40:06 +01:00
33fce03045
added test checking dictID when using ZSTD_initCStream_usingCDict()
...
It shows that dictID is not properly added into frame header
2017-01-16 19:46:22 -08:00
c44c4d5223
Fix missing 'OK' logging on fuzzer testcase
2017-01-12 09:38:33 -08:00
834ab50fa3
Fixed decompress_usingDict not propagating corrupted dictionary error
2017-01-11 17:31:34 -08:00
a8b4fe0481
Add COVER dictionary builder to fuzzer unit tests
2017-01-02 18:45:19 -08:00
3a1fefcf00
Simplify COVER parameters
2017-01-02 17:51:38 -08:00
cbb3ce376b
Add cover cli to playtests
2017-01-02 14:43:11 -08:00
5ca0fd2045
Shorten thread pool tests
2016-12-31 22:39:32 -05:00
d132433534
Switch thread pool test to threading.h
2016-12-31 19:10:13 -05:00
9c499648e3
Add thread pool tests
2016-12-29 23:41:03 -08:00
c07d2e3a31
Merge pull request #499 from inikep/dev11
...
improved *BSD and Solaris compatibility
2016-12-23 21:32:03 +01:00
78a0072d5a
Fix failing test due to deprecation warning
2016-12-22 17:36:16 -08:00
5f5a902453
"make test" is now compatible with Solaris
2016-12-22 18:05:07 +01:00
795d95309f
Merge pull request #493 from inikep/fullbench
...
Fullbench extDict variant
2016-12-21 15:12:06 +01:00
9d08597364
Add test for invalid offset rep codes
2016-12-20 11:13:45 -08:00
4beb51f17c
tests of ZSTD_compressContinue_extDict
2016-12-20 10:17:21 +01:00
d564faa3c6
fix : ZSTD_initCStream_srcSize() correctly set srcSize in frame header
2016-12-18 21:39:15 +01:00
31ff2a23be
fix Travis long test list;
...
added zbufftest-dll
2016-12-17 19:10:10 +01:00
d46ecb58a5
added dll compilation tests
2016-12-17 16:28:12 +01:00
61e62c014f
Test that all API symbols are exported
2016-12-16 13:29:23 -08:00
7d5e344ce5
Merge pull request #480 from inikep/dev11
...
advanced mode where each parameter can be selected on the command line
2016-12-15 22:27:50 +01:00
f9a56668a6
improved playTests.sh (3
2016-12-14 18:43:06 +01:00
24a4236111
improved playTests.sh (2)
2016-12-14 18:07:31 +01:00
ab5ed6fa7f
improved playTests.sh
2016-12-14 17:10:38 +01:00
9b4fa0ddf7
playTests.sh: added Advanced compression parameters
2016-12-14 16:50:00 +01:00
e795c8a5f6
Added ZSTD_initCStream_srcSize().
...
Added relevant test cases in zstreamtest
2016-12-13 17:00:14 +01:00
12df6da83b
Fix running test suite on FreeBSD
...
* Remove last bashism from tests/playTests.sh
* Use gmd5sum from the sysutils/coreutils port
2016-12-12 19:22:47 +01:00
c261f71f6a
minor variation of rescale fix
2016-12-12 00:25:07 +01:00
b547d212a1
Fix longmatch test build errors.
2016-12-10 23:17:36 -08:00
5cc85cf183
Switch uint64_t to U64
2016-12-10 19:31:55 -08:00
0acae734f1
Add exposing test case
2016-12-10 19:12:13 -08:00
94d1a93d28
changed environment variable comparison to sh compatible
2016-12-06 12:02:56 -08:00
f586bdfe23
fixed fuzzer test
2016-12-06 06:11:46 +01:00
825dffbc43
moved zbuff source files into lib/deprecated
2016-12-05 19:28:19 -08:00
e7a41a5955
added : dictID retrieval functions.
...
added : unit tests for dictID retrieval functions
2016-12-05 16:21:06 -08:00
7c6bbc3298
updated FIO_passThrough
2016-12-05 18:31:14 +01:00
6b508b1770
updated test-gzstd
2016-12-05 18:02:40 +01:00
9ffbeea875
API : changed : streaming decompression : implicit reset on starting new frames
2016-12-02 18:37:38 -08:00
743b33f57e
fix zstdcat
2016-12-02 15:18:57 -08:00
0efaf7e7b1
added test-gzstd
2016-11-30 15:20:24 +01:00
4f5350f610
long matches support overflow
2016-11-29 13:12:24 -08:00
cc3887085f
updated build\README.md
2016-11-21 13:58:58 +01:00
8bb86e330b
create DLL with Windows
2016-11-21 12:51:01 +01:00
0d761dbe95
Merge pull request #453 from inikep/dev11
...
fullbench-dll
2016-11-16 15:45:30 -08:00
52afb3993e
zbuff API now generates deprecation warnings
2016-11-16 08:50:54 -08:00
811b34d962
fix Visual Studio warnings
2016-11-15 19:02:39 +01:00
179555c1d1
working fullbench-dll
2016-11-15 18:05:46 +01:00
eb977a42ef
"file" moved to tests/Makefile
2016-11-14 17:26:58 +01:00
e579ab5faa
introduced QEMU_SYS
2016-11-14 12:57:05 +01:00
9adf7bfd8a
fixed MinGW compilation (2)
2016-11-03 15:38:13 +01:00
861cd06ded
fix test-zstd-nolegacy
2016-11-03 01:11:56 -07:00
4c0b44f8ce
minor display improvement in fuzzer when nb of tests is very large
2016-11-01 11:13:22 -07:00
589f011761
changed ZBUFF_* by ZSTD_*Stream() within fullbench,
...
in anticipation of future deprecation of ZBUFF_*.
2016-10-28 15:17:38 -07:00
b9550d6d43
fixed benchmark mode typo .
...
added benchmark mode tests
2016-10-28 14:43:24 -07:00
81c334b024
test-zstd-speed.py: default timeout changed to 1800 seconds
2016-10-28 20:40:21 +02:00
53e7f5c2e4
test-zstd-speed.py: converted to python3 and added "--timeout"
2016-10-28 19:24:16 +02:00
335ad5d4d4
added ZSTD_initDStream_usingDDict() .
...
slightly optimized ZSTD_initDStream() when no dictionary .
fixed ZSTD_sizeof_CStream() .
2016-10-25 17:47:02 -07:00
9516234e67
first sketch for ZSTD_initCStream_usingCDict()
2016-10-25 16:19:52 -07:00
5c5f01f3da
added ZSTD_btopt2 strategy
2016-10-25 12:25:07 +02:00
d7b120ab5c
added long commands --memory= and --memlimit-decompress=
2016-10-14 14:22:32 -07:00
1122349ac2
added long comment --memlimit=
2016-10-14 14:07:11 -07:00
d4cda27b63
new command -M#, to limit memory usage during decompression ( #403 )
2016-10-14 13:32:20 -07:00
a17fd7312a
changed error_public.h into zstd_errors.h
2016-10-11 16:41:09 -07:00
3e82f2b61a
Remove references to GPLv2 license
...
License headers added to Makefiles were taken from `zstd/Makefile`.
2016-10-11 15:28:40 -07:00
cf409a7e2a
fixed : init*_advanced() followed by reset() with different pledgedSrcSiz
2016-09-26 16:41:05 +02:00
2f2639438a
zstreamtest can fuzztest pledgedSrcSize
2016-09-26 14:06:08 +02:00
58d5dfea54
zstreamtest uses ZSTD_reset?Stream
2016-09-25 01:34:03 +02:00
97b378a6f8
Streaming : dictionary compression on multiple files / segments can correctly provide srcSize into header (when provided) using pledgedSrcSize.
2016-09-21 17:20:19 +02:00
714464f05d
fixed : cli : forgotten mandatory argument
2016-09-21 16:05:03 +02:00
27b5ac666e
Implemented "command must be followed by argument" protection
...
suggested by @terrelln (#375 )
2016-09-21 14:31:22 +02:00
3e70cf8036
Merge remote-tracking branch 'refs/remotes/facebook/dev' into dev
2016-09-15 20:41:40 +02:00
dd8905b351
test-zstd-speed.py: better description of options
2016-09-15 20:41:37 +02:00
ed0ea8d271
test-zstd-speed.py: added "-D dictName"
2016-09-15 20:31:29 +02:00
d28afac4f8
test-zstd-speed.py: added support for directories
2016-09-15 19:56:04 +02:00
55f276949c
removed option unsupported by travis
2016-09-15 17:23:15 +02:00
3e47dbcc8c
fixed memory leak
2016-09-15 17:00:02 +02:00
3ecbe6a37c
fileio uses ZSTD_resetDStream()
2016-09-14 17:26:59 +02:00
64deef3bee
Fixed srcSize=1
2016-09-14 00:16:07 +02:00
0be21d790a
fixed fullbench
2016-09-13 17:33:47 +02:00
0dad121a1a
test-zstd-speed.py: compiler version and MD5 in logs
2016-09-12 14:17:47 +02:00
b3060f7a9e
changed streaming decoder behavior : now, when all compressed frame is consumed, it means decompression is completed, with regenerated data fully flushed.
2016-09-09 16:44:16 +02:00
12083a45d4
more context-reuse tests
2016-09-06 15:01:51 +02:00
a7737f6a60
improved compression on small files when using same parameters
2016-09-06 09:44:59 +02:00
Paul Cruz
Yann Collet
Nick Terrell
Yann Collet
Sean Purcell
Przemyslaw Skibinski
Dimitry Andric
Yann Collet