f9de54acfb
reduced memory requirements for --long tests
...
in new --long test section
2017-09-27 15:38:27 -07:00
60059df051
shorter make test to avoid time out on travis CI
...
Timed tests (fuzzer) are reduced
Long tests are shortened (less data generated)
2017-09-27 15:16:27 -07:00
c233bdbaee
Increase maximum window size
...
* Maximum window size in 32-bit mode is 1GB, since allocations for 2GB fail
on my Mac.
* Maximum window size in 64-bit mode is 2GB, since that is the largest
power of 2 that works with the overflow prevention.
* Allow `--long=windowLog` to set the window log, along with
`--zstd=wlog=#`. These options also set the window size during
decompression, but don't override `--memory=#` if it is set.
* Present a helpful error message when the window size is too large during
decompression.
* The long range matcher defaults to a hash log 7 less than the window log,
which keeps it at 20 for window log 27.
* Keep the default long range matcher window size and the default maximum
window size at 27 for the API and CLI.
* Add tests that use the maximum window size and hash size for compression
and decompression.
2017-09-26 14:00:01 -07:00
62568c9a42
added capability to generate magic-less frames
...
decoder not implemented yet
2017-09-25 14:26:26 -07:00
1fe762e236
[zstdcli] Fix LDM advanced options parsing
2017-09-18 14:49:35 -07:00
17d8e0bdcc
Merge remote-tracking branch 'upstream/longRangeMatcher' into ldm-integrate
2017-09-01 10:19:38 -07:00
6a546efb8c
Add long distance matcher
...
Move last literals section to ZSTD_block_internal
2017-08-31 12:53:19 -07:00
3587556873
[cover] Test small maxdict
2017-08-21 11:16:47 -07:00
abe12b3399
[libzstd] Fix bug in Huffman decompresser
...
The zstd format specification doesn't enforce that Huffman compressed
literals (including the table) have to be smaller than the uncompressed
literals. The compressor will never Huffman compress literals if the
compressed size is larger than the uncompressed size. The decompresser
doesn't accept Huffman compressed literals with 4 streams whose compressed
size is at least as large as the uncompressed size.
* Make the decompresser accept Huffman compressed literals whose size
increases.
* Add a test case that exposes the bug. The compressed file has to be
statically generated, since the compressor won't normally produce files
that expose the bug.
2017-08-07 12:37:48 -07:00
d0b27483ae
[zstdcli] Fix -t in streaming mode
2017-07-18 14:45:49 -07:00
3a60efd3a9
policy change : ZSTDMT automatically caps nbThreads to ZSTDMT_NBTHREADS_MAX ( #760 )
...
Previously, ZSTDMT would refuse to create the compressor.
Also : increased ZSTDMT_NBTHREADS_MAX to 256,
updated doc,
and added relevant test
2017-07-13 10:17:23 -07:00
4616fad18b
improved ZSTDMT_compress() memory usage
...
does not need the input buffer for streaming operations
also : reduced a few tests time length
2017-07-10 17:16:41 -07:00
6aeb50ea0d
[zstdcli] Add unlzma and unxz symlinks
2017-06-26 11:24:36 -07:00
c16748b137
added test cases for new command --list
2017-06-21 12:09:53 -07:00
db3606e249
added test for files with no frame content size
2017-06-20 17:43:36 -07:00
a73c2a444a
added tests with null files, changed condition to check that the file is more than 0 bytes
2017-06-20 14:33:08 -07:00
58c19b4202
spacing matters for test scripts
2017-06-20 14:14:53 -07:00
b07d0af2ba
added additional tests for error detection
2017-06-20 11:54:44 -07:00
6a99de2dd8
change test to list info on .zst files
2017-06-20 10:45:06 -07:00
ddd1ab710c
added tests in playTest.sh
2017-06-15 16:53:03 -07:00
01a1abfdb5
cli : -d and -t do not stop after a failed decompression
...
The problematic srcfile will be named on console/log,
but decompression/test will continue onto next file in the list.
2017-05-05 19:15:24 -07:00
f376d47c11
[CLI] Switch dictionary builder on CLI to cover
2017-05-02 11:18:27 -07:00
4de8632957
Add LZ4 compress/decompress support to CLI
2017-04-24 16:48:25 -07:00
230d7acc7d
cli : add support for --threads=# command
...
updated documentation
add relevant test case
2017-04-21 11:38:13 -07:00
d845dab69c
Fix input size too small to trigger zstdmt
2017-04-17 12:10:58 -07:00
c424ec2eae
Add multithreading tests to playTests.sh
2017-04-17 11:41:46 -07:00
d37e1df2ab
Fix message
2017-04-11 17:33:26 -07:00
eb70d219fd
Add test of file > 4GB to playTests
2017-04-11 17:15:13 -07:00
1652172b2d
Add refuse to overwrite test and fix format
2017-04-06 17:06:30 -07:00
9da11c6aae
Add test for overwriting read-only
2017-04-06 12:58:49 -07:00
4c41d37fcc
changed test for new syntax
...
--dictID= and --maxdict=
2017-03-24 18:36:56 -07:00
f332ece468
dictBuilder fails to create dictionary on certain input
...
Properly expressed with an error code (see zstd_errors.h)
and a cli return code != 0
2017-03-23 16:24:02 -07:00
680e4e0953
Ignore symbolic links unless --force specified
2017-03-23 11:52:09 -07:00
9a38dfa794
Only run IS_CONSOLE tests with a TTY
2017-03-17 12:32:18 -07:00
d973071e90
Add tests for compressed data on console
2017-03-16 16:25:19 -07:00
aa8bcf360f
Add xz and lzma support.
...
Finish feature started by @inikep.
* Add xz and lzma compression and decompression support to target `xzstd`.
* Fix bug in gzip decompression that silently accepted truncated files.
* Add gzip frame composition tests.
* Add xz/lzma compatibility tests.
* Add xz/lzma frame composition tests.
2017-03-13 18:45:41 -07:00
27526c7201
make : added target shortest
...
shortest only run fast part of playTests.sh .
cc @iburinoc
2017-03-01 17:02:49 -08:00
c1c040eae1
added gzip tests
...
also : made sure zstd --format=gzip -V
would fail if gzip compatibility is not supported
2017-03-01 16:49:20 -08:00
a81c2e7e44
Merge pull request #573 from facebook/ddict
...
Improved DDict memory usage
2017-02-27 20:54:42 -08:00
67d86a74a5
added test case : --rm on stdin
...
must remain silent (instead of failing)
2017-02-27 16:09:20 -08:00
bd7fa21deb
added ZSTD_refDDict()
...
Now DDict does no longer depends on DCtx duplication
2017-02-26 14:43:07 -08:00
bd6bc22612
playtest.sh : changed sdiff into $DIFF
2017-01-22 15:54:14 -08:00
3a1fefcf00
Simplify COVER parameters
2017-01-02 17:51:38 -08:00
cbb3ce376b
Add cover cli to playtests
2017-01-02 14:43:11 -08:00
5f5a902453
"make test" is now compatible with Solaris
2016-12-22 18:05:07 +01:00
f9a56668a6
improved playTests.sh (3
2016-12-14 18:43:06 +01:00
24a4236111
improved playTests.sh (2)
2016-12-14 18:07:31 +01:00
ab5ed6fa7f
improved playTests.sh
2016-12-14 17:10:38 +01:00
9b4fa0ddf7
playTests.sh: added Advanced compression parameters
2016-12-14 16:50:00 +01:00
12df6da83b
Fix running test suite on FreeBSD
...
* Remove last bashism from tests/playTests.sh
* Use gmd5sum from the sysutils/coreutils port
2016-12-12 19:22:47 +01:00
94d1a93d28
changed environment variable comparison to sh compatible
2016-12-06 12:02:56 -08:00
743b33f57e
fix zstdcat
2016-12-02 15:18:57 -08:00
4f5350f610
long matches support overflow
2016-11-29 13:12:24 -08:00
eb977a42ef
"file" moved to tests/Makefile
2016-11-14 17:26:58 +01:00
e579ab5faa
introduced QEMU_SYS
2016-11-14 12:57:05 +01:00
b9550d6d43
fixed benchmark mode typo .
...
added benchmark mode tests
2016-10-28 14:43:24 -07:00
d7b120ab5c
added long commands --memory= and --memlimit-decompress=
2016-10-14 14:22:32 -07:00
1122349ac2
added long comment --memlimit=
2016-10-14 14:07:11 -07:00
d4cda27b63
new command -M#, to limit memory usage during decompression ( #403 )
2016-10-14 13:32:20 -07:00
714464f05d
fixed : cli : forgotten mandatory argument
2016-09-21 16:05:03 +02:00
27b5ac666e
Implemented "command must be followed by argument" protection
...
suggested by @terrelln (#375 )
2016-09-21 14:31:22 +02:00
3ecbe6a37c
fileio uses ZSTD_resetDStream()
2016-09-14 17:26:59 +02:00
b3060f7a9e
changed streaming decoder behavior : now, when all compressed frame is consumed, it means decompression is completed, with regenerated data fully flushed.
2016-09-09 16:44:16 +02:00
c843142ad0
zstd -d writes to stdout when input is stdin
2016-09-01 15:05:57 -07:00
bb93d77ab8
reinforced fix for huge files
2016-08-25 22:22:50 +02:00
94376acfb0
fixed test on CentOS7
2016-08-25 19:09:21 +02:00
24a738c668
removed TRAVIS_OS_NAME
2016-08-25 15:15:06 +02:00
70e3b31306
fixed playtests on os-x
2016-08-23 01:18:06 +02:00
b7d3449d5d
playTests.sh working with tests/
2016-08-18 15:13:41 +02:00
6ca9b853a1
cmake project: fixed include directories
2016-08-18 14:42:28 +02:00
63e335704e
updated scripts +x permissions
2016-08-18 14:04:57 +02:00
2868d565e4
test-related files moved to tests/
2016-08-18 13:18:11 +02:00
Yann Collet
Nick Terrell
Stella Lau
Paul Cruz
Sean Purcell
Yann Collet
Przemyslaw Skibinski
Dimitry Andric