209df52ba2
Changed nbThreads for nbWorkers
...
This makes it easier to explain that nbWorkers=0 --> single-threaded mode,
while nbWorkers=1 --> asynchronous mode (one mode thread on top of the "main" caller thread).
No need for an additional asynchronous mode flag.
nbWorkers>=2 works the same as nbThreads>=2 previously.
2018-02-01 19:29:30 -08:00
4680e85bdf
Allow -o with multiple files
2017-12-13 17:44:34 -08:00
eb3327c10a
Merge branch 'dev' of https://github.com/facebook/zstd into ldm-mergeDev
2017-09-11 15:00:01 -07:00
3128e03be6
updated license header
...
to clarify dual-license meaning as "or"
2017-09-08 00:09:23 -07:00
67d4a6161c
Add ldmBucketSizeLog param
2017-09-02 21:55:29 -07:00
a1f04d518d
Move hashEveryLog to cctxParams and update cli
2017-09-01 15:05:47 -07:00
17d8e0bdcc
Merge remote-tracking branch 'upstream/longRangeMatcher' into ldm-integrate
2017-09-01 10:19:38 -07:00
6a546efb8c
Add long distance matcher
...
Move last literals section to ZSTD_block_internal
2017-08-31 12:53:19 -07:00
32fb407c9d
updated a bunch of headers
...
for the new license
2017-08-18 16:52:05 -07:00
bda57754a2
moved signifcant operations to fileio.c
2017-06-20 12:43:10 -07:00
0f06f4f266
added display for compressed size
2017-06-06 09:21:42 -07:00
901435e9ef
setup basic functions for adding --list functionality
2017-06-05 14:45:31 -07:00
4de8632957
Add LZ4 compress/decompress support to CLI
2017-04-24 16:48:25 -07:00
aa8bcf360f
Add xz and lzma support.
...
Finish feature started by @inikep.
* Add xz and lzma compression and decompression support to target `xzstd`.
* Fix bug in gzip decompression that silently accepted truncated files.
* Add gzip frame composition tests.
* Add xz/lzma compatibility tests.
* Add xz/lzma frame composition tests.
2017-03-13 18:45:41 -07:00
98509a70ac
fixed function name
2017-02-14 09:23:32 +01:00
cfd4dc299a
add "--format=gzip" option
2017-02-08 15:17:55 +01:00
6be2337c26
added command --block-size=
...
for Multi-threading only.
alias : -B#
2017-01-30 11:17:26 -08:00
8dafb1acf5
CLI : automatically set overlap size to max (windowSize) for max compression level
2017-01-25 17:01:13 -08:00
512cbe8c10
zstdmt cli and API allow selection of section sizes
...
By default, section sizes are 4x window size.
This new setting allow manual selection of section sizes.
The larger they are, the (slightly) better the compression ratio,
but also the higher the memory allocation cost,
and eventually the lesser the nb of possible threads,
since each section is compressed by a single thread.
It also introduces a prototype to set generic parameters,
ZSTDMT_setMTCtxParameter()
The idea is that it's possible to add enums
to extend the list of parameters that can be set this way.
This is more long-term oriented than a fixed-size struct.
Consider it as a test.
2017-01-24 17:08:53 -08:00
500014af49
zstd cli can now compress using multi-threading
...
added : command -T#
added : ZSTD_resetCStream() (zstdmt_compress)
added : FIO_setNbThreads() (fileio)
2017-01-19 17:04:28 -08:00
8349d675e0
fileio.c: support advanced compression parameters
2016-12-13 13:24:59 +01:00
743b33f57e
fix zstdcat
2016-12-02 15:18:57 -08:00
d0815583d9
Changed stdinmark and stdoutmark
2016-11-04 11:37:27 +01:00
d4cda27b63
new command -M#, to limit memory usage during decompression ( #403 )
2016-10-14 13:32:20 -07:00
a6bdf55759
fixed memory leak
2016-09-15 17:02:06 +02:00
43eeea4725
fileio uses ZSTD_resetCStream()
2016-09-15 15:38:44 +02:00
4ded9e591c
added boilerplate
2016-08-30 11:06:28 -07:00
b402490546
fixed #260 , reported by @amnilsson
2016-07-26 00:49:47 +02:00
b09b12ce10
Added command `--rm` : remove source file after successful de/compression
2016-06-09 23:01:19 +02:00
87cfbe3e5f
checksum generation can be selected from command line (`--checksum`)
2016-06-01 19:22:15 +02:00
6381e99fb2
Added : ability to create compressed frames without dictID
2016-05-31 02:29:45 +02:00
75424d1139
Added : Sparse write support
...
--[no-]sparse command
2016-05-23 16:56:56 +02:00
8a1d1a6a6c
implemented `--ultra` mode protection
2016-03-10 21:02:25 +01:00
accfd80c37
Added : option `-t` to test compressed files integrity
2016-02-15 19:33:16 +01:00
f062436fa6
cli : added ability to compress multiple files into stdout (-c)
2016-02-12 15:56:46 +01:00
883a67eee2
fixed cmake
2016-02-12 03:50:05 +01:00
c8da2c9f8f
updated tests
2016-02-12 02:56:27 +01:00
deb078b9b1
added : -m : decompress multiple files
2015-12-17 20:30:14 +01:00
9d90922d49
refactored file compression
2015-12-17 14:09:55 +01:00
4f13703b2f
added : -m : compress multiple files in a single command
2015-12-17 02:23:58 +01:00
f6f3d7526a
external dictionary capability added to command line
2015-12-13 13:35:21 +01:00
2acb5d3d48
HC modes can be selected from command line
2015-10-29 16:49:43 +01:00
f3eca25322
quick first zstdhc version
2015-10-22 15:31:46 +01:00
439eb77088
Normalize all the line endings
2015-01-31 10:52:59 +01:00
04d8e15e57
fixed : file permissions
2015-01-24 11:22:13 +01:00
4856a00164
Initial release
2015-01-24 01:58:16 +01:00
Yann Collet
Nick Terrell
Stella Lau
Paul Cruz
Sean Purcell
Przemyslaw Skibinski
Yann Collet