9a8ccd4ba3
Add output-dir-mirror option
2020-06-24 22:12:11 -07:00
b1cce9a6ad
Short version string output
...
This adds support for just showing the version string
without the full welcome message if the log level is
less than the default. That means that you pass -q once
and you will just see "1.4.5".
This makes it easier to parse in scripts.
2020-06-09 08:40:41 +02:00
f13eb2ec01
Merge pull request #2123 from facebook/zstd_help
...
updated `zstd -h`
2020-05-11 18:54:07 -07:00
37b2dafbed
minor clarification on `-o file`
2020-05-08 14:20:47 -07:00
e5366bee16
updated `zstd -h`
...
to help readability.
Group arguments into categories,
try to give better visibility to more common arguments.
2020-05-08 14:14:46 -07:00
376c26bf56
Use Unused Variable
2020-05-08 16:43:39 -04:00
7dcca6bc64
Also Move programs/ Directory to Relative Includes
2020-05-04 15:20:26 -04:00
5b0a452cac
Adding --long support for --patch-from ( #1959 )
...
* adding long support for patch-from
* adding refPrefix to dictionary_decompress
* adding refPrefix to dictionary_loader
* conversion nit
* triggering log mode on chainLog < fileLog and removing old threshold
* adding refPrefix to dictionary_round_trip
* adding docs
* adding enableldm + forceWindow test for dict
* separate patch-from logic into FIO_adjustParamsForPatchFromMode
* moving memLimit adjustment to outside ifdefs (need for decomp)
* removing refPrefix gate on dictionary_round_trip
* rebase on top of dev refPrefix change
* making sure refPrefx + ldm is < 1% of srcSize
* combining notes for patch-from
* moving memlimit logic inside fileio.c
* adding display for optimal parser and long mode trigger
* conversion nit
* fuzzer found heap-overflow fix
* another conversion nit
* moving FIO_adjustMemLimitForPatchFromMode outside ifndef
* making params immutable
* moving memLimit update before createDictBuffer call
* making maxSrcSize unsigned long long
* making dictSize and maxSrcSize params unsigned long long
* error on files larger than 4gb
* extend refPrefix test to include round trip
* conversion to size_t
* making sure ldm is at least 10x better
* removing break
* including zstd_compress_internal and removing redundant macros
* exposing ZSTD_cycleLog()
* using cycleLog instead of chainLog
* add some more docs about user optimizations
* formatting
2020-04-17 15:58:53 -05:00
ac58c8d720
Fix copyright and license lines
...
* All copyright lines now have -2020 instead of -present
* All copyright lines include "Facebook, Inc"
* All licenses are now standardized
The copyright in `threading.{h,c}` is not changed because it comes from
zstdmt.
The copyright and license of `divsufsort.{h,c}` is not changed.
2020-03-26 17:02:06 -07:00
43874730f4
Adding --content-size
2020-03-09 14:19:05 -05:00
6d8e761ba3
Inverting content size prefs bool
2020-03-09 14:16:10 -05:00
03ee18d9c5
Adding (void)noContentSize
2020-03-09 14:00:52 -05:00
167244a64f
--no-content-size cli
2020-03-09 13:07:29 -05:00
23165b387e
Adding hashLog to --show-default-cparams
2020-02-27 13:56:56 -08:00
834d06b655
Allow some cli options to accept numeric values up to size_t instead of unsigned int
2020-02-20 14:29:58 -05:00
4e728e26ca
Fix integer parsing in cli ( #2003 )
2020-02-18 15:30:59 -08:00
f627e1a1ae
Displaying level in --show-default-cparams ( #1991 )
...
* Displaying level in --show-default-cparams
* Displaying actual enum value instead of level
2020-02-06 13:51:43 -08:00
d1389ac3ff
Adding assert(NB_STRATEGIES == upperLimit)
2020-02-03 09:52:39 -08:00
19473390d1
Adding (void)ZSTD_strategyMap
2020-01-31 10:54:02 -08:00
38d010eea0
Adding static assert and using it in cli
2020-01-31 10:47:17 -08:00
9d9cfa9ef9
Adding assert and using ZSTD_STRATEGY_MAX as ZSTD_NB_STRATEGIES
2020-01-30 17:54:01 -08:00
6ad2f0d7d6
Adding back one cast and using UTIL_FILESIZE_UNKNOWN to check unknown file size
2020-01-30 17:16:02 -08:00
c203341292
Removing more casts
2020-01-30 17:07:58 -08:00
2a0771cfdb
Removing unnecessary cast
2020-01-30 17:05:33 -08:00
b0ceab4dc0
Moving default cparams back, checking for unknown file size, using getCParams()
2020-01-30 16:52:07 -08:00
b660ef87f8
Convertion nit U32 -> size_t
2020-01-30 14:29:04 -08:00
71754a26f8
Update comment
2020-01-30 14:14:27 -08:00
2f10019b92
Adding --show-default-cparams (show cparams before compressing
2020-01-30 14:12:03 -08:00
fa48af545f
Add --single-thread to zstd --help
2020-01-17 13:54:49 -08:00
f25a6e9f8f
Adding new cli endpoint --patch-from= ( #1940 )
...
* Adding new cli endpoint --diff-from=
* Appveyor conversion nit
* Using bool set trick instead of direct set
* Removing --diff-from and only leaving --diff-from=#
* Throwing error when both dictFileName vars are set
* Clean up syntax
* Renaming diff-from to patch-from
* Revering comma separated syntax clean up
* Updating playtests with patch-from
* Uncommenting accidentally commented
* Updating remaining docs and var names to be patch-from instead of diff-from
* Constifying
* Using existing log2 function and removing newly created one
* Argument order (moving prefs to end)
* Using comma separated syntax
* Moving to outside #ifndef
2020-01-10 14:25:24 -08:00
4b4de7493f
refactoring : remove global variable g_displayOut
...
displaying into stderr or stdout is now an explicit operation,
no longer depending on some global state set elsewhere in the code.
2019-12-02 16:19:03 -08:00
a49417b5af
fix recent issue combining -r with empty list of input files
...
This would resize the table of input filenames to zero,
delivering an empty table,
to which it was no longer possible to add stdin.
2019-12-02 14:28:18 -08:00
c71bd45a3b
Merge branch 'dev' into ahmed_file
2019-11-26 11:20:26 -08:00
9a22140ef4
created UTIL_chmod()
...
protecting "/dev/null" from having its permissions changed.
also : minor : improved consistency of util.h API
2019-11-25 13:45:22 -08:00
31a0abbfda
updated pzstd and largeNbDicts to use the new FileNamesTable* abstraction
2019-11-06 09:10:05 -08:00
b09f59390b
refactor code to only use FileNamesTable*
2019-11-05 17:02:43 -08:00
81c51483e9
Merge branch 'dev' into ahmed_file
2019-11-05 14:44:12 -08:00
47034cd6c3
Merge pull request #1850 from bimbashrestha/named_pipes
...
Gating named pipe support on windows
2019-10-30 12:18:58 -07:00
0f2bff2faf
Addressing comments, removing cyclic dependency with header file, updating tests
2019-10-28 18:21:47 -07:00
0e9a37daeb
Fixing tests and moving flag to advanced usage
2019-10-28 15:22:26 -07:00
f422914619
Resolving local merge conflicts
2019-10-28 15:15:13 -07:00
02433e0b15
Addressing comments: -Created a list of extensions defined in fileio.h, -Updated test
2019-10-28 14:54:54 -07:00
48f856640e
Added --exclude-compressed flag feature that skips compression of precompressed files
2019-10-28 13:57:40 -07:00
d7f258d845
change command name to `--filelist=`
...
updated documentation and man page
2019-10-28 13:54:36 -07:00
b40eaced94
minor cosmetic refactoring
2019-10-25 18:16:45 -07:00
5fb84ca2cf
no need to track tableBuf
...
free() is compatible with NULL,
let's free() unconditionnally
2019-10-25 17:34:29 -07:00
1ead0c5d5a
improved --file=FILE implementation
...
pass basic tests
2019-10-25 16:36:59 -07:00
55ee7d56e4
Added --exclude-compressed flag feature that skips compression of precompressed files
2019-10-25 15:49:11 -07:00
5e59d51991
Merge branch 'master' of https://github.com/bimbashrestha/zstd into named_pipes
2019-10-25 15:43:41 -07:00
0b52d878b2
Cleaning up gate and adding comment to flag
2019-10-25 14:06:50 -07:00
5b45ff4f1c
Gating named file support on windows
2019-10-25 11:32:38 -07:00
14e9010bb5
Merge pull request #1844 from AhmedAbdellah19/adding_read_files_from_file_feature
...
Adding --file=FILE feature
2019-10-25 10:11:47 -07:00
37f90930da
Merge pull request #1839 from bimbashrestha/named_pipes
...
Allowing named pipes to go through in zstdcli
2019-10-24 10:53:12 -07:00
0b3096596a
fixing AppVeyor errors
2019-10-24 15:25:48 +01:00
cddb05ef8c
fixing some warning
2019-10-24 14:42:37 +01:00
849b8c6de8
fixing continuous integeration errors and removing a lot of logs
2019-10-24 11:10:13 +01:00
aefa18ee38
fixing c90 issue in util.c
2019-10-24 10:12:51 +01:00
f43e45954f
fixing memory leak issue and removing c90 issue
2019-10-24 09:39:16 +01:00
8cbe42fcb0
solving the rest of C90 issues in defining local variables in middle of code and comparing uncompatible types
2019-10-23 20:22:07 +01:00
9a454e9724
solving C90 issues in defining local variables in middle of code and comparing uncompatible types
2019-10-23 20:15:18 +01:00
7a732e2bb2
Merge branch 'dev' into adding_read_files_from_file_feature
2019-10-23 20:29:01 +02:00
8a3974807e
Allowing named pipes to go through zstdcli
2019-10-22 15:23:22 -07:00
989e0f0cee
Added --output-dir-flat=
...
which is a preferred construction when applicable.
Also, added --output-dir-flat into man page.
2019-10-21 14:39:18 -07:00
0ee360982d
improved test mode `-t`
...
The test mode do no longer open a file `/dev/null` nor write anything to output.
This is supposed to be more efficient than writing to `/dev/null`,
and more universal too : the previous method was failing on Windows.
2019-10-17 16:09:53 -07:00
1795133c45
refactored FIO_compressMultipleFilenames() prototype
...
for consistency
2019-10-17 15:32:03 -07:00
7f86ae2867
fixed multiple implicit casts
2019-10-17 15:27:25 -07:00
779ea72953
Adding --file=FILE feature
2019-10-15 07:49:13 +01:00
64bc441d7d
Now constructs final destination path without allocating new table
2019-10-03 13:53:04 -04:00
4dc604cab8
Addressed comments on malloc
2019-10-02 18:34:42 -04:00
c763457e0a
Static analyze fix
2019-10-02 15:30:24 -04:00
1e4d602412
Modified message
2019-10-02 11:11:35 -04:00
f80437c586
Add support for --output-dir-flat
...
New flag to specify output directory destination for multiple files.
2019-10-02 11:08:20 -04:00
62616c4d90
fixes for windows compilation
2019-09-06 13:20:50 -07:00
30bff50e06
fixes for tests and segfault
2019-09-06 11:10:53 -07:00
a9c807a948
kill memory leaks, cleanup, fix some dumb bugs
2019-09-06 10:17:04 -07:00
6beb3c0159
added decompression support
2019-09-05 17:56:24 -07:00
7f98b46876
adding support for -O flag: multiple files into one directory for compressions (decompression to come)
2019-09-05 16:03:35 -07:00
493f95c7df
Fix merge conflicts
2019-08-22 11:51:41 -07:00
dffbac5f89
Add --size-hint=# option
2019-08-19 11:38:49 -07:00
af0c9501d1
Add --stream-size=# command
2019-08-16 11:34:39 -07:00
04a9d6b828
fix compiling errors with clang-8
...
Compiling with clang-8 fails with the following errors:
largeNbDicts.c:562:37: error: implicit conversion turns floating-point
number into integer: 'const double' to 'U64' (aka 'unsigned long')
[-Werror,-Wfloat-conversion]
U64 const dTime_ns = result.nanoSecPerRun;
~~~~~~~~ ~~~~~~~^~~~~~~~~~~~~
zstdcli.c:300:5: error: '@return' command used in a comment that is
not attached to a function or method declaration
[-Werror,-Wdocumentation]
* @return 1 means that cover parameters were correct
~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
zstdcli.c:301:5: error: '@return' command used in a comment that is
not attached to a function or method declaration
[-Werror,-Wdocumentation]
* @return 0 in case of malformed parameters
~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2019-07-18 19:41:00 -07:00
096714d1b8
Merge pull request #1671 from ephiepark/dev
...
Adding targetCBlockSize param
2019-07-03 17:47:44 -07:00
9007701670
Adding targetCBlockSize param
2019-07-03 15:41:52 -07:00
c55d2e7ba3
Adding shrinking flag for cover and fastcover ( #1656 )
...
* Changed ERROR(GENERIC) excluding inits
* editing git ignore
* Edited init functions to size_t returns
* moved declarations earlier
* resolved issues with changes to init functions
* fixed style and an error check
* attempting to add tests that might trigger changes
* added && die to cases expecting to fail
* resolved no die on expected failed command
* fixed accel to be incorrect value
* Adding an automated shrinking option
* Fixing build
* finalizing fixes
* fix?
* Removing added comment in cover.h
* Styling fixes
* Merging with fb dev
* removing megic number for default regression
* Requested revisions
* fixing support for fast cover
* fixing casting errors
* parenthesis fix
* fixing some build nits
* resolving travis ci syntax
* might resolve all compilation issues
* removed unused variable
* remodeling the selectDict function
* fixing bad memory access
* fixing error checks
* fixed erroring check in selectDict
* fixing mixed declarations
* modify mixed declaration
* fixing nits and adding test cases
* Adding requested changes + fixed bug for error checking
* switched double comparison from != to <
* fixed declaration typing
* refactoring COVER_best_finish() and changing shrinkDict
* removing the const's
* modifying ZDICT_optimizeTrainFromBuffer_cover functions
* fixing potential bad memcpy
* fixing the error function for dict size
2019-06-27 16:26:57 -07:00
c4a40dbf65
set followLinks option true to cat, zcat and gzcat programs
2019-04-27 19:06:29 -04:00
a880ca239b
Spelling ( #1582 )
...
* spelling: accidentally
* spelling: across
* spelling: additionally
* spelling: addresses
* spelling: appropriate
* spelling: assumed
* spelling: available
* spelling: builder
* spelling: capacity
* spelling: compiler
* spelling: compressibility
* spelling: compressor
* spelling: compression
* spelling: contract
* spelling: convenience
* spelling: decompress
* spelling: description
* spelling: deflate
* spelling: deterministically
* spelling: dictionary
* spelling: display
* spelling: eliminate
* spelling: preemptively
* spelling: exclude
* spelling: failure
* spelling: independence
* spelling: independent
* spelling: intentionally
* spelling: matching
* spelling: maximum
* spelling: meaning
* spelling: mishandled
* spelling: memory
* spelling: occasionally
* spelling: occurrence
* spelling: official
* spelling: offsets
* spelling: original
* spelling: output
* spelling: overflow
* spelling: overridden
* spelling: parameter
* spelling: performance
* spelling: probability
* spelling: receives
* spelling: redundant
* spelling: recompression
* spelling: resources
* spelling: sanity
* spelling: segment
* spelling: series
* spelling: specified
* spelling: specify
* spelling: subtracted
* spelling: successful
* spelling: return
* spelling: translation
* spelling: update
* spelling: unrelated
* spelling: useless
* spelling: variables
* spelling: variety
* spelling: verbatim
* spelling: verification
* spelling: visited
* spelling: warming
* spelling: workers
* spelling: with
2019-04-12 11:18:11 -07:00
094c000904
Merge branch 'dev' into benchfn
2019-04-10 11:57:05 -07:00
90c0462d63
minor presentation refactoring
...
and removed some // comment style
2019-04-10 10:03:06 -07:00
19ca3fbc03
[zstdcli] Respect --[no-]compress-literals in benchmark mode
2019-02-15 16:27:39 -08:00
0c53c5ad4a
[zstdcli] Add a flag to control literals compression
2019-02-15 15:00:45 -08:00
482b84f07b
Make detection of symbolic links more consistent
...
While fixing the detection of symbolic links on OpenBSD I noticed
inconsistent behaviour:
$ echo hello > hello
$ ln -s hello world
$ zstd hello world
Warning : world is a symbolic link, ignoring
hello :316.67% ( 6 => 19 bytes, hello.zst
$ ls *.zst
hello.zst
$ zstd world
world :316.67% ( 6 => 19 bytes, world.zst)
$ ls *.zst
hello.zst world.zst
2019-02-12 01:56:05 +01:00
5e220bf4b5
Remove global parameters, pass into public functions instead
2019-01-23 16:06:27 -08:00
9b2d708850
change function name: _readU32FromChar() -> readU32FromCharChecked()
2018-12-19 23:41:18 -08:00
f7b1841b6f
make init_cLevel(...) static
2018-12-19 17:56:45 -08:00
30ffc24ad7
fix the code ahead of declaration issue
2018-12-19 17:49:04 -08:00
0700335f57
change int init_cLevel() to int init_cLevel(void)
2018-12-19 17:38:28 -08:00
26a9ae3f5f
refactor readU32FromChar(...), improve init_cLevel(...), and add env var ZSTD_CLEVEL tests
2018-12-19 16:45:42 -08:00
5324b1e386
add support for setting compression level through environment variable ZSTD_CLEVEL
2018-12-19 13:26:27 -08:00
bdfcaecc0a
[zstdcli] Add --no-progress flag
...
The `--no-progress` flag disables zstd's progress bars, but leaves
the summary.
I've added simple tests to `playTests.sh` to make sure the parsing
works.
2018-12-14 11:50:25 -08:00
9c3265a53f
Merge pull request #1417 from facebook/advancedAPI
...
Advanced API
2018-12-10 18:48:15 -08:00
Xin Xie
Tobias Hieta
Yann Collet
Yann Collet
W. Felix Handte
Bimba Shrestha
Nick Terrell
Lehman Garrison
Philip Jones
Nick Terrell
Shashank Tavildar
Ahmed Abdellah
Sen Huang
Nick Magerko
Qin Li
Ephraim Park
Tyler-Tran
cev
Josh Soref
Björn Ketelaars
Karl Ostmo
Yi Jin
Yi Jin