facebook
/
zstd
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,061 Commits
2 Branches
0 Tags
28 MiB
Commit Graph

656 Commits (bfae317ae3b3f768a648cb48d59d9ceed88a968d)

Author SHA1 Message Date
Yann Collet dd25a27702 added tutorial warning messages for dictBuilder 2016-07-27 12:43:09 +02:00
Yann Collet fbd557d5c2 multi-files -t doesn't stop after detecting magic number read failure 2016-07-26 17:13:58 +02:00
Yann Collet a1dd6b97d2 fixed null-length round trip 2016-07-26 16:44:09 +02:00
Yann Collet 7adc2328a3 fixed --test on zero-length files, reported by @amnilsson 2016-07-26 15:49:24 +02:00
Yann Collet 9cebec21e1 Merge pull request #259 from inikep/dev08 
legacy decoder for v0.7 format
 2016-07-26 15:13:05 +02:00
inikep 7bc5c6b5cb util.h: detect if an error occurs in readdir() (thanks to Jim Meyering) 2016-07-26 11:07:37 +02:00
Yann Collet 24a3d90bf0 strengthened integrity tests 2016-07-26 01:33:20 +02:00
Yann Collet b402490546 fixed #260, reported by @amnilsson 2016-07-26 00:49:47 +02:00
inikep fca90f8f60 legacy decoder for v0.7 format 2016-07-25 17:49:08 +02:00
Yann Collet e5a817a2d8 better MOREFLAGS 2016-07-24 17:46:05 +02:00
Yann Collet 10b9c13d07 fixed doc on cLevel default, reported by Oliver Lange 2016-07-24 01:21:53 +02:00
Yann Collet f8e7b5363f unified encoding types 2016-07-23 16:31:49 +02:00
Yann Collet b752298d1d fixed 32-bits compilation 2016-07-22 14:37:09 +02:00
Yann Collet 32faf6c8e7 fixed conversion warnings 2016-07-22 14:37:09 +02:00
Yann Collet 5e45a5fbb3 force loop-align to 32 for zstd_decompress 2016-07-22 14:37:09 +02:00
Yann Collet 5288ac0cb7 changed filed order 2016-07-22 14:37:09 +02:00
Yann Collet 6fa05a2371 cBlockSize uses little-endian convention 2016-07-22 14:37:09 +02:00
Yann Collet 06dd74114a minor : long tests display progression status 2016-07-18 04:06:43 +02:00
Yann Collet 85f3919960 moved `zstd.h` to `/lib` 2016-07-17 20:42:21 +02:00
Yann Collet 988bcf360a -v and --verbose increase display level by 1 2016-07-15 19:43:30 +02:00
Yann Collet d3d2db587e adapted fuzzer test to new blockSizeMax rule for ZSTD_compressBlock() 2016-07-15 12:20:26 +02:00
Yann Collet 227cc39e15 improved efficiency for large messages with small dictionaries 2016-07-15 11:27:09 +02:00
Yann Collet e20d5cf117 fixed paramgrill 2016-07-14 20:46:24 +02:00
Yann Collet 17508f1a16 fixed a few minor coverity warnings 2016-07-14 17:18:20 +02:00
Yann Collet 69c2cdb45c fixed conversion warning 2016-07-14 16:52:45 +02:00
Yann Collet 44f684ded3 fixed minor coverity warning 2016-07-13 20:12:33 +02:00
Yann Collet 5e80dd3261 fixed minor coverity warnings 2016-07-13 19:21:57 +02:00
Yann Collet 158e7703bb reduced paramgrill dependency to C standard lib only 2016-07-13 16:45:24 +02:00
Yann Collet 2b1a3638e6 changed macro name to ZSTDCLI_CLEVEL_DEFAULT 2016-07-13 15:16:00 +02:00
Yann Collet 3c242e79d3 updated compression levels table 2016-07-13 14:56:24 +02:00
Yann Collet 2cac5b30b9 changed default compression level to 3 (can be modified with macro ZSTDCLI_DEFAULT_CLEVEL) 2016-07-13 14:15:08 +02:00
Yann Collet 696c4d7ef5 new paramgrill mode : `-O#` : find optimal parameters for a given sample and a given target speed 2016-07-13 13:11:08 +02:00
Yann Collet 650a8778c1 minor filter improvement 2016-07-13 11:49:05 +02:00
Yann Collet a43a854cdb updated paramgrill 2016-07-12 13:42:10 +02:00
Yann Collet 45dc35628c first version of doubleFast 2016-07-12 09:47:31 +02:00
Yann Collet 3ae543ce75 added ZSTD_estimateCCtxSize() 2016-07-11 03:12:17 +02:00
Yann Collet aa2628da30 added : ZSTD_insertBlock(), basic tests 2016-07-07 15:28:41 +02:00
Yann Collet 19c27d27f1 simplified legacy functions, no longer need magic number 2016-07-07 14:40:13 +02:00
Yann Collet e72efeb0a1 removed "error_public.h" dependency from "zstd.h" 2016-07-07 14:17:40 +02:00
Yann Collet f323bf7d32 added : ZSTD_getDecompressedSize() 2016-07-07 13:14:21 +02:00
Yann Collet a3d03a3973 added <errno.h> dependency 2016-07-06 16:27:17 +02:00
Yann Collet bcb5f77efa dictBuilder manages better samples of null size 0 and large size > 128 KB 2016-07-06 15:41:03 +02:00
Yann Collet 9ca73364e6 updated spec 2016-07-05 10:53:38 +02:00
Yann Collet f9cac7a734 Added GNU separator `--`, to specifies that all following arguments are necessary file names (and not commands). Suggested by @chipturner (#230) 2016-07-04 18:18:24 +02:00
Yann Collet 92c986b4e8 fixed cmake error (missing errno) 2016-07-04 01:37:30 +02:00
Yann Collet d916c908e0 updated doc 2016-07-04 00:42:58 +02:00
Yann Collet 440bb637e2 Merge pull request #238 from juanfra684/patch-2 
Add OpenBSD to the Makefile test.
 2016-07-04 00:38:19 +02:00
Juan Francisco Cantero Hurtado 06ad6f1911 Add OpenBSD to the Makefile test. 2016-07-03 22:16:00 +02:00
Juan Francisco Cantero Hurtado fb5c59fc89 Redundant entry for options in the man page. 
".SH OPTIONS" is enough.
 2016-07-03 22:15:26 +02:00
Yann Collet 5cc1882d45 fixed minor visual warning 2016-07-03 19:03:13 +02:00
Yann Collet c62cda9def fileio.c no longer depends on zstd_internal.h 2016-07-03 01:36:57 +02:00
Yann Collet 92d75667e4 fix for fast mode 2016-07-03 01:10:53 +02:00
Yann Collet b2b5309c6f removes Visual warning on strerror() 2016-07-03 00:20:03 +02:00
Yann Collet f4b7b747c7 `-c` does no longer modify displayLevel when `-v` set. 2016-07-02 22:57:28 +02:00
Yann Collet ed7fb8413c extended use of strerror(errno) 2016-07-02 21:01:54 +02:00
Yann Collet b71adf45c1 extended use of strerror(errno) 2016-07-02 01:51:12 +02:00
Yann Collet b7f197633a use strerror(errno) to return system error message 2016-07-02 00:59:25 +02:00
Yann Collet a7a5d7736c Updated doc 2016-07-02 00:37:32 +02:00
Yann Collet cebab1d322 Explicit error message when dst file cannot be created / opened 2016-07-02 00:12:14 +02:00
Yann Collet 6c6e1751f6 use ZSTD_getParams() to simplify code 2016-06-27 15:28:45 +02:00
Yann Collet 3d2cd7f816 Introduced ZSTD_getParams() 
bench now uses ZSTD_createCDict_advanced()
 2016-06-27 15:12:26 +02:00
Yann Collet ec224d256d removed useless context 2016-06-27 13:39:30 +02:00
Yann Collet 4c56f4a3cf fixed error messages 2016-06-27 13:36:54 +02:00
Yann Collet d4f4e58ee1 fixed ZSTD_decompressBlock() using multiple blocks 2016-06-27 01:31:35 +02:00
inikep 9649126f70 Merge remote-tracking branch 'refs/remotes/origin/speedTest' into dev 2016-06-22 16:22:29 +02:00
inikep d7d251ccb5 bench.c: added support for ZSTD_GIT_COMMIT 2016-06-22 16:13:25 +02:00
inikep f2f59d758e test-zstd-speed.py: added ZSTD_GIT_COMMIT 2016-06-22 15:42:26 +02:00
Yann Collet 8d30cd562a Merge pull request #219 from inikep/dev 
added gcc5test and gcc6test for Travis
 2016-06-21 21:51:52 +02:00
Yann Collet 391a128794 fix : segfault in command line during automatic overwrite protection mode 2016-06-21 17:06:25 +02:00
Yann Collet 446d442989 zbufftest now ensures ZBUFF_compressEnd() is fully flushed in a single pass if dst buffer is large enough 2016-06-21 14:14:02 +02:00
Yann Collet f15c1cb00c Fixed : ZBUFF_compressEnd() called multiple times with too small dst buffer (#206) 2016-06-21 13:11:48 +02:00
Yann Collet 2565971ea4 stronger fuzzer tests for ZBUFF_compressEnd() 2016-06-21 12:17:26 +02:00
inikep 9bf5357101 bench.c: use ZSTD_VERSION_STRING 2016-06-21 11:01:29 +02:00
Yann Collet c98f8e7b57 Modified : zstd CLI enables checksum by default 2016-06-20 16:31:24 +02:00
Yann Collet cbf8c52954 roundTripCrash automatic compression level now depends on first 128 bytes 2016-06-20 16:18:19 +02:00
Yann Collet 19cab46f2f Joined `seqStore` initialization at dispatch point 2016-06-17 12:54:52 +02:00
Yann Collet 3f01c8833f better seed randomization for systems with poor clock() resolutation 2016-06-16 13:38:10 +02:00
Yann Collet 803c05ec7e fuzzer : tests with high id are run without need to change finalTestNb 2016-06-16 11:32:57 +02:00
Yann Collet 23ccc34262 Merge branch 'dev' of github.com:Cyan4973/zstd into dev 2016-06-15 23:33:52 +02:00
Yann Collet 1a7b8fbc24 fixed dictionary tests 2016-06-15 23:33:38 +02:00
Yann Collet 9b998e4d08 Fixed decompression of literals in dictionary mode 2016-06-15 23:11:20 +02:00
Tobias Ibounig 3915545605 Fix Max Compression Level in zstd.1 2016-06-15 22:20:46 +02:00
Yann Collet 531a4273c0 stronger dictionary compression tests 2016-06-15 19:02:11 +02:00
Yann Collet 1869f7966e Merge pull request #205 from inikep/dev 
legacy decoder for v0.6
 2016-06-10 17:13:07 +02:00
Yann Collet b09b12ce10 Added command `--rm` : remove source file after successful de/compression 2016-06-09 23:01:19 +02:00
inikep bf853d5510 added legacy decoder for v0.6 format 2016-06-09 17:59:18 +02:00
Yann Collet ee1a084852 Integrated new dictionary API into bench module 2016-06-07 01:40:49 +02:00
Yann Collet f72dc6091b removed msan tests, due to issues with `datagen.c` 2016-06-06 19:42:47 +02:00
Yann Collet 2cc72f1fd3 fixed initialization issue in bench 2016-06-06 17:50:07 +02:00
Yann Collet 673f0d7cdc new frame format, allowing custom window size 2016-06-06 00:26:38 +02:00
Yann Collet a91ca620cf removed `HUF_readStats()` from public space 2016-06-05 01:33:55 +02:00
Yann Collet f3a1a84c9a fixed cmake project 2016-06-05 01:05:01 +02:00
Yann Collet d0e2cd15cb Merged `fse_static` into `fse.h` . Now requires `FSE_STATIC_LINKING_ONLY` macro. 2016-06-05 00:58:01 +02:00
Yann Collet d3b7f8d21f Merged `zstd_static.h` into `zstd.h` . Now requires `ZSTD_STATIC_LINKING_ONLY` macro 2016-06-04 19:47:02 +02:00
Yann Collet 5347aee8f7 merged `zbuff_static.h` into `zbuff.h` . Now requires `ZBUFF_STATIC_LINKING_ONLY` macro 2016-06-04 19:12:48 +02:00
Yann Collet e69b8ccceb merged `zdict_static.h` into `zdict.h`. Now requires `ZDICT_STATIC_LINKING_ONLY` macro. 2016-06-04 18:56:23 +02:00
Yann Collet 0d31160b4e better dynamic memory adaptation when using CLI 2016-06-04 00:09:02 +02:00
Yann Collet ab7b6f1ece Merge pull request #198 from inikep/dev070 
Dev070
 2016-06-03 21:37:49 +02:00
Yann Collet 441f5d61fd dictionary size objective can be described in Megabytes 2016-06-03 15:15:47 +02:00
Yann Collet 1dd7961557 minor code refactoring 2016-06-03 15:14:09 +02:00
inikep 36fac00149 removed calloc calls from lib/ 2016-06-03 13:23:04 +02:00
inikep db2f540414 added defaultCustomNULL 2016-06-03 12:56:56 +02:00
inikep ff2d18928d zlibWrapper: added gcc flag -Wdeclaration-after-statement 2016-06-02 22:15:09 +02:00
inikep b74a468fad Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070 2016-06-02 22:09:09 +02:00
inikep 7cab86f647 ZWRAP_allocFunction and ZWRAP_freeFunction are static 2016-06-02 18:24:07 +02:00
Yann Collet 923938edde Added `-Wdeclaration-after-statement` compilation flag 2016-06-02 17:56:00 +02:00
Yann Collet 2c4acdabdc Changed command name to `--check` , `-C`, following `xz` convention 2016-06-02 17:05:50 +02:00
inikep ff9114aee3 zlibWrapper: added support for custom memory allocation functions 2016-06-02 16:52:36 +02:00
inikep 2866951558 opaque parameter for custom memory allocation functions 2016-06-02 13:04:18 +02:00
Yann Collet 87cfbe3e5f checksum generation can be selected from command line (`--checksum`) 2016-06-01 19:22:15 +02:00
Yann Collet eb70043e59 Fixed paramgrill 2016-06-01 18:59:55 +02:00
Yann Collet 70d1301d6e Changed `ZSTD_adjustCParams()` prototype 
`ZSTD_adjustCParams()` is now automatically invoked at the end of `ZSTD_getCParams()`
 2016-06-01 18:45:34 +02:00
Yann Collet 83c3f4427c upgraded zbufftest to also test advanced frame parameters no/checksum no/dictID 2016-06-01 17:44:53 +02:00
inikep 5c2771710d Merge remote-tracking branch 'refs/remotes/Cyan4973/dev070' into dev070 
# Conflicts:
#	.gitignore
#	lib/decompress/zstd_decompress.c
#	programs/zbufftest.c
 2016-06-01 09:16:11 +02:00
Yann Collet 202844ebd0 fixed zbufftest : 2016-06-01 00:44:36 +02:00
inikep 00fa1ae0c0 update playTests.sh permission 2016-06-01 00:13:02 +02:00
inikep a6b942018d Merge remote-tracking branch 'refs/remotes/origin/dev' into dev070 
# Conflicts:
#	.travis.yml
#	Makefile
#	lib/common/zstd_static.h
#	programs/Makefile
#	projects/VS2008/zstd/zstd.vcproj
#	projects/VS2008/zstdlib/zstdlib.vcproj
#	projects/cmake/lib/CMakeLists.txt
#	projects/cmake/programs/CMakeLists.txt
 2016-06-01 00:07:09 +02:00
Yann Collet f2a3b6e7b4 added : frame content checksum 2016-05-31 22:23:45 +02:00
inikep cf6edcd0a1 zbufftest.c: fixed g++ warning 2016-05-31 20:21:43 +02:00
inikep 43aa9fe8b3 fixed skippable frame 2016-05-31 19:36:51 +02:00
inikep 5bee32e349 cmake project works with MSYS 2016-05-31 13:36:14 +02:00
inikep f772bf54a5 support for skippable frames 2016-05-31 12:43:46 +02:00
Yann Collet 6fca9e7545 Changed : max dictionary file size increased to 8 MB 2016-05-31 02:40:42 +02:00
Yann Collet 6381e99fb2 Added : ability to create compressed frames without dictID 2016-05-31 02:29:45 +02:00
Yann Collet b81cbbade1 fixed minor conversion warning 2016-05-30 22:29:45 +02:00
Yann Collet 290aaa7521 Added : ability to manually select the dictionary ID of a newly created dictionary 2016-05-30 21:18:52 +02:00
cyan b880631aed Fixed visual projects 
Signed-off-by: Yann Collet <yann.collet.73@gmail.com>
 2016-05-30 18:28:29 +02:00
Yann Collet 30009521d7 fuzzer tests dictBuilder. 
Added : ability to not store dictID during compression; decompression doesn't check dictID then
 2016-05-30 16:17:33 +02:00
Yann Collet d2858e93cb minor refactoring 2016-05-30 15:11:17 +02:00
inikep 1dcb2ff23f improved scripts compatibility 2016-05-30 11:33:52 +02:00
inikep 957d678031 update playTests.sh perimissions 2016-05-30 10:23:52 +02:00
inikep 93fc13ebc8 playTests.sh working with Linux, Windows, OS X 2016-05-30 10:17:55 +02:00
Yann Collet c0a9bf3c2e minor code refactoring 2016-05-30 04:48:32 +02:00
Yann Collet 954e2bc48f added fuzzer test for `ZSTD_compressBegin_advanced()` 2016-05-30 01:42:05 +02:00
Yann Collet 33341de7d7 fixed fuzzer dictionary test 2016-05-29 23:09:51 +02:00
Yann Collet fcf2087a15 restored zstdcli.c 2016-05-29 05:16:05 +02:00
Yann Collet c46fb924df added dictionary ID (incomplete) 2016-05-29 05:01:04 +02:00
Yann Collet 0d348d46d8 fixed cmake 
fixed playTests
 2016-05-29 02:02:24 +02:00
Yann Collet f51e0660f4 Simplified list of `*.c` files 2016-05-29 01:39:19 +02:00
Yann Collet 0c5e8b17ad moved xxhash to lib/common 2016-05-29 01:06:30 +02:00
Yann Collet ab2ee08042 fixed makefile error in clean target 2016-05-28 16:06:29 +02:00
Yann Collet fb0ba59c41 Added : utility `roundTripCrash` 
which generates a crash (double-free) on detecting a round-trip corruption
 2016-05-28 15:30:01 +02:00
Yann Collet 6c903a8dd5 updated xxhash to latest "dev" version 2016-05-28 13:34:07 +02:00
inikep 993a9dfc5a playTests.sh updated to work better with /bin/sh 2016-05-27 10:07:46 +02:00
inikep bff23b72c5 fixed Visual Studio warning 2016-05-25 17:40:58 +02:00
inikep 957823f56f zstdcli: -r (operate recursively on directories) works with dictBuilder and compression 2016-05-25 15:30:55 +02:00
inikep 4f1acdd158 usage of fileno() only on POSIX and Windows 2016-05-25 12:41:41 +02:00
inikep e75909ef93 ZBUFF_createCCtx_advanced moved to zbuff_static.h 2016-05-25 11:31:16 +02:00
inikep 5d589562fe playTests.sh joined with playTestsMSYS.sh 2016-05-25 10:50:28 +02:00
inikep 460a4ee6d4 playTests updated with Pass-Through mode 2016-05-24 18:22:38 +02:00