facebook
/
zstd
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,193 Commits
2 Branches
0 Tags
28 MiB
Commit Graph

728 Commits (b09b12ce10bfbd50c7af3b6d4aae643d3f8f6325)

Author SHA1 Message Date
inikep afe1f7994b Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
 2016-04-07 19:50:03 +02:00
Yann Collet 9e8b09a7bd Fixed memory initialization issue, reported by Maciej Adamczyk 2016-04-07 19:35:23 +02:00
inikep 2bf79f9bff use extDict only when needed 2016-04-07 19:24:33 +02:00
inikep 64d7bcb0dc only repcode 0 for lazy, lazy2 and btlazy2 strategies 2016-04-07 19:14:09 +02:00
inikep a69640cca1 Revert "removed void ZSTD_compressBlock_greedy" 
This reverts commit 9296400a69.
 2016-04-07 18:22:29 +02:00
Yann Collet d7bee33caf Fixed make install (reported by Oliver Lange) 2016-04-07 18:16:42 +02:00
Yann Collet 5d39357bc4 minor compression speed optimization 2016-04-07 17:19:00 +02:00
inikep 9296400a69 removed void ZSTD_compressBlock_greedy 2016-04-07 16:58:04 +02:00
Yann Collet 485371600a Implemented default coding table for lengths and offset 2016-04-07 15:24:29 +02:00
Yann Collet 79459da14b Merge pull request #163 from inikep/dev 
3 repcodes and MINMATCH=3
 2016-04-07 14:37:30 +02:00
inikep 81a345b0ce minor speed improvements 2016-04-07 11:35:17 +02:00
inikep e47f33f980 reordered code 2016-04-06 20:58:00 +02:00
inikep 2db1eb78e9 reordered functions 2016-04-06 17:14:19 +02:00
inikep e5b6e9e551 fixed support for searchLength=4 2016-04-06 13:15:38 +02:00
inikep 75716851d4 MINMATCH=3 for lazy strategy 2016-04-06 12:34:42 +02:00
inikep 7bc19b6b3e MINMATCH=3 2016-04-06 09:46:01 +02:00
inikep f8a339d274 working ZSTD_compressBlock_opt_extDict_generic 2016-04-05 23:58:51 +02:00
inikep 83417bbbd2 code formatting 2016-04-05 21:30:03 +02:00
inikep 5ce00aee37 ZSTD_compressBlock_opt_extDict_generic in progress 2016-04-05 21:03:43 +02:00
inikep faa8d8aae1 introduced ZSTD_compressBlock_greedy 2016-04-05 19:01:10 +02:00
inikep 908fcb384a 3 repcodes with ZSTD_compressBlock_lazy_extDict_generic 2016-04-05 18:16:38 +02:00
inikep a4385aa23b ZSTD_REP_NUM=3 only 2016-04-05 17:11:56 +02:00
inikep d5359b2e55 Merge remote-tracking branch 'refs/remotes/origin/repcodes' into dev 2016-04-05 17:07:36 +02:00
inikep ba73d1bb6b support for ZSTD_REP_NUM=3 2016-04-05 10:30:05 +02:00
inikep 74e3a7ba4c removed kSlotNew 2016-04-05 10:18:37 +02:00
inikep b3532793a9 experiments with ZSTD_decodeSequence 2016-04-05 10:08:25 +02:00
Yann Collet 46bdb6267e Merge pull request #161 from inikep/dev 
Dev
 2016-04-05 09:59:59 +02:00
inikep 2ec2698ef9 working 4 reps 2016-04-05 09:34:13 +02:00
inikep 19140cd80e zstd_stats.h moved to .debug/ 2016-04-05 08:52:57 +02:00
inikep d6f208badf improved logging 2016-04-04 21:15:23 +02:00
inikep 78e52044de Merge remote-tracking branch 'refs/remotes/origin/dev' into repcodes 
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_decompress.c
#	lib/zstd_internal.h
#	lib/zstd_opt.h
#	programs/bench.c
 2016-04-04 16:28:40 +02:00
inikep cb70c8ab90 fixed -Werror,-Wconversion warning 2016-04-04 15:43:45 +02:00
inikep 0c7456c5b7 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
#	lib/zstd_static.h
 2016-04-04 14:54:53 +02:00
Yann Collet b59bf963a8 fixed Visual conversion warnings 2016-04-04 14:53:16 +02:00
inikep 227dd4bc74 changed price estimation for optimal parser 2016-04-04 14:34:02 +02:00
Yann Collet 8a57b928ba changed `contentLog` -> `chainLog` 2016-04-04 13:49:18 +02:00
Yann Collet 1005fc1276 reduced memory usage of very hich compression levels in 32-bits mode 2016-04-04 13:28:28 +02:00
inikep 19bd48f516 Merge from Cyan4973/dev060 2016-04-04 12:10:00 +02:00
Yann Collet 1535414927 Fixed 32-bits windowLog limitation 
Fixed some macro errors in zbufftest
 2016-04-04 04:22:53 +02:00
Yann Collet 5a88a70f97 fixed buffer sync error in zbuff 2016-04-03 20:24:25 +02:00
Yann Collet ef36390e4a refined exception for hashlog < min 2016-04-02 00:46:40 +02:00
Yann Collet 40358d01aa Fix : rare bugs when hashLog < min in bt mode 2016-04-02 00:40:09 +02:00
Yann Collet 1d803d8deb fixed zbuff error 775-3 (internal buffer management) 2016-04-01 18:57:41 +02:00
Yann Collet efb18309ef fixed minor visual 32-64bits conversion warning 2016-04-01 18:54:13 +02:00
Yann Collet afa60e0f14 fixed decoding error, reported by Maciej Adamczyk 2016-04-01 15:49:41 +02:00
Yann Collet 27caf2afca minor variable isolation 2016-04-01 15:48:48 +02:00
Yann Collet 9bb87e5995 fixed harmless comparison warning 2016-03-30 21:28:15 +02:00
Yann Collet 51d500425f fixed paramgrill 2016-03-30 20:42:19 +02:00
Yann Collet dd6466a211 fixed clang conversion warning 2016-03-30 20:06:26 +02:00
Yann Collet 3b71925c2d separate params into compressionParams and frameParams 2016-03-30 19:48:05 +02:00
Yann Collet 21588e370b changed validateParams() into checkParams() + adjustParams() 2016-03-30 16:50:44 +02:00
Yann Collet b44be74244 Fixed zdict 
more dictionary compression tests
 2016-03-26 20:52:14 +01:00
Yann Collet 74bd11954b fixed ARM compatibility 2016-03-26 17:50:26 +01:00
Yann Collet b9151406de fixed 32-bits compatibility 2016-03-26 17:18:11 +01:00
inikep 97c88e716c fix for -Wshorten-64-to-32 warning in ZSTD_statsUpdatePrices 2016-03-25 13:39:14 +01:00
Yann Collet 433a5cce7e improved decompression speed (680) 2016-03-25 11:43:48 +01:00
inikep 5cc4efdaf8 created zstd_stats.h 2016-03-25 10:52:25 +01:00
Yann Collet 646693e3be support for alternate offset (fusion) 2016-03-24 02:42:15 +01:00
Yann Collet b21ce15efe minor variables isolation 2016-03-24 02:02:32 +01:00
Yann Collet 7cbe79ab25 fixed write overflow found by fuzzer 2016-03-23 22:31:57 +01:00
Yann Collet 72d706a020 fixed crash at -O3 with customized block size (wrong alignment) 2016-03-23 20:44:12 +01:00
inikep eaba91a161 added ZSTD_compressBegin_targetSrcSize 2016-03-23 20:30:26 +01:00
Yann Collet 862a85976f Added BMI instructions 2016-03-23 18:45:23 +01:00
inikep 7adceef974 hashLog3 added to ZSTD_CCtx 2016-03-23 15:53:38 +01:00
Yann Collet 6cf45dac81 shared const BIT_mask 2016-03-23 14:41:54 +01:00
Yann Collet 3c017867de minor optimization (DSpeed 665) 2016-03-23 14:09:51 +01:00
Yann Collet 2512597576 minor reordering (DSpeed 665) 2016-03-23 14:00:09 +01:00
Yann Collet afab02098a improved decoding speed (660) 2016-03-23 13:57:49 +01:00
inikep 472638c861 added mili_sleep and setHighPriority 2016-03-23 12:28:28 +01:00
Yann Collet 9c34df93b6 new decodeSequence, merging parts 2016-03-23 01:54:25 +01:00
Yann Collet add08d6f61 minor variation - DSpeed at 640 2016-03-23 01:32:41 +01:00
Yann Collet be391438ff first working version with both encoder and decode alternate LL + ML coding scheme. 
decompression speed highly impacted
 2016-03-22 23:19:28 +01:00
inikep 2872b6f01f Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
#	programs/bench.c
 2016-03-22 14:38:34 +01:00
Yann Collet fadda6c875 first prototype with ML encoding scheme (but not yet decoding scheme) 2016-03-22 12:14:26 +01:00
inikep 2b942881ac improved 4reps in ZSTD_compressBlock_lazy_generic 
kSlotNew = 0
 2016-03-22 11:56:22 +01:00
Yann Collet 1dcf930f72 Merge branch 'dev060' into alternateLLcode 2016-03-22 00:29:57 +01:00
inikep f2fa0e1198 final repcodes for ZSTD_btopt 2016-03-21 20:14:03 +01:00
inikep 378be62a9e better repcodes 2016-03-21 19:48:54 +01:00
inikep fc1d7bd93b changed update logic of repcodes 2016-03-21 19:02:16 +01:00
inikep e7ec8f2b9b improved ratio 2016-03-21 17:23:02 +01:00
Yann Collet be4605d851 improved decompression speed 2016-03-21 14:29:26 +01:00
Yann Collet e91477c171 minor variable isolation 2016-03-21 14:22:38 +01:00
Yann Collet b0aec17a90 code simplification (but reduce decompression speed ...) 2016-03-21 13:24:16 +01:00
Yann Collet 6c62b7dfc8 support default LL distribution 2016-03-21 00:39:19 +01:00
Yann Collet d64f435f63 handles litLength >= 65535 2016-03-21 00:07:42 +01:00
Yann Collet 597847a2ae first emulation 2016-03-20 19:14:22 +01:00
Yann Collet ecabfe3777 Improved index overflow protection 2016-03-20 16:20:06 +01:00
Yann Collet 5244738046 minor code refactoring 2016-03-20 16:00:00 +01:00
Yann Collet de406eebcd minor code refactor 2016-03-20 15:46:10 +01:00
Yann Collet 516ba88022 updated huff0 2016-03-20 05:40:39 +01:00
Yann Collet a5c2c08c68 code refactoring 2016-03-20 01:09:18 +01:00
Yann Collet 70e4577179 minor code refactoring 2016-03-19 18:08:32 +01:00
Yann Collet c6eea2b2f2 Improved speed for small files 2016-03-19 17:18:00 +01:00
Yann Collet e74215e3c7 performance fix for small files 2016-03-19 16:09:09 +01:00
inikep 1269e2f7db working kSlotNew for ZSTD_btopt 2016-03-19 15:32:21 +01:00
Yann Collet bb604486f1 fixed clang warning 2016-03-19 15:18:42 +01:00
Yann Collet 37f3d1b2ab minor refactor 2016-03-19 15:11:42 +01:00
Yann Collet 90a03a95a1 minor performance fix (decompression) 2016-03-19 14:47:31 +01:00
Yann Collet 01e5b95199 code refactor 2016-03-19 14:14:31 +01:00
Yann Collet d1d210f3fb minor code refactor 2016-03-19 12:12:07 +01:00
Yann Collet 4db09efde4 simplifications 2016-03-18 22:23:49 +01:00
Yann Collet 39c596ca58 minor simplifications 2016-03-18 21:40:56 +01:00
inikep fade9b7ae3 ZSTD_btopt with 4 repcodes 2016-03-18 16:10:35 +01:00
inikep 1c1e6916e4 improved timer accuracy 2016-03-18 12:49:44 +01:00
Yann Collet a910dc8238 minor code refactoring 2016-03-18 12:37:45 +01:00
inikep 5b15865413 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into repcodes 
# Conflicts:
#	lib/zstd_decompress.c
#	programs/bench.c
 2016-03-18 11:14:58 +01:00
inikep eca2ec0b3b introduced ZSTD_REP_MOVE and ZSTD_REP_INIT 2016-03-18 11:03:43 +01:00
inikep c56e32e782 4 repcodes when litLen==0 2016-03-17 19:53:38 +01:00
inikep 3e743052cd kSlotNew 2016-03-17 17:24:17 +01:00
Yann Collet 3fd164e656 minor refactoring 2016-03-17 13:43:32 +01:00
Yann Collet b40287aaef Improved decompression speed (by @inikep) 2016-03-17 12:11:16 +01:00
inikep 7d1742825b support for ZSTD_REP_NUM == 1 and ZSTD_REP_NUM == 4 2016-03-17 11:21:00 +01:00
inikep 5945308983 working 4 reps 2016-03-16 15:35:14 +01:00
Yann Collet 569b81adb1 changed `BLOCKSIZE` into `ZSTD_BLOCKSIZE_MAX` 2016-03-16 15:26:51 +01:00
inikep 62d694795d ZSTD_compressBlock_lazy supports more reps 2016-03-16 12:57:07 +01:00
inikep 0ac4a551b9 ZSTD_REP_NUM removed from ZSTD_storeSeq 2016-03-16 12:03:07 +01:00
inikep df164e6d35 introduced U32 rep[ZSTD_REP_NUM] 2016-03-16 11:56:59 +01:00
inikep 4569667c85 ZSTD_REP_NUM 2016-03-16 11:40:09 +01:00
Yann Collet 6cb41356e8 update doc / comments 2016-03-15 15:47:38 +01:00
Yann Collet 346bffbc68 Added frame content size test within fuzzer 2016-03-15 15:24:52 +01:00
Yann Collet 09b21ee2f6 fix fileio bug with new zbuff 
simplified zbuff decoding
 2016-03-15 12:56:03 +01:00
inikep d700a1a8b9 ZSTD_setAdditionalParam 2016-03-15 12:18:44 +01:00
Yann Collet 1c2c2bcaff minor refactoring 2016-03-15 01:33:36 +01:00
Yann Collet d1b26849e5 Frame content size supported 2016-03-15 01:24:33 +01:00
inikep 5fdd0b46d3 added additionalParam 2016-03-14 19:51:11 +01:00
Yann Collet fb7973580f minor comments update 2016-03-13 11:08:40 +01:00
Yann Collet 03ea59b17b Decompression can decode frame content size 2016-03-12 01:25:40 +01:00
Yann Collet 0e491c01fe created ZSTD_frameParams 2016-03-11 21:58:04 +01:00
inikep cc6c283633 removed hashLog3 from ZSTD_parameters 2016-03-10 15:17:24 +01:00
inikep 260a9e3886 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 2016-03-10 15:04:12 +01:00
inikep b0c640d934 small ratio improvement with MINMATCH=3 2016-03-10 13:18:36 +01:00
Yann Collet da5be72fda update compression level parameters 2016-03-10 11:01:44 +01:00
Yann Collet dcc000f0eb minor doc clarifications 2016-03-10 01:09:41 +01:00
Yann Collet e3193c4081 update compresson levels 2016-03-09 16:57:09 +01:00
Yann Collet 4f013a2281 Merge pull request #142 from inikep/dev 
Dev
 2016-03-09 16:29:42 +01:00
inikep b5a519f43c improved compression speed 
introduced cache in ZSTD_setLog2Prices
 2016-03-09 15:45:01 +01:00
Yann Collet 95cd0c2e26 frame format can support window sizes up to 128 MB 2016-03-08 18:24:21 +01:00
Yann Collet ff14b351f5 Merge pull request #141 from inikep/dev 
fix update for zstd_opt
 2016-03-08 14:41:04 +01:00
Yann Collet d3a6660ad1 Update clevel table for <= 128K 2016-03-08 14:12:46 +01:00
Yann Collet 2e91dde43e improved memory size evaluation by paramgrill 2016-03-08 12:22:11 +01:00
inikep 48413765b4 fixed update of hashTable for matches with length of 4+ 2016-03-08 11:03:55 +01:00
Yann Collet dd54bbc184 Fixed large NbSeq > 32 K 
Added a test in Fuzzer to check NbSeq > 32 K
 2016-03-08 02:35:34 +01:00
Yann Collet 370b08e840 fix compression ratio for blocks <= 16 KB 2016-03-08 00:03:59 +01:00
Yann Collet fb7ab8b2b8 Merge pull request #140 from inikep/dev 
mml3
 2016-03-07 18:06:48 +01:00
inikep 4f7f79ef9d fixed update of nextToUpdate 2016-03-07 16:14:58 +01:00
inikep e2446b0e36 added support for MINMATCH=3 on big endian architecture 
changed ZSTD_HASHLOG3_MIN to 2 (4 bytes for MINMACH > 3)
 2016-03-07 10:07:08 +01:00
inikep 89c9e1a847 added missing "case 3:" in ZSTD_BtGetAllMatches 2016-03-06 23:21:52 +01:00
Yann Collet 1df2594bfe new compression level scale for <= 16KB 2016-03-05 18:43:21 +01:00
inikep 01060bc477 Merge remote-tracking branch 'refs/remotes/Cyan4973/dev060' into dev 
# Conflicts:
#	lib/zstd_compress.c
 2016-03-04 20:10:09 +01:00
inikep f3c6503e55 resolve conflict in zstd_internal.h 2016-03-04 20:04:25 +01:00
inikep e29caf7d1c code cleanup 2016-03-04 19:52:23 +01:00
inikep 805d2a7465 removed zstd_opt_internal.h 2016-03-04 19:31:57 +01:00
Yann Collet 944d0d2285 updated fse version 2016-03-04 19:26:59 +01:00
inikep 4ab9c913a5 MEM_readMINMATCH replaced with inline function 2016-03-04 19:17:31 +01:00
Yann Collet 4c01580362 finer searchLength validation 2016-03-04 17:07:54 +01:00
Yann Collet d409db68d3 Support for nbSeq > 32767 
tamed -Wstrict-aliasing warning
 2016-03-04 14:45:31 +01:00
Yann Collet 1435335342 Merge pull request #138 from inikep/dev 
reduce stack usage with optimal parsing mode
 2016-03-03 02:08:34 +01:00
inikep 5cccd77c55 fix clang -Wcast-align warning (part 2) 2016-03-02 20:37:49 +01:00
inikep 51bb9a0064 fix clang -Wcast-align warning 2016-03-02 19:17:13 +01:00
inikep 87d4f3daa4 priceTable moved to heap 2016-03-02 15:56:24 +01:00
inikep 338533f741 improved price function initialization 2016-03-02 14:36:41 +01:00
Yann Collet a997654670 Merge pull request #136 from inikep/dev 
merging mml3 mode
 2016-03-01 17:31:03 +01:00
inikep a4dde25498 fixed repcode before lowLimit 2016-03-01 14:14:35 +01:00
inikep 2d55563b92 better logs 2016-02-29 22:07:40 +01:00
inikep f647d99d61 fixed bug with 3 or more succesive rep codes 2016-02-29 12:33:08 +01:00
inikep f414647c6b fixed ZSTD_copyCCtx 2016-02-25 22:31:07 +01:00
inikep 59493e8669 fixed paramgrill 2016-02-25 19:15:08 +01:00
inikep afa9c9f5ab turn off RTF optimization 2016-02-25 16:47:57 +01:00
Yann Collet ee0229287c changed version to v0.6.0 2016-02-25 14:53:35 +01:00
inikep 02137f8c42 more accurate gain function 2016-02-24 18:09:36 +01:00
inikep ee55628c9d combined price function 2016-02-24 14:40:30 +01:00
Yann Collet 3152a8c87a finer dictionary completion 2016-02-23 21:28:59 +01:00
inikep 4a981f7937 improved ZSTD_GETPRICE 2016-02-23 19:08:20 +01:00
inikep e0010e9baf priceFunc 2016-02-23 16:25:04 +01:00
inikep 15174b0cfb statistics of encoded sequences 2016-02-23 12:41:56 +01:00
inikep 9f754d23dc dummy levels 22-25 2016-02-22 17:00:04 +01:00
inikep 6b3739c8e5 MINMATCH=3 or 4 selected in ZSTD frame 2016-02-22 15:53:42 +01:00
inikep 84f43e2359 support for searchLength from 3 to 7 for optimal parser 2016-02-22 11:34:07 +01:00
inikep c950b78ce2 removed backward match extension 2016-02-22 10:11:39 +01:00
inikep d3b8d7a4e5 removed ZSTD_opt parser 2016-02-22 10:06:17 +01:00
inikep 6291c54006 litlen bounded to 128 bytes 2016-02-19 18:24:14 +01:00
Yann Collet f8482131d7 better compatibility with Visual <= 2012 2016-02-19 17:33:43 +01:00
Yann Collet 191b52a8dc silence array subscript warning 2016-02-19 15:16:15 +01:00
inikep fcafb26b2e speed optimiaztions 2016-02-19 11:59:44 +01:00
inikep c3a9a9ca56 ZSTD_rescaleFreqs and removed minml 2016-02-19 11:05:25 +01:00
inikep cc52a97214 added hashLog3 2016-02-19 10:09:35 +01:00
Yann Collet 4c64d51425 modified level 18 2016-02-18 01:01:42 +01:00
Yann Collet d56a4192f6 Added : README within /lib directory, to help file selection 2016-02-17 17:47:29 +01:00
Yann Collet 6062b15a07 performance fix for hash chain mode 2016-02-16 17:41:03 +01:00
Yann Collet accfd80c37 Added : option `-t` to test compressed files integrity 2016-02-15 19:33:16 +01:00
Yann Collet 0068be94d8 Faster literals cost evaluation (suggested by @inikep) 2016-02-15 18:42:13 +01:00
Yann Collet e93add0439 Removed `if (matchIndex >= current) return 0;` as recommended by @inikep 2016-02-15 17:44:14 +01:00
Yann Collet b8a6f6824b refactored fix to be more generic and applicable to both btlazy2 and btopt 2016-02-15 17:06:29 +01:00
Yann Collet b37e0a9241 performance tweak : bt search w/ long repeated segments 2016-02-15 14:07:07 +01:00
Yann Collet cefef8cde7 Change : zstd_opt_bt => zstd_btopt 2016-02-15 07:21:54 +01:00
Yann Collet 0d78a33374 updated CLevel confs for 256K 2016-02-15 06:49:09 +01:00
Yann Collet 422fd563f3 modified : compression Levels for blocks <= 16KB 2016-02-13 15:07:24 +01:00
Yann Collet 38fba56483 Changed compression level settings 2016-02-13 11:20:23 +01:00
Yann Collet e8bd73df80 Fixed : error when compressing one file 2016-02-13 03:09:48 +01:00
Yann Collet 23e8aee224 Introduced new compression level settings 
Changed position of parameter TargetLength
 2016-02-13 02:08:46 +01:00