facebook
/
zstd
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
5,523 Commits
2 Branches
0 Tags
28 MiB
Commit Graph

5523 Commits (3a2e95eba45a28afa57afae00dac15dce29959e9)

Author SHA1 Message Date
Yann Collet 5892dd5da4
Merge pull request #1255 from terrelln/norm-fix 
[FSE] Fix division by zero
 2018-08-02 11:48:56 -07:00
Nick Terrell dc5a67cb7b Disallow tableLog == srcLog 2018-08-02 11:12:17 -07:00
Jennifer Liu 0acb0abd1e Add non-optimize FASTCOVER (#1260) 
* Add non-optimize FASTCOVER

* Minor fix

* Pass param as value instead of pointer
 2018-08-01 11:06:16 -07:00
Nick Terrell 1420129fda
Merge pull request #1258 from jennifermliu/fastCover 
Use CDict instead of CCtx in analyzeEntropy
 2018-07-31 14:31:05 -07:00
Jennifer Liu f5228f2c44 Refactoring 2018-07-31 13:58:54 -07:00
Jennifer Liu 4e29bc2469 Use CDict instead of CCtx in analyzeEntropy 2018-07-31 10:36:45 -07:00
Nick Terrell fc685d6b94
Merge pull request #1257 from jennifermliu/fastCover 
Increment frequency for every dmer occurence within same sample
 2018-07-30 16:03:18 -07:00
Nick Terrell b9faaa1dc3 [FSE] Add division by zero test 2018-07-30 13:24:09 -07:00
Jennifer Liu 31229e527b Increment frequency for every dmer occurence within same sample instead of at most once per sample 2018-07-30 12:54:22 -07:00
cyan4973 e85b4c56b2 speed up appveyor tests 2018-07-30 17:13:13 +02:00
cyan4973 3f535007e4 fix %zu support under minGW 
and relevant test on Appveyor
 2018-07-30 16:56:18 +02:00
cyan4973 c738a2c795 ensure appveyor test fails due to formatting error 
to catch %zu incompatibility
 2018-07-30 16:44:20 +02:00
cyan4973 aade1e5904 Merge branch 'dev' into fix1241 2018-07-30 16:30:35 +02:00
cyan4973 3d4b09a5aa support %zu under mingw 2018-07-30 16:29:20 +02:00
Nick Terrell 92633789f6
Merge pull request #1254 from jennifermliu/fastCover 
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
 2018-07-27 18:22:52 -07:00
Jennifer Liu 51b109c1b5 Delete old benchmarking result 2018-07-27 17:31:33 -07:00
Nick Terrell 9889bca530 [FSE] Fix division by zero 
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
 2018-07-27 17:30:03 -07:00
Jennifer Liu 53ef22a4bc Undo deleting clean in make 2018-07-27 16:56:50 -07:00
Jennifer Liu 96d84ee235 Revert test.sh 2018-07-27 16:54:05 -07:00
Jennifer Liu 61262f6c0d Save segmentFreqs in ctx instead of malloc and memset in SelectSegment 2018-07-27 16:51:38 -07:00
Nick Terrell 3abfbee215
Merge pull request #1250 from jennifermliu/fastCover 
Add Fast Cover Dictionary Builder
 2018-07-27 15:11:57 -07:00
Jennifer Liu 49b398e93f Use same param after optimizing cover and fastCover and record k and d for benchmarking 2018-07-27 13:39:19 -07:00
Jennifer Liu 759c543312 Rerun cover and fastCover with optimized values 2018-07-26 19:03:01 -07:00
Jennifer Liu 3d7941ce41 Benchmark different f values 2018-07-26 16:24:13 -07:00
Nick Terrell 7974628587
Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix 
Fixes bug
 2018-07-26 16:12:15 -07:00
George Lu 09ccd977c3 no zero 2018-07-26 15:17:58 -07:00
Jennifer Liu 3b163e0b5b Add array to keep track of frequency within active segment, fix malloc bug, update benchmarking result 2018-07-26 13:53:13 -07:00
Jennifer Liu 2333ecb173 Allow d=6 2018-07-25 18:10:09 -07:00
Jennifer Liu 1e85f314d8 Benchmark fast cover optimize vs k=200 2018-07-25 17:53:38 -07:00
Jennifer Liu d1fc507ef9 Initial benchmarking result for fastCover 2018-07-25 17:05:54 -07:00
Jennifer Liu f5407e398a Make hash value const 2018-07-25 16:54:08 -07:00
Jennifer Liu 7f3f70f766 Add Fast Cover Dictionary Builder 2018-07-25 16:34:07 -07:00
Nick Terrell 77068a8447
Merge pull request #1246 from jennifermliu/benchmark 
Benchmark dictionary builders
 2018-07-20 18:09:31 -07:00
Jennifer Liu b6c5d4982c Minor fix 2018-07-20 17:41:22 -07:00
Jennifer Liu 71e767ac09 Refactoring and benchmark without dictionary 2018-07-20 17:03:47 -07:00
Jennifer Liu 470c8d42f4 Benchmark dictionary builders 2018-07-20 11:32:39 -07:00
Nick Terrell 2e47865d7d
Merge pull request #1245 from terrelln/disable-arm 
Revert "attempt to re-enable arm64 tests"
 2018-07-19 15:32:53 -07:00
Nick Terrell 5624f3f1ea Revert "attempt to re-enable arm64 tests" 
This reverts commit 9c277f137c.
 2018-07-19 14:35:27 -07:00
Nick Terrell 4d1ad5cdb2
Merge pull request #1238 from jennifermliu/random 
Add random dictionary builder
 2018-07-19 13:52:15 -07:00
Jennifer Liu 0c5eaef248 Update Makefile 2018-07-19 13:44:27 -07:00
Jennifer Liu 5bb46a898e Rename cleanup 2018-07-18 12:15:49 -07:00
Jennifer Liu 52e7cf0e40 Add cleanup to trainfromFiles and move RANDOM_segment_t declaration 2018-07-18 10:40:13 -07:00
Yann Collet effa84c8d1
Merge pull request #1230 from terrelln/train-out 
zstdcli: Allow -o before --train
 2018-07-18 16:34:10 +02:00
Yann Collet 6e490a2f09
Merge pull request #1237 from terrelln/init-cstream-adv 
Set requestedParams in ZSTD_initCStream*()
 2018-07-18 16:33:30 +02:00
cyan4973 7d1bc9cc8c fix minor conversion warning 2018-07-18 16:10:23 +02:00
Yann Collet 37da48986b
Merge pull request #1242 from facebook/mingw_traces 
zstdmt debug traces compatibles with mingw
 2018-07-18 12:23:07 +02:00
Yann Collet 545bd3dd01
Merge pull request #1244 from terrelln/ferror 
fileio: Error in compression on read errors
 2018-07-18 12:22:41 +02:00
Jennifer Liu ce09fb723d Update freeSampleInfo 2018-07-17 16:13:40 -07:00
Jennifer Liu 896ff0644a Fix deallocation problem and add documentation 2018-07-17 16:01:44 -07:00
Nick Terrell 4e706d7f2c fileio: Error in compression on read errors 
We can write a corrupted file if the input file errors during a read.
We should return a non-zero error code in this case.
 2018-07-17 15:26:30 -07:00