Commit Graph

5497 Commits (3adc217ea47f93f11e32ca6d3bf2f103ff3dbbd0)

Author SHA1 Message Date
George Lu 3adc217ea4 Total Changes:
Add different constraint types (decompression speed, compression memory, parameter constraints)
Separate search space by strategy + strategy selection
Memoize results
Real random restarts
Support multiple files
Support Dictionary inputs
Debug Macro for extra printing
2018-08-09 10:42:58 -07:00
George Lu fab4438801 Dictionary + Multiple file Loading 2018-08-09 10:42:58 -07:00
George Lu eb21b7f482 Not crashing 2018-08-09 10:42:58 -07:00
George Lu 5f49034520 Working V1 2018-08-09 10:42:58 -07:00
George Lu cffb6da339 Parses additional parameters
Additional constraint checking

Minor fixes

more param parsing

Add Memory

Change paramVariation

work on feasibility

reformat bench

Changed Paramgrill to use bench.c benchmarking

customlevel macro

Printing Flag

Minor changes

Explicit casting

Makefile fix

casting, type fix

Printing Flag

Minor Changes

comments, helper fn's
2018-08-09 10:42:58 -07:00
Yann Collet 1bc69b9cb5
Merge pull request #1272 from facebook/travisTest
gcc-8 travis test
2018-08-08 14:56:00 -07:00
Yann Collet 48a421c1f0
Merge pull request #1271 from felixhandte/circleci-2.0-config
Migrate Config to CircleCI 2.0
2018-08-08 14:48:51 -07:00
W. Felix Handte 6518745024 Preserve Commented-Out Longer Tests 2018-08-08 14:09:12 -07:00
Yann Collet d1afd48e44 some errors may only happen when optimizations are enabled 2018-08-08 12:37:08 -07:00
W. Felix Handte 0ede1735b0 Remove Old CircleCI Config 2018-08-08 12:33:21 -07:00
W. Felix Handte 4f5e4fe9ed Fix Path 2018-08-08 12:32:55 -07:00
W. Felix Handte 9deef2c41b Add an Auto-Gen'ed CircleCI 2.0 Config
Built via the cci-config-generator.sh script.
2018-08-08 10:28:22 -07:00
Yann Collet 23ab7875e1 try adding gcc-8 compilation tests 2018-08-08 10:26:54 -07:00
Yann Collet 93750a54a9 try to improve some travis test speed 2018-08-08 10:22:19 -07:00
Yann Collet 0d5813ca01
Merge pull request #1243 from facebook/fix1241
fix #1241
2018-08-08 10:18:02 -07:00
Yann Collet 3c491c8d92
Merge pull request #1269 from felixhandte/fix-fix1241
Fix fix1241: Fix CDict Attachment to Handle CDicts with Non-Zero Starts
2018-08-08 09:25:40 -07:00
W. Felix Handte 2ca7c69167 Fix CDict Attachment to Handle CDicts with Non-Zero Starts
CDicts were previously guaranteed to be generated with `lowLimit=dictLimit=0`.
This is no longer true, and so the old length and index calculations are no
longer valid. This diff fixes them to handle non-zero start indices in CDicts.
2018-08-07 18:14:14 -07:00
Yann Collet 5808027abf Merge branch 'dev' into fix1241 2018-08-03 16:08:33 -07:00
Yann Collet df09d4318f
Merge pull request #1263 from facebook/travisTest
Fix Makefile on Linux and ZSTD_NOBENCH
2018-08-03 15:57:22 -07:00
Yann Collet 2fdab1629b fix unused variable warning 2018-08-03 08:30:01 -07:00
Yann Collet ca785c4b20 fix .travis.yml 2018-08-03 07:59:33 -07:00
Yann Collet 5203f01774 fix : zstd cli can be built with build macro ZSTD_NOBENCH
which disables bench.c module
2018-08-03 07:54:29 -07:00
Yann Collet b002eac69a Merge branch 'dev' into travisTest 2018-08-02 11:53:46 -07:00
Yann Collet 064b8e6785 Merge branch 'travisTest' of github.com:facebook/zstd into travisTest 2018-08-02 11:52:12 -07:00
Yann Collet 5892dd5da4
Merge pull request #1255 from terrelln/norm-fix
[FSE] Fix division by zero
2018-08-02 11:48:56 -07:00
Nick Terrell dc5a67cb7b Disallow tableLog == srcLog 2018-08-02 11:12:17 -07:00
Jennifer Liu 0acb0abd1e Add non-optimize FASTCOVER (#1260)
* Add non-optimize FASTCOVER

* Minor fix

* Pass param as value instead of pointer
2018-08-01 11:06:16 -07:00
Nick Terrell 1420129fda
Merge pull request #1258 from jennifermliu/fastCover
Use CDict instead of CCtx in analyzeEntropy
2018-07-31 14:31:05 -07:00
Jennifer Liu f5228f2c44 Refactoring 2018-07-31 13:58:54 -07:00
Jennifer Liu 4e29bc2469 Use CDict instead of CCtx in analyzeEntropy 2018-07-31 10:36:45 -07:00
Nick Terrell fc685d6b94
Merge pull request #1257 from jennifermliu/fastCover
Increment frequency for every dmer occurence within same sample
2018-07-30 16:03:18 -07:00
Nick Terrell b9faaa1dc3 [FSE] Add division by zero test 2018-07-30 13:24:09 -07:00
Jennifer Liu 31229e527b Increment frequency for every dmer occurence within same sample instead of at most once per sample 2018-07-30 12:54:22 -07:00
cyan4973 e85b4c56b2 speed up appveyor tests 2018-07-30 17:13:13 +02:00
cyan4973 3f535007e4 fix %zu support under minGW
and relevant test on Appveyor
2018-07-30 16:56:18 +02:00
cyan4973 c738a2c795 ensure appveyor test fails due to formatting error
to catch %zu incompatibility
2018-07-30 16:44:20 +02:00
cyan4973 aade1e5904 Merge branch 'dev' into fix1241 2018-07-30 16:30:35 +02:00
cyan4973 3d4b09a5aa support %zu under mingw 2018-07-30 16:29:20 +02:00
Nick Terrell 92633789f6
Merge pull request #1254 from jennifermliu/fastCover
Save segmentFreqs in ctx instead of malloc and memset in SelectSegment
2018-07-27 18:22:52 -07:00
Jennifer Liu 51b109c1b5 Delete old benchmarking result 2018-07-27 17:31:33 -07:00
Nick Terrell 9889bca530 [FSE] Fix division by zero
When the primary normalization method fails, and
`(1 << tableLog) == (maxSymbolValue + 1)`, and every symbol gets assigned
normalized weight 1 or -1 in the first loop, then the next division can
raise `SIGFPE`.
2018-07-27 17:30:03 -07:00
Jennifer Liu 53ef22a4bc Undo deleting clean in make 2018-07-27 16:56:50 -07:00
Jennifer Liu 96d84ee235 Revert test.sh 2018-07-27 16:54:05 -07:00
Jennifer Liu 61262f6c0d Save segmentFreqs in ctx instead of malloc and memset in SelectSegment 2018-07-27 16:51:38 -07:00
Nick Terrell 3abfbee215
Merge pull request #1250 from jennifermliu/fastCover
Add Fast Cover Dictionary Builder
2018-07-27 15:11:57 -07:00
Jennifer Liu 49b398e93f Use same param after optimizing cover and fastCover and record k and d for benchmarking 2018-07-27 13:39:19 -07:00
Jennifer Liu 759c543312 Rerun cover and fastCover with optimized values 2018-07-26 19:03:01 -07:00
Jennifer Liu 3d7941ce41 Benchmark different f values 2018-07-26 16:24:13 -07:00
Nick Terrell 7974628587
Merge pull request #1252 from GeorgeLu97/bench-quiet-display-fix
Fixes bug
2018-07-26 16:12:15 -07:00
George Lu 09ccd977c3 no zero 2018-07-26 15:17:58 -07:00