55a8bea0b5
fixed dictionary generation
2016-07-27 14:48:47 +02:00
c154d9d6a2
better support for large dictionaries (> 128 KB)
2016-07-27 14:37:00 +02:00
07626dfa51
improved dictbuilder notifications on selectivity
2016-07-27 13:28:46 +02:00
f796f7ab45
removed fastscan mode
2016-07-27 12:53:54 +02:00
dd25a27702
added tutorial warning messages for dictBuilder
2016-07-27 12:43:09 +02:00
cf05b9d477
ZSTD_getBlockSizeMax()
2016-07-18 16:52:10 +02:00
e557fd5e92
minor compression level corrections
2016-07-17 16:21:37 +02:00
f6ff53cd4e
implemented dictID reserved ranges
2016-07-15 17:03:38 +02:00
961b6a0e34
ZSTD_compressBlock() limits block size depending on windowLog parameter
2016-07-15 11:58:49 +02:00
e9ed5cdc94
fixed minor coverity warning
2016-07-14 21:02:57 +02:00
17508f1a16
fixed a few minor coverity warnings
2016-07-14 17:18:20 +02:00
69c2cdb45c
fixed conversion warning
2016-07-14 16:52:45 +02:00
3c174f4da9
fixed minor coverity warning
2016-07-13 17:25:53 +02:00
fbc69f8649
changed for #245
2016-07-13 13:52:58 +02:00
29652e2618
sample set limitation closer to 2 GB
2016-07-06 16:25:46 +02:00
99b045b70a
dictBuilder protection vs huge sample sets (>2 GB)
2016-07-06 16:12:38 +02:00
445d49d898
fixed conversion warning
2016-07-06 13:27:22 +02:00
a295b3170f
fixed conversion warning
2016-07-06 13:13:12 +02:00
517e1ba623
fixed dictBuilder issue with HC levels. Reported by Bartosz Taudul.
2016-07-06 12:35:09 +02:00
c093208ab8
fix : potential leak ( #229 )
2016-06-30 14:07:30 +02:00
23042929da
Fixed : dictBuilder fails if first sample is too small
2016-06-22 11:05:34 +02:00
ad39b7a718
zdict stores standard rep-offset.
...
It can use custom ones, but the proper formula and impact on statistics is not done yet.
2016-06-16 01:14:41 +02:00
52a0622beb
RepsCodes are saved into Dict
...
(uncomplete : need decompression to regenerate them)
2016-06-16 01:05:04 +02:00
130fe11394
merged `huf_static.h` into `huf.h` . Requires `HUF_STATIC_LINKING_ONLY` macro.
2016-06-05 00:42:28 +02:00
49bb0041af
removed `ZSTD_highbit()` from `zstd_internal.h`, as it is only used by `zstd_compress.c`
2016-06-04 20:17:38 +02:00
e69b8ccceb
merged `zdict_static.h` into `zdict.h`. Now requires `ZDICT_STATIC_LINKING_ONLY` macro.
2016-06-04 18:56:23 +02:00
370b751e24
Expose function to add entropy tables to pre-built dictionary.
...
In some cases a custom dictionary building algorithm tailored for a specific
input can be more effective than the one produced by `ZDICT_trainFromBuffer`,
but with the current API it's not possible encode the entropy tables into the
custom-built dictionary.
This commit extracts the logic to add entropy tables to a dictionary from
`ZDICT_trainFromBuffer` and exposes it as a function
`ZDICT_addEntropyTablesFromBuffer`.
2016-05-30 19:50:09 -07:00
290aaa7521
Added : ability to manually select the dictionary ID of a newly created dictionary
2016-05-30 21:18:52 +02:00
c46fb924df
added dictionary ID (incomplete)
2016-05-29 05:01:04 +02:00
d5ff2c3d9a
ordering of #include
2016-04-28 14:40:45 +02:00
69fcd7c0ae
getFileSize moved to common/util.h
2016-04-28 12:23:33 +02:00
23a0889301
separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/
2016-04-22 12:43:18 +02:00
Yann Collet
Giuseppe Ottaviano
inikep