Yann Collet
18b795374a
UTIL_getFileSize() returns UTIL_FILESIZE_UNKNOWN on failure
...
UTIL_getFileSize() used to return zero on failure.
This made it impossible to distinguish a failure from a genuine empty file.
Both cases where coalesced.
Adding UTIL_FILESIZE_UNKNOWN constant has many consequences on user code,
since in many places, the `0` was assumed to mean "error".
This is no longer the case, and the error code must be actively checked.
2017-10-17 16:14:25 -07:00
Yann Collet
1722055799
add comment on using -B# to split input file for dictionary training
2017-09-15 16:23:50 -07:00
Yann Collet
c68d17f2da
ensures that sampleSizes table is large enough
...
as recommended by @terrelln
2017-09-15 15:31:31 -07:00
Yann Collet
25a60488dd
fixed 64-to-32 conversion warnings
2017-09-15 11:55:13 -07:00
Yann Collet
a9694231ca
fixed minor conversion warning
2017-09-15 10:16:26 -07:00
Yann Collet
086b9597d9
added ability to split input files for dictionary training
...
using command -B#
This is the same behavior as benchmark module,
which can also split input into arbitrary size blocks, using -B#.
2017-09-14 16:45:10 -07:00
Yann Collet
77c137b3ae
minor comment refactor
2017-09-14 15:12:57 -07:00
Yann Collet
3128e03be6
updated license header
...
to clarify dual-license meaning as "or"
2017-09-08 00:09:23 -07:00
Yann Collet
32fb407c9d
updated a bunch of headers
...
for the new license
2017-08-18 16:52:05 -07:00
Nick Terrell
5b7fd7c422
[zdict] Make COVER the default algorithm
2017-06-26 21:09:22 -07:00
Sean Purcell
42bac7fa84
Change ifndef's to undef's
2017-04-13 15:35:05 -07:00
Sean Purcell
f876f1200c
Fix compilation on macOS
2017-04-13 12:33:45 -07:00
Sean Purcell
042ba122ae
Change g_displayLevel to int and fix DISPLAYUPDATE flush
2017-03-23 11:21:59 -07:00
Nick Terrell
c220d4c74d
Use COVER_MEMMULT when training with COVER.
2017-01-09 16:49:04 -08:00
Nick Terrell
3a1fefcf00
Simplify COVER parameters
2017-01-02 17:51:38 -08:00
Nick Terrell
df8415c502
Add COVER to the zstd cli
2017-01-02 14:43:08 -08:00
Przemyslaw Skibinski
7a8a03c20d
util.h: restore BSD license for Facebook Open-Source
2016-12-21 15:08:44 +01:00
Przemyslaw Skibinski
e679741b18
_CRT_SECURE_NO_WARNINGS moved to util.h
2016-12-21 13:47:11 +01:00
Przemyslaw Skibinski
2f6ccee6af
platform.h: removed Compiler Options
2016-12-21 13:23:34 +01:00
Przemyslaw Skibinski
16ae6563a2
executables use new util.h and platform.h
2016-12-21 09:06:14 +01:00
Przemyslaw Skibinski
f8046b8e72
Merge remote-tracking branch 'refs/remotes/facebook/dev' into v112
...
# Conflicts:
# appveyor.yml
2016-12-19 08:20:26 +01:00
Yann Collet
1496c3dc47
Fix : size estimation when some samples are very large
2016-12-18 11:58:23 +01:00
Yann Collet
d46ecb58a5
added dll compilation tests
2016-12-17 16:28:12 +01:00
Przemyslaw Skibinski
b866e72826
tools use platform.h
2016-12-16 14:24:01 +01:00
Yann Collet
4ded9e591c
added boilerplate
2016-08-30 11:06:28 -07:00
Yann Collet
49d105cfcf
better warning and error messages in case of dictionary training failure ( #292 )
2016-08-18 15:02:11 +02:00
Yann Collet
dd25a27702
added tutorial warning messages for dictBuilder
2016-07-27 12:43:09 +02:00
Yann Collet
a3d03a3973
added <errno.h> dependency
2016-07-06 16:27:17 +02:00
Yann Collet
bcb5f77efa
dictBuilder manages better samples of null size 0 and large size > 128 KB
2016-07-06 15:41:03 +02:00
Yann Collet
290aaa7521
Added : ability to manually select the dictionary ID of a newly created dictionary
2016-05-30 21:18:52 +02:00
inikep
3733797fcd
bench.c: experimental -r (operate recursively on directories) for Windows and _POSIX_C_SOURCE >= 200112L
2016-05-10 14:22:55 +02:00
inikep
ed9a08538c
Merge remote-tracking branch 'refs/remotes/Cyan4973/dev' into dev
...
# Conflicts:
# lib/common/util.h
# programs/paramgrill.c
# visual/2013/fullbench/fullbench.vcxproj.filters
# visual/2013/fuzzer/fuzzer.vcxproj.filters
2016-05-10 13:20:01 +02:00
Yann Collet
f6ca09b5ff
Reduced console display on loading lots of files with `zstd --train`. Reported by @KrzysFR, see #177
2016-05-09 04:44:45 +02:00
inikep
13c8424ea0
code cleaning
2016-05-05 13:58:56 +02:00
inikep
9c22e57bfb
Compiler Options moved to util.h
2016-05-05 11:53:42 +02:00
inikep
bab4317961
util.h must the the first include to #define _POSIX_C_SOURCE
2016-04-29 15:19:40 +02:00
inikep
55d047aa92
getTotalFileSize moved to common/util.h
2016-04-28 16:50:13 +02:00
inikep
d5ff2c3d9a
ordering of #include
2016-04-28 14:40:45 +02:00
inikep
69fcd7c0ae
getFileSize moved to common/util.h
2016-04-28 12:23:33 +02:00
inikep
23a0889301
separation of lib/ into common/, compress/, decompress/, dictBuilder/, legacy/
2016-04-22 12:43:18 +02:00
Yann Collet
7de4f9fd81
minor cosmetic
2016-02-23 21:34:18 +01:00
Yann Collet
6f3acbac0d
notificationLevel into ZDICT_param_t
2016-02-12 20:19:48 +01:00
Yann Collet
f4c9d75370
dictBuilder => zdict
2016-02-12 18:45:02 +01:00
Yann Collet
71eafdd23f
Integrated dictionary builder into zstd cli
2016-02-12 02:31:57 +01:00