Commit Graph

628 Commits (ac3a136b0ac1a0b9e054dd96e19c9ec72213fd90)

Author SHA1 Message Date
Nick Terrell 9c257dc268 Fix up xxhash 2017-04-04 15:54:39 -07:00
Nick Terrell 0888251fb1 Switch intptr_t to ptrdiff_t 2017-04-04 15:49:38 -07:00
Nick Terrell 675839254d Move zstd.h to linux/zstd.h 2017-04-04 15:44:27 -07:00
Nick Terrell b06507221e Test module macros 2017-04-04 12:56:44 -07:00
Nick Terrell b1b582b9fa Add module macros 2017-04-04 12:56:35 -07:00
Nick Terrell b5e3e3c9a8 Add zstd kernel module Makefile 2017-04-04 12:10:47 -07:00
Nick Terrell 79298bf187 Add userland test with mock kernel headers 2017-04-04 11:53:22 -07:00
Nick Terrell 33fc0ad56a Fix ZSTD_createCStream_usingCDict() and ZSTD_compress_usingCDict() 2017-04-04 11:52:49 -07:00
Nick Terrell 87cec8fd56 Fix compilation errors 2017-04-03 16:08:20 -07:00
Nick Terrell 59aadc85dc Preallocate workSpace for cctx and combine create and init for cstream 2017-04-03 15:23:09 -07:00
Nick Terrell 21b6c53b9f Working on API 2017-03-31 18:07:32 -07:00
Nick Terrell e48b135521 Remove STATIC_LINKING_ONLY defines 2017-03-30 14:54:33 -07:00
Nick Terrell 6ce58897da Use <asm/unaligned.h> for unaligned memory access 2017-03-30 14:53:57 -07:00
Nick Terrell be7da5d98b Change stdlib includes to linux includes 2017-03-30 14:53:52 -07:00
Nick Terrell b3b41d0f6d Remove platform specific macros 2017-03-30 14:53:23 -07:00
Nick Terrell 1075c12078 Convert all spaces to tabs 2017-03-30 14:49:45 -07:00
Nick Terrell 78063ca2bd spaces to tabs 2017-03-30 14:47:42 -07:00
Nick Terrell b1c6bb8702 Copy files into contrib/linux-kernel/ 2017-03-30 14:47:35 -07:00
Yann Collet 6851db48e0 created contrib/cleanTabs 2017-03-30 12:42:44 -07:00
Sean Purcell 793e7bb6dd Add symbolic link checking to pzstd 2017-03-23 12:41:51 -07:00
Yann Collet 7e35b352c6 Merge pull request #602 from iburinoc/doc
Add functions missing from manual, and fix parameter alignment
2017-03-14 14:08:41 -07:00
Sean Purcell dec2b96536 Add functions missing from manual, and fix parameter alignment 2017-03-14 11:24:09 -07:00
Sean Purcell 120df494e9 Update builds to not support legacy v01-v03 2017-03-13 14:44:08 -07:00
Pádraig Brady 38a3428b37 support -Werror=format-security
Fedora now enables this option by default, resulting
in the following build failure:

Logging.h: In instantiation of
'void pzstd::Logger::operator()(int, const char*, Args ...)
Pzstd.cpp:413:48:   required from here
Logging.h:46:17: error: format not a string literal and no format arguments
[-Werror=format-security]
     std::fprintf(out_, fmt, args...);
     ~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~
2017-03-05 19:42:51 -08:00
Sean Purcell 822c7187d4 Merge branch 'dev' into doc 2017-02-23 15:23:24 -08:00
Yann Collet 7e224ea03e Merge pull request #562 from iburinoc/testcorpus
Create a tool that generates random, valid, Zstd frames for decoder testing
2017-02-23 15:19:36 -08:00
Sean Purcell 1d1932480e Move educational_decoder to doc/ and add doc README
- Also make some minor bugfixes to educational decoder
2017-02-23 14:34:52 -08:00
Yann Collet db478ad27e Merge pull request #558 from facebook/manual
Manual
2017-02-23 13:39:36 -08:00
Sean Purcell 3cd8d50c34 Update CLI and link from educational decoder 2017-02-23 13:06:50 -08:00
Yann Collet 508404514c added `manual` target to contrib/gen_html/Makefile 2017-02-22 00:57:50 -08:00
Przemyslaw Skibinski 346ce32ade legacy.c: fix memory leaks 2017-02-21 20:10:21 +01:00
Przemyslaw Skibinski d8114e5802 zstd_compress.c: fix memory leaks 2017-02-21 18:59:56 +01:00
Przemyslaw Skibinski 684858e7b7 fix memory leaks 2017-02-21 18:17:24 +01:00
Dima Krasner 107c9a4e42 Moved to contrib 2017-02-18 23:30:57 +02:00
Sean Purcell 0f5c95af44 Disambiguate pledgedSrcSize == 0
- Modify ZSTD CLI to only set contentSizeFlag if it _knows_ the size
- Change pzstd to stop setting contentSizeFlag without accurate pledgedSrcSize
2017-02-08 15:12:46 -08:00
Sean Purcell eb52dbd4fe Minor changes to educational decoder 2017-02-07 14:44:11 -08:00
Sean Purcell f191be2fe6 Inlined portions of specification for clarity 2017-02-03 18:04:00 -08:00
Sean Purcell 18ce8b54dd Switch IO to go through streams 2017-02-03 15:22:52 -08:00
Sean Purcell 823d8c233b Minor security fixes 2017-02-01 10:41:04 -08:00
Sean Purcell 92ec2ea62f More const's and readability improvements 2017-01-31 15:57:18 -08:00
Sean Purcell f5d2f32d4d Removed circular buffer, matches access destination buffer directly 2017-01-31 15:54:55 -08:00
Sean Purcell f231626244 Minor fixes according to comments
- Add Facebook copyright notice
- Make max size macros more consistent
- Fix some unchecked malloc's
2017-01-30 15:00:19 -08:00
Sean Purcell 5657e0e07d Added ZSTD_get_decompressed_size
Since this implementation handles multiple concatenated frames,
to determine decompressed size we must traverse the entire input,
checking each frame's frame_content_size field
2017-01-30 14:56:29 -08:00
Sean Purcell 9700f92583 Add educational decoder to /contrib 2017-01-30 11:44:43 -08:00
Nick Terrell 5cf84a05e7 Revert unnecessary change to Logging.h 2017-01-27 13:26:44 -08:00
Nick Terrell 58f499c41e Clean imports and shorten tests 2017-01-27 10:43:18 -08:00
Nick Terrell 9c018cc140 Add BUCK files for Nuclide support 2017-01-27 10:43:12 -08:00
Chocobo1 37a2fb4ce1 Move -std=c++11 cxxflag to PZSTD_CXXFLAGS
Fixes the problem that the compiler doesn't enable c++11 mode by default
and the package build system has its own CXXFLAGS
2016-12-26 23:08:23 +08:00
Dimitry Andric 83cc2fb083 Enable using isatty() and nanosleep() on *BSD 2016-12-12 19:24:51 +01:00
Przemyslaw Skibinski 4da53219a0 zstd Manual updated to 1.1.2 2016-12-07 11:18:40 +01:00
Przemyslaw Skibinski abd9ec0d53 gen_html: comments of type /*= and /**= can be longer than a single line 2016-12-07 11:13:20 +01:00
Yann Collet 379908be3d fixed zstd.h for manual 2016-12-06 10:36:15 -08:00
Nick Terrell bcd61586a8 [pzstd] Cast unused parameters to void 2016-11-15 17:46:28 -08:00
Nick Terrell f147fccd0c [pzstd] Fix frame size for small files + add logging 2016-11-15 16:39:09 -08:00
Nick Terrell 324c8ab000 [pzstd] Remove gtest dependency from make all 2016-11-14 11:56:28 -08:00
Nick Terrell 4bafb5aa97 The static library was moved to libzstd.a 2016-11-03 11:32:45 -07:00
Przemyslaw Skibinski f882e132cf added gen-zstd-manual.sh 2016-10-31 10:51:58 +01:00
Yann Collet 03982b5ddb Merge pull request #434 from terrelln/dev
Pzstd Improvements
2016-10-28 20:27:59 -07:00
Nick Terrell 25086d9bc6 [pzstd] Move -I flags to PZSTD_CPPFLAGS 2016-10-28 14:24:15 -07:00
Nick Terrell ac4310d303 [pzstd] Fix test mode for streaming input 2016-10-26 00:09:39 -07:00
Przemyslaw Skibinski 86d9424c81 added doc\zstd_manual.html 2016-10-24 16:07:53 +02:00
Przemyslaw Skibinski 984b66cd72 added contrib\gen_html 2016-10-24 15:59:51 +02:00
Nick Terrell 8c6c686d0a [pzstd] Fix lantent bug in WorkQueue::push() 2016-10-14 15:26:56 -07:00
Nick Terrell baa152e56e [pzstd] Add Logger class 2016-10-14 15:26:55 -07:00
Nick Terrell e9e151ce31 [pzstd] Reuse ZSTD_{C,D}Stream 2016-10-14 15:26:55 -07:00
Nick Terrell 48294b57c3 [pzstd] Put ErrorHolder into SharedState 2016-10-14 15:26:55 -07:00
Nick Terrell 9b603ee284 [pzstd] Run the reading thread separately 2016-10-14 15:26:55 -07:00
Nick Terrell 96e0702c00 [pzstd] Print the correct width ints 2016-10-14 15:26:55 -07:00
Nick Terrell 8b4e84249b [pzstd] Fix Makefile 2016-10-14 15:26:50 -07:00
Nick Terrell 87629978d3 [pzstd] Fix latent bug in WorkQueue 2016-10-06 15:51:58 -07:00
Pádraig Brady 0dd8071e2e pzstd: fix test failure on headless build
Remove this test as pass/fail status is
dependent on whether I/O is connected to a tty.
It currrently passes on a tty but fails on
a package build system for example.
2016-10-06 22:38:27 +01:00
Nick Terrell b0f6d73002 [pzstd] Remove empty else statement 2016-10-06 12:58:23 -07:00
Nick Terrell 5fa71396e0 [pzstd] Fix typo in readme 2016-10-06 12:45:47 -07:00
inikep 0ff0f2a259 Merge remote-tracking branch 'refs/remotes/facebook/dev' into zlibWrapper 2016-09-26 20:57:01 +02:00
Yann Collet 02c17e18d8 Merge pull request #387 from terrelln/display
[pzstd] Print (de)compression results
2016-09-24 11:52:29 +02:00
Nick Terrell 3980167488 [pzstd] Add status update for MB written 2016-09-23 15:47:26 -07:00
Nick Terrell dac0376908 [pzstd] Add header required for Visual Studios 2016-09-23 14:38:25 -07:00
Nick Terrell d249889b9f [pzstd] Print (de)compression results 2016-09-23 13:42:50 -07:00
Nick Terrell e5b60e859b [pzstd] Update README to reflect new CLI 2016-09-23 13:07:54 -07:00
inikep 611cd094d1 typo in pzstd 2016-09-23 21:14:37 +02:00
Nick Terrell 5ca471990b [pzstd] Spawn less threads in tests
MinGW thread performance degrades significantly when there are
a lot of threads, so limit the number of threads spawned to ~10.
2016-09-22 18:59:22 -07:00
Nick Terrell 5eaf5da723 [pzstd] Turn on warnings + quiet them 2016-09-22 16:12:29 -07:00
Nick Terrell 0a5910b23b [pzstd] Fix and test 32 bit support 2016-09-21 17:47:09 -07:00
Nick Terrell 5c9adff7f8 [pzstd] Check if input is a directory 2016-09-21 16:25:08 -07:00
Nick Terrell f1073c1da7 [pzstd] Fix invalid argument message 2016-09-21 16:04:44 -07:00
Nick Terrell 1c209a4feb [pzstd] Reduce memory usage to 60-75% of previous 2016-09-21 15:12:23 -07:00
Nick Terrell 254c5b1692 [pzstd] Make CLI compatible with zstd 2016-09-21 14:29:47 -07:00
Nick Terrell 4d4d1ad3b3 Fix minor potential narrowing bug 2016-09-06 20:27:11 -07:00
Nick Terrell 823bf3d08d Fix invalid narrowing conversion to size_t 2016-09-06 20:11:02 -07:00
Nick Terrell 4db9fbdec7 [pzstd] Compile with minGW 64 2016-09-06 14:00:20 -07:00
Nick Terrell 378d12bb0c [pzstd] Changes to compile on VS2015 2016-09-06 12:43:07 -07:00
Nick Terrell 4c202815c7 [pzstd] Smart default # of threads (#331) 2016-09-06 12:41:36 -07:00
Nick Terrell 9622fe499d Fix memory usage issues. 2016-09-02 20:11:22 -07:00
Nick Terrell 64c1c065cc Add optional max size to work queue 2016-09-02 13:53:23 -07:00
Nick Terrell 2fcf8a4b99 Update tests to reflect new default options 2016-09-02 12:59:14 -07:00
Nick Terrell ac14348a28 When reading from stdin, write to stdout by default 2016-09-02 12:35:36 -07:00
Nick Terrell 1e2f6a1f5d Clean up compiler warnings + Build pzstd on travis 2016-09-02 12:23:49 -07:00
Nick Terrell 2ebe1cf732 Put libzstd last 2016-09-01 21:12:39 -07:00
Nick Terrell 7bf8c4d7ff Add zstd/lib in includes 2016-09-01 20:53:34 -07:00
Nick Terrell 724e3d534f Put linker -l commands at the end 2016-09-01 20:45:55 -07:00
Nick Terrell 7aa7e5aaab Merge remote-tracking branch 'upstream/dev' into dev 2016-09-01 18:27:18 -07:00
Nick Terrell 7df55e17e9 Fix up Makefiles, and fix include issues compiling with gcc 2016-09-01 18:26:19 -07:00
Yann Collet c53926c077 Merge branch 'dev' of github.com:Cyan4973/zstd into dev 2016-09-01 18:11:43 -07:00
Yann Collet 5153a084f3 zbufftest only depends on standard C time.h 2016-09-01 18:11:12 -07:00
Nick Terrell bff1c92c87 Minor tweaks to pzstd graph 2016-09-01 17:53:23 -07:00
Nick Terrell 2741677a8d Update scale for compression speed graph 2016-09-01 17:43:07 -07:00
Nick Terrell 2b0830b067 Randomize tests so travis-ci tests can check for existing failures 2016-09-01 16:39:45 -07:00
Nick Terrell 040cfd8e7d Get ready to add tests to travis-ci 2016-09-01 16:21:19 -07:00
Nick Terrell 4c3b1881f2 Remove old benchmark code 2016-09-01 15:32:10 -07:00
Nick Terrell f381d2d39c Fix small README things 2016-09-01 15:30:36 -07:00
Nick Terrell c932520960 Add PZstandard to contrib/ 2016-09-01 15:25:31 -07:00
inikep 33b8a893ed CMake project moved to projects 2016-05-24 17:44:14 +02:00
inikep 63ecd747de added common/entropy_common.c 2016-05-13 11:27:56 +02:00
inikep aaaf923a17 common/util.h moved to programs/util.h
decompress/fse_decompress.c moved to common/
2016-05-09 16:19:25 +02:00
inikep a1febea01d Error functions moved to common/zstd_common.c 2016-04-22 17:14:25 +02:00
inikep d6be2751a8 updated CMakeLists.txt 2016-04-22 13:59:21 +02:00
Yann Collet 62ae5fb0d2 zstd_buffered => zbuff 2016-02-12 18:59:11 +01:00
Yann Collet e0a3084d30 fixed cmake 2016-02-12 18:48:07 +01:00
Yann Collet 883a67eee2 fixed cmake 2016-02-12 03:50:05 +01:00
Yann Collet dd283b1f4f fixed cmake 2016-01-21 16:08:01 +01:00
Artyom Dymchenko 52197bcd32 CMake minimal version 2.8.7 test 2016-01-13 00:18:49 +06:00
Artyom Dymchenko 0b7c10121e CMake 2.8.8 final test; 2016-01-11 23:40:16 +06:00
Artyom Dymchenko a207930d30 CMake 2.8.11 with travis test; 2016-01-11 23:03:55 +06:00
Artyom Dymchenko 706ced3553 CMake check version test; 2016-01-11 22:50:57 +06:00
Artyom Dymchenko 1e0081699b travis and CMake 2.8.8 installation test; 2016-01-11 21:39:42 +06:00
Yann Collet 3a3b72f25a Implemented ZSTD_HEAPMODE for zstd_decompress.c
Reduce cmake version requirement to 2.8.7
2016-01-11 12:56:11 +01:00
Artyom Dymchenko 7e98daa32d Add math library -lm into paramgrill linker flag; 2016-01-11 00:33:54 +06:00
Artem Dymchenko cf018f0c03 typo finally fixed; 2016-01-10 20:08:32 +06:00