Paul Cruz
|
dcf609f835
|
make adaptCompressionLevel oscillate less
|
2017-07-19 16:36:33 -07:00 |
Paul Cruz
|
2a22c7915e
|
call ZSTD_compressBegin() once
|
2017-07-19 16:00:54 -07:00 |
Paul Cruz
|
6767abe652
|
fixing error when file size is multiple of job size (in which case, the srcSize of the last job is 0)
|
2017-07-19 14:54:15 -07:00 |
Paul Cruz
|
42382c1216
|
added some debug statements, adjusted end condition
|
2017-07-19 13:30:07 -07:00 |
Paul Cruz
|
5a85c57e30
|
set up new calculations compression completion progress
|
2017-07-19 11:47:17 -07:00 |
Paul Cruz
|
f1ac518b59
|
split compression into smaller blocks
|
2017-07-19 11:23:40 -07:00 |
Paul Cruz
|
338951cd48
|
moved compression adapt to avoid warning
|
2017-07-19 10:23:46 -07:00 |
Paul Cruz
|
4497ecf297
|
change compression level only right before actually performing compression. When waiting, only update waiting statistics.
|
2017-07-19 10:14:00 -07:00 |
Paul Cruz
|
e11bf55d0b
|
added mechanism for measuring how much of a job has been created
|
2017-07-19 10:10:47 -07:00 |
Paul Cruz
|
559ea4ff25
|
split up read process into smaller chunks
|
2017-07-19 09:59:17 -07:00 |
Paul Cruz
|
6119cd2164
|
added additional print for help menu
|
2017-07-19 09:43:17 -07:00 |
Paul Cruz
|
3d7f1afadd
|
changed createCCtx() to split into initialization and creation
|
2017-07-18 17:32:36 -07:00 |
Paul Cruz
|
2c4e4ddc50
|
added mutex for stats struct
|
2017-07-18 15:55:58 -07:00 |
Paul Cruz
|
ad66faf16a
|
added progress check for filewriting, put important shared data behind mutex when being read from/written to
|
2017-07-18 15:23:11 -07:00 |
Paul Cruz
|
a34bc30237
|
setting up basic readme
|
2017-07-18 13:31:02 -07:00 |
Paul Cruz
|
29c36cf051
|
rename completion variable, split up fwrite operations in order to track progress
|
2017-07-18 13:30:29 -07:00 |
Paul Cruz
|
ae47eab2fd
|
changed test cases to use -s setting on the diffs
|
2017-07-18 12:58:50 -07:00 |
Paul Cruz
|
5af04c57b0
|
change parameters for compression level adapt
|
2017-07-17 17:59:50 -07:00 |
Paul Cruz
|
b3c9e02bb6
|
added signal to other threads whenever error occurs
|
2017-07-17 15:34:58 -07:00 |
Paul Cruz
|
6be22f1f84
|
swap buffers instead of copying memory over
|
2017-07-17 14:39:10 -07:00 |
Paul Cruz
|
708238e07e
|
open file outside of adaptCCtx, pass to the output thread
|
2017-07-17 14:01:13 -07:00 |
Paul Cruz
|
044e40db5a
|
removed freeCCtx() calls from createCCtx() so that it is not called twice during errors
|
2017-07-17 11:19:23 -07:00 |
Paul Cruz
|
50ce4eaeb6
|
added error detection for pthread initialization, added compression completion measurement, fixed const values
|
2017-07-17 10:12:44 -07:00 |
Paul Cruz
|
1ab3f06f00
|
updated tests to use different seeds when executing different tests
|
2017-07-14 16:29:29 -07:00 |
Paul Cruz
|
0c8b9436b7
|
removed goto statements for the most part
|
2017-07-13 16:38:20 -07:00 |
Paul Cruz
|
65a4ce2635
|
added tests for forced compression level
|
2017-07-13 14:57:24 -07:00 |
Paul Cruz
|
0d9665cef5
|
added additional tests for performance, allowed force compression level for testing purposes
|
2017-07-13 14:46:54 -07:00 |
Paul Cruz
|
9165e97fc6
|
added some tests for correctness, time, and compression ratio
|
2017-07-13 13:50:23 -07:00 |
Paul Cruz
|
766663f1f1
|
added altering dictionary size depending on compression level
|
2017-07-13 10:15:27 -07:00 |
Paul Cruz
|
7c886db0a8
|
changed to stderr
|
2017-07-12 17:28:53 -07:00 |
Paul Cruz
|
b5b18cf664
|
changed to malloc, added comment about adaptive compression level, and changed ternary operators
|
2017-07-12 17:10:58 -07:00 |
Paul Cruz
|
954d999abf
|
fixed up freeCCtx() removed BYTE since it wasn't being used
|
2017-07-12 16:50:43 -07:00 |
Paul Cruz
|
3c16edd26a
|
added copyright header, removed clean from makefile
|
2017-07-12 16:40:24 -07:00 |
Paul Cruz
|
74d3a6f5ae
|
passes tests with adaptive compression level
|
2017-07-12 16:18:41 -07:00 |
Paul Cruz
|
5353d350ae
|
working with fixed compression level and fixed dictionary size
|
2017-07-12 16:02:20 -07:00 |
Paul Cruz
|
356ddb649f
|
working with flush job->src.size and fixed cLevel
|
2017-07-12 12:21:21 -07:00 |
Paul Cruz
|
0a401852c4
|
added debug statement
|
2017-07-11 16:50:50 -07:00 |
Paul Cruz
|
72a183efad
|
changed dictionary size, added debugging statements
|
2017-07-11 15:49:52 -07:00 |
Paul Cruz
|
7c54e09347
|
updated DEBUG statements
|
2017-07-11 15:15:41 -07:00 |
Paul Cruz
|
a3c077b8c6
|
added error message, updated copying dictionary into the input buffer
|
2017-07-11 15:00:52 -07:00 |
Paul Cruz
|
34afb9b23e
|
changed to using ZSTD_compressBegin_usingDict() and fixed strange issue with ZSTD_compressContinue()
|
2017-07-11 11:50:00 -07:00 |
Paul Cruz
|
7ec5928626
|
fixed an error where -c argument wasn't working for single files
|
2017-07-11 10:23:25 -07:00 |
Paul Cruz
|
f918545491
|
made some progress on improving compression ratio, but problems exist with speed limits, and for some reason higher compression levels are really slow
|
2017-07-10 18:16:42 -07:00 |
Paul Cruz
|
01fc7c4244
|
changed how the detection of the last job works
|
2017-07-10 16:27:58 -07:00 |
Paul Cruz
|
c36552ef8a
|
dst buffer should use ZSTD_compressBound to determine how much space it needs
|
2017-07-10 16:10:19 -07:00 |
Paul Cruz
|
7aa36df6df
|
fixed memory leak that was happening when creating jobs
|
2017-07-10 16:03:09 -07:00 |
Paul Cruz
|
e410d63d45
|
made input buffer an internal part of the compression context
|
2017-07-10 15:37:14 -07:00 |
Paul Cruz
|
cc7f8e4d71
|
small changes
|
2017-07-10 11:10:11 -07:00 |
Paul Cruz
|
7e09b508ff
|
changed name
|
2017-07-10 11:05:37 -07:00 |
Paul Cruz
|
ed72ea5438
|
removed single from Makefile
|
2017-07-10 10:58:03 -07:00 |