zstd/lib/README.md

120 lines
5.6 KiB
Markdown
Raw Normal View History

2016-08-29 04:04:26 -07:00
Zstandard library files
================================
2017-09-06 16:15:18 -07:00
The __lib__ directory is split into several sub-directories,
2017-12-31 06:50:00 -08:00
in order to make it easier to select or exclude features.
2017-09-06 16:15:18 -07:00
#### Building
2017-12-31 06:50:00 -08:00
`Makefile` script is provided, supporting all standard [Makefile conventions](https://www.gnu.org/prep/standards/html_node/Makefile-Conventions.html#Makefile-Conventions),
including commands variables, staged install, directory variables and standard targets.
2017-09-06 16:15:18 -07:00
- `make` : generates both static and dynamic libraries
- `make install` : install libraries in default system directories
2017-12-31 06:50:00 -08:00
`libzstd` default scope includes compression, decompression, dictionary building,
and decoding support for legacy formats >= v0.4.0.
2016-07-17 11:42:21 -07:00
#### API
2016-04-25 02:31:28 -07:00
2017-09-06 16:15:18 -07:00
Zstandard's stable API is exposed within [lib/zstd.h](zstd.h).
2016-03-09 16:09:41 -08:00
2016-07-17 11:42:21 -07:00
#### Advanced API
2016-04-25 02:36:44 -07:00
2017-09-06 16:15:18 -07:00
Optional advanced features are exposed via :
- `lib/common/zstd_errors.h` : translates `size_t` function results
into an `ZSTD_ErrorCode`, for accurate error handling.
- `ZSTD_STATIC_LINKING_ONLY` : if this macro is defined _before_ including `zstd.h`,
it unlocks access to advanced experimental API,
exposed in second part of `zstd.h`.
2017-12-31 06:50:00 -08:00
These APIs are not "stable", their definition may change in the future.
2018-01-29 09:42:20 -08:00
As a consequence, it shall ___never be used with dynamic library___ !
2016-07-17 11:42:21 -07:00
Only static linking is allowed.
2016-04-25 02:31:28 -07:00
2016-07-17 11:42:21 -07:00
#### Modular build
2016-04-25 02:31:28 -07:00
2017-12-31 06:50:00 -08:00
It's possible to compile only a limited set of features.
2017-09-06 16:15:18 -07:00
- Directory `lib/common` is always required, for all variants.
- Compression source code lies in `lib/compress`
- Decompression source code lies in `lib/decompress`
- It's possible to include only `compress` or only `decompress`, they don't depend on each other.
- `lib/dictBuilder` : makes it possible to generate dictionaries from a set of samples.
2017-12-31 06:50:00 -08:00
The API is exposed in `lib/dictBuilder/zdict.h`.
This module depends on both `lib/common` and `lib/compress` .
- `lib/legacy` : source code to decompress legacy zstd formats, starting from `v0.1.0`.
This module depends on `lib/common` and `lib/decompress`.
To enable this feature, it's required to define `ZSTD_LEGACY_SUPPORT` during compilation.
Typically, with `gcc`, add argument `-DZSTD_LEGACY_SUPPORT=1`.
Using higher number limits versions supported.
For example, `ZSTD_LEGACY_SUPPORT=2` means : "support legacy formats >= v0.2.0".
`ZSTD_LEGACY_SUPPORT=3` means : "support legacy formats >= v0.3.0", and so on.
Starting v0.8.0, all versions of `zstd` produce frames compliant with specification.
As a consequence, `ZSTD_LEGACY_SUPPORT=8` (or more) doesn't trigger legacy support.
Also, `ZSTD_LEGACY_SUPPORT=0` means "do __not__ support legacy formats".
Once enabled, this capability is transparently triggered within decompression functions.
It's also possible to invoke directly legacy API, as exposed in `lib/legacy/zstd_legacy.h`.
Each version also provides an additional dedicated set of advanced API.
For example, advanced API for version `v0.4` is exposed in `lib/legacy/zstd_v04.h` .
Note : `lib/legacy` only supports _decoding_ legacy formats.
2018-06-04 09:56:37 -07:00
- Similarly, you can define `ZSTD_LIB_COMPRESSION, ZSTD_LIB_DECOMPRESSION`, `ZSTD_LIB_DICTBUILDER`,
and `ZSTD_LIB_DEPRECATED` as 0 to forgo compilation of the corresponding features. This will
also disable compilation of all dependencies (eg. `ZSTD_LIB_COMPRESSION=0` will also disable
dictBuilder).
2017-09-06 16:15:18 -07:00
#### Multithreading support
2017-09-06 16:23:39 -07:00
Multithreading is disabled by default when building with `make`.
2017-09-06 16:15:18 -07:00
Enabling multithreading requires 2 conditions :
- set macro `ZSTD_MULTITHREAD`
2017-12-31 06:50:00 -08:00
- on POSIX systems : compile with pthread (`-pthread` compilation flag for `gcc`)
2017-09-06 16:15:18 -07:00
Both conditions are automatically triggered by invoking `make lib-mt` target.
Note that, when linking a POSIX program with a multithreaded version of `libzstd`,
it's necessary to trigger `-pthread` flag during link stage.
2017-12-31 06:50:00 -08:00
Multithreading capabilities are exposed
via [advanced API `ZSTD_compress_generic()` defined in `lib/zstd.h`](https://github.com/facebook/zstd/blob/dev/lib/zstd.h#L919).
This API is still considered experimental,
but is expected to become "stable" at some point in the future.
2017-09-06 16:15:18 -07:00
#### Windows : using MinGW+MSYS to create DLL
DLL can be created using MinGW+MSYS with the `make libzstd` command.
This command creates `dll\libzstd.dll` and the import library `dll\libzstd.lib`.
The import library is only required with Visual C++.
The header file `zstd.h` and the dynamic library `dll\libzstd.dll` are required to
compile a project using gcc/MinGW.
The dynamic library has to be added to linking options.
It means that if a project that uses ZSTD consists of a single `test-dll.c`
file it should be linked with `dll\libzstd.dll`. For example:
```
gcc $(CFLAGS) -Iinclude/ test-dll.c -o test-dll dll\libzstd.dll
```
The compiled executable will require ZSTD DLL which is available at `dll\libzstd.dll`.
2017-09-06 16:15:18 -07:00
#### Deprecated API
2017-09-06 16:15:18 -07:00
Obsolete API on their way out are stored in directory `lib/deprecated`.
At this stage, it contains older streaming prototypes, in `lib/deprecated/zbuff.h`.
These prototypes will be removed in some future version.
Consider migrating code towards supported streaming API exposed in `zstd.h`.
#### Miscellaneous
The other files are not source code. There are :
2017-09-06 16:15:18 -07:00
- `LICENSE` : contains the BSD license text
2017-09-06 16:23:39 -07:00
- `Makefile` : `make` script to build and install zstd library (static and dynamic)
- `BUCK` : support for `buck` build system (https://buckbuild.com/)
2017-09-06 16:15:18 -07:00
- `libzstd.pc.in` : for `pkg-config` (used in `make install`)
- `README.md` : this file