Add Space-Optimized Helper Variable to Lib Makefile
This diff reorganizes the `lib/Makefile` to extract various settings that a user would normally invoke together (supposing that they were aware of them) if they were trying to build the smallest `libzstd` possible. It collects these settings under a master setting `ZSTD_LIB_MIN_SIZE`. Also document this new option.dev
parent
e103d7b4a6
commit
fa5e01c467
33
lib/Makefile
33
lib/Makefile
|
@ -24,7 +24,6 @@ CPPFLAGS+= -I. -I./common -DXXH_NAMESPACE=ZSTD_
|
||||||
ifeq ($(OS),Windows_NT) # MinGW assumed
|
ifeq ($(OS),Windows_NT) # MinGW assumed
|
||||||
CPPFLAGS += -D__USE_MINGW_ANSI_STDIO # compatibility with %zu formatting
|
CPPFLAGS += -D__USE_MINGW_ANSI_STDIO # compatibility with %zu formatting
|
||||||
endif
|
endif
|
||||||
CFLAGS ?= -O3
|
|
||||||
DEBUGFLAGS= -Wall -Wextra -Wcast-qual -Wcast-align -Wshadow \
|
DEBUGFLAGS= -Wall -Wextra -Wcast-qual -Wcast-align -Wshadow \
|
||||||
-Wstrict-aliasing=1 -Wswitch-enum -Wdeclaration-after-statement \
|
-Wstrict-aliasing=1 -Wswitch-enum -Wdeclaration-after-statement \
|
||||||
-Wstrict-prototypes -Wundef -Wpointer-arith \
|
-Wstrict-prototypes -Wundef -Wpointer-arith \
|
||||||
|
@ -51,18 +50,46 @@ ifeq ($(findstring GCC,$(CCVER)),GCC)
|
||||||
decompress/zstd_decompress_block.o : CFLAGS+=-fno-tree-vectorize
|
decompress/zstd_decompress_block.o : CFLAGS+=-fno-tree-vectorize
|
||||||
endif
|
endif
|
||||||
|
|
||||||
ZSTD_LEGACY_SUPPORT ?= 5
|
# This is a helper variable that configures a bunch of other variables to new,
|
||||||
|
# space-optimized defaults.
|
||||||
|
ZSTD_LIB_MINIFY ?= 0
|
||||||
|
ifneq ($(ZSTD_LIB_MINIFY), 0)
|
||||||
|
HAVE_CC_OZ ?= $(shell echo "" | $(CC) -Oz -x c -c - -o /dev/null 2> /dev/null && echo 1 || echo 0)
|
||||||
|
ZSTD_LEGACY_SUPPORT ?= 0
|
||||||
|
ZSTD_LIB_DEPRECATED ?= 0
|
||||||
|
HUF_FORCE_DECOMPRESS_X1 ?= 1
|
||||||
|
ZSTD_FORCE_DECOMPRESS_SHORT ?= 1
|
||||||
|
ZSTD_NO_INLINE ?= 1
|
||||||
|
ZSTD_STRIP_ERROR_STRINGS ?= 1
|
||||||
|
ifneq ($(HAVE_CC_OZ), 0)
|
||||||
|
# Some compilers (clang) support an even more space-optimized setting.
|
||||||
|
CFLAGS += -Oz
|
||||||
|
else
|
||||||
|
CFLAGS += -Os
|
||||||
|
endif
|
||||||
|
CFLAGS += -fno-stack-protector -fomit-frame-pointer -fno-ident \
|
||||||
|
-DDYNAMIC_BMI2=0 -DNDEBUG
|
||||||
|
else
|
||||||
|
CFLAGS += -O3
|
||||||
|
endif
|
||||||
|
|
||||||
|
# Modules
|
||||||
ZSTD_LIB_COMPRESSION ?= 1
|
ZSTD_LIB_COMPRESSION ?= 1
|
||||||
ZSTD_LIB_DECOMPRESSION ?= 1
|
ZSTD_LIB_DECOMPRESSION ?= 1
|
||||||
ZSTD_LIB_DICTBUILDER ?= 1
|
ZSTD_LIB_DICTBUILDER ?= 1
|
||||||
ZSTD_LIB_DEPRECATED ?= 1
|
ZSTD_LIB_DEPRECATED ?= 1
|
||||||
|
|
||||||
|
# Legacy support
|
||||||
|
ZSTD_LEGACY_SUPPORT ?= 5
|
||||||
|
ZSTD_LEGACY_MULTITHREADED_API ?= 0
|
||||||
|
|
||||||
|
# Build size optimizations
|
||||||
HUF_FORCE_DECOMPRESS_X1 ?= 0
|
HUF_FORCE_DECOMPRESS_X1 ?= 0
|
||||||
HUF_FORCE_DECOMPRESS_X2 ?= 0
|
HUF_FORCE_DECOMPRESS_X2 ?= 0
|
||||||
ZSTD_FORCE_DECOMPRESS_SHORT ?= 0
|
ZSTD_FORCE_DECOMPRESS_SHORT ?= 0
|
||||||
ZSTD_FORCE_DECOMPRESS_LONG ?= 0
|
ZSTD_FORCE_DECOMPRESS_LONG ?= 0
|
||||||
ZSTD_NO_INLINE ?= 0
|
ZSTD_NO_INLINE ?= 0
|
||||||
ZSTD_STRIP_ERROR_STRINGS ?= 0
|
ZSTD_STRIP_ERROR_STRINGS ?= 0
|
||||||
ZSTD_LEGACY_MULTITHREADED_API ?= 0
|
|
||||||
|
|
||||||
ifeq ($(ZSTD_LIB_COMPRESSION), 0)
|
ifeq ($(ZSTD_LIB_COMPRESSION), 0)
|
||||||
ZSTD_LIB_DICTBUILDER = 0
|
ZSTD_LIB_DICTBUILDER = 0
|
||||||
|
|
|
@ -85,28 +85,48 @@ The file structure is designed to make this selection manually achievable for an
|
||||||
|
|
||||||
- While invoking `make libzstd`, it's possible to define build macros
|
- While invoking `make libzstd`, it's possible to define build macros
|
||||||
`ZSTD_LIB_COMPRESSION, ZSTD_LIB_DECOMPRESSION`, `ZSTD_LIB_DICTBUILDER`,
|
`ZSTD_LIB_COMPRESSION, ZSTD_LIB_DECOMPRESSION`, `ZSTD_LIB_DICTBUILDER`,
|
||||||
and `ZSTD_LIB_DEPRECATED` as `0` to forgo compilation of the corresponding features.
|
and `ZSTD_LIB_DEPRECATED` as `0` to forgo compilation of the
|
||||||
This will also disable compilation of all dependencies
|
corresponding features. This will also disable compilation of all
|
||||||
(eg. `ZSTD_LIB_COMPRESSION=0` will also disable dictBuilder).
|
dependencies (eg. `ZSTD_LIB_COMPRESSION=0` will also disable
|
||||||
|
dictBuilder).
|
||||||
|
|
||||||
- There are some additional build macros that can be used to minify the decoder.
|
- There are a number of options that can help minimize the binary size of
|
||||||
|
`libzstd`.
|
||||||
|
|
||||||
Zstandard often has more than one implementation of a piece of functionality,
|
The first step is to select the components needed (using the above-described
|
||||||
where each implementation optimizes for different scenarios. For example, the
|
`ZSTD_LIB_COMPRESSION` etc.).
|
||||||
Huffman decoder has complementary implementations that decode the stream one
|
|
||||||
symbol at a time or two symbols at a time. Zstd normally includes both (and
|
The next step is to set `ZSTD_LIB_MINIFY` to `1` when invoking `make`. This
|
||||||
dispatches between them at runtime), but by defining `HUF_FORCE_DECOMPRESS_X1`
|
disables various optional components and changes the compilation flags to
|
||||||
or `HUF_FORCE_DECOMPRESS_X2`, you can force the use of one or the other, avoiding
|
prioritize space-saving.
|
||||||
|
|
||||||
|
Detailed options: Zstandard's code and build environment is set up by default
|
||||||
|
to optimize above all else for performance. In pursuit of this goal, Zstandard
|
||||||
|
makes significant trade-offs in code size. For example, Zstandard often has
|
||||||
|
more than one implementation of a particular component, with each
|
||||||
|
implementation optimized for different scenarios. For example, the Huffman
|
||||||
|
decoder has complementary implementations that decode the stream one symbol at
|
||||||
|
a time or two symbols at a time. Zstd normally includes both (and dispatches
|
||||||
|
between them at runtime), but by defining `HUF_FORCE_DECOMPRESS_X1` or
|
||||||
|
`HUF_FORCE_DECOMPRESS_X2`, you can force the use of one or the other, avoiding
|
||||||
compilation of the other. Similarly, `ZSTD_FORCE_DECOMPRESS_SEQUENCES_SHORT`
|
compilation of the other. Similarly, `ZSTD_FORCE_DECOMPRESS_SEQUENCES_SHORT`
|
||||||
and `ZSTD_FORCE_DECOMPRESS_SEQUENCES_LONG` force the compilation and use of
|
and `ZSTD_FORCE_DECOMPRESS_SEQUENCES_LONG` force the compilation and use of
|
||||||
only one or the other of two decompression implementations. The smallest
|
only one or the other of two decompression implementations. The smallest
|
||||||
binary is achieved by using `HUF_FORCE_DECOMPRESS_X1` and
|
binary is achieved by using `HUF_FORCE_DECOMPRESS_X1` and
|
||||||
`ZSTD_FORCE_DECOMPRESS_SEQUENCES_SHORT`.
|
`ZSTD_FORCE_DECOMPRESS_SEQUENCES_SHORT` (implied by `ZSTD_LIB_MINIFY`).
|
||||||
|
|
||||||
For squeezing the last ounce of size out, you can also define
|
For squeezing the last ounce of size out, you can also define
|
||||||
`ZSTD_NO_INLINE`, which disables inlining, and `ZSTD_STRIP_ERROR_STRINGS`,
|
`ZSTD_NO_INLINE`, which disables inlining, and `ZSTD_STRIP_ERROR_STRINGS`,
|
||||||
which removes the error messages that are otherwise returned by
|
which removes the error messages that are otherwise returned by
|
||||||
`ZSTD_getErrorName`.
|
`ZSTD_getErrorName` (implied by `ZSTD_LIB_MINIFY`).
|
||||||
|
|
||||||
|
Finally, when integrating into your application, make sure you're doing link-
|
||||||
|
time optimation and unused symbol garbage collection (via some combination of,
|
||||||
|
e.g., `-flto`, `-ffat-lto-objects`, `-fuse-linker-plugin`,
|
||||||
|
`-ffunction-sections`, `-fdata-sections`, `-fmerge-all-constants`,
|
||||||
|
`-Wl,--gc-sections`, `-Wl,-z,norelro`, and an archiver that understands
|
||||||
|
the compiler's intermediate representation, e.g., `AR=gcc-ar`). Consult your
|
||||||
|
compiler's documentation.
|
||||||
|
|
||||||
- While invoking `make libzstd`, the build macro `ZSTD_LEGACY_MULTITHREADED_API=1`
|
- While invoking `make libzstd`, the build macro `ZSTD_LEGACY_MULTITHREADED_API=1`
|
||||||
will expose the deprecated `ZSTDMT` API exposed by `zstdmt_compress.h` in
|
will expose the deprecated `ZSTDMT` API exposed by `zstdmt_compress.h` in
|
||||||
|
|
Loading…
Reference in New Issue