History

Yann Collet c49ccbc8e7 largeNbDicts : can select a nb of blocks will automatically truncate or repeat input as needed, to create the requested nb of blocks. default: nb of files, eventually increased appropriately if blockSize is set		2018-09-12 11:31:28 -07:00
..
.gitignore	first working test program	2018-08-28 15:47:07 -07:00
Makefile	fixed link order for old compilers	2018-08-30 16:43:28 -07:00
README.md	updated documentation	2018-09-04 14:57:45 -07:00
largeNbDicts.c	largeNbDicts : can select a nb of blocks	2018-09-12 11:31:28 -07:00

README.md

largeNbDicts

largeNbDicts is a benchmark test tool dedicated to the specific scenario of dictionary decompression using a very large number of dictionaries. When dictionaries are constantly changing, they are always "cold", suffering from increased latency due to cache misses.

The tool is created in a bid to investigate performance for this scenario, and experiment mitigation techniques.

Command line :

largeNbDicts [Options] filename(s)

Options :
-r           : recursively load all files in subdirectories (default: off)
-B#          : split input into blocks of size # (default: no split)
-#           : use compression level # (default: 3)
-D #         : use # as a dictionary (default: create one)
-i#          : nb benchmark rounds (default: 6)
--nbDicts=#  : set nb of dictionaries to # (default: one per block)
-h           : help (this text)