[regression] Add README explaining the test

dev
Nick Terrell 2020-10-30 13:55:52 -07:00
parent 222916a5d3
commit a446fa33dc
1 changed files with 28 additions and 0 deletions

View File

@ -0,0 +1,28 @@
# Regression tests
The regression tests run zstd in many scenarios and ensures that the size of the compressed results doesn't change. This helps us ensure that we don't accidentally regress zstd's compression ratio.
These tests get run every night by CircleCI. If the job fails you can read the diff printed by the job to ensure the change isn't a regression. If all is well you can download the `results.csv` artifact and commit the new results. Or you can rebuild it yourself following the instructions below.
## Rebuilding results.csv
From the root of the zstd repo run:
```
# Build the zstd binary
make clean
make -j zstd
# Build the regression test binary
cd tests/regression
make clean
make -j test
# Run the regression test
./test --cache data-cache --zstd ../../zstd --output results.csv
# Check results.csv to ensure the new results are okay
git diff
# Then submit the PR
```