Archiveteam/grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Document file formats

Browse Source
This commit is contained in:
Ivan Kozik 2015-02-05 05:37:34 +00:00
parent d73ee5ba27
commit f815920a83
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
README.md
View File

@ -20,7 +20,12 @@ Note: `--ignore-sets=` with `=` will **not** work.
While the crawl is running, you can edit `DIR/ignores` and `DIR/ignore_sets`; the
changes will be applied as soon as the next URL is grabbed.
You can also `touch DIR/igoff` to stop `IGNOR` message spew, and `rm DIR/igoff`
`ignore_sets` is a comma-separated list of ignore sets to use
([see this list of available sets](https://github.com/ArchiveTeam/ArchiveBot/tree/master/db/ignore_patterns)).
`ignores` is a newline-separated list of Python 3 regular expressions.
You can `touch DIR/igoff` to stop `IGNOR` message spew, and `rm DIR/igoff`
to turn it back on again.
License: