Archiveteam/grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

README: More subreddit crawling

Browse Source
This commit is contained in:
Ivan Kozik 2015-12-11 09:03:02 +00:00
parent 01a72b910a
commit a9a06127ea
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -248,7 +248,7 @@ Some tumblr blogs appear to require JavaScript, but they are actually just hidin
#### Subreddits
Use [`--igsets=reddit`](https://github.com/ludios/grab-site/blob/master/libgrabsite/ignore_sets/reddit).
Use [`--igsets=reddit`](https://github.com/ludios/grab-site/blob/master/libgrabsite/ignore_sets/reddit) and add a `/` at the end of the URL to avoid crawling all subreddits.
When crawling a subreddit, you **must** get the casing of the subreddit right for the recursive crawl to work. For example,