Archiveteam/grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

reddit igset: apply to old.reddit.com as well

Browse Source
This commit is contained in:
Ivan Kozik 2018-08-25 14:29:14 +00:00
parent bf0d7d28a9
commit 90c37526e1
2 changed files with 13 additions and 13 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
libgrabsite/__init__.py
View File

@ -1 +1 @@
__version__ = '1.7.3'
__version__ = '1.7.4'

24
libgrabsite/ignore_sets/reddit
View File

@ -2,19 +2,19 @@
# all comments will be downloaded because many comments are collapsed
# by reddit.
^https?://www\.reddit\.com/gold\?goldtype=
^https?://(www|old)\.reddit\.com/gold\?goldtype=
# URLs with utm_ can (hopefully) be safely ignored because reddit also sends
# href=""s without the utm_ trackers.
^https?://www\.reddit\.com/r/[^/]+/.*[\?&]utm_
^https?://www\.reddit\.com/r/[^/]+/comments/[a-z0-9]+/[^/]+/[a-z0-9]+
^https?://www\.reddit\.com/r/[^/]+/comments/[a-z0-9]+.*\?sort=
^https?://www\.reddit\.com/r/[^/]+/comments/[a-z0-9]+/[^/]+/\.compact
^https?://www\.reddit\.com/r/[^/]+/(top|new|rising|controversial|gilded|ads)/.+[\?&]after=
^https?://www\.reddit\.com/r/[^/]+/related/
^https?://www\.reddit\.com/r/[^/]+/(gilded)?\.mobile\?
^https?://www\.reddit\.com/r/[^/]+/search/?\?
^https?://www\.reddit\.com/r/[^/]+/wiki/(revisions|discussions)/user/.+
^https?://www\.reddit\.com/user/[^/]+/(comments/)?.+[\?&]sort=
^https?://www\.reddit\.com/.+/\.rss$
^https?://(www|old)\.reddit\.com/r/[^/]+/.*[\?&]utm_
^https?://(www|old)\.reddit\.com/r/[^/]+/comments/[a-z0-9]+/[^/]+/[a-z0-9]+
^https?://(www|old)\.reddit\.com/r/[^/]+/comments/[a-z0-9]+.*\?sort=
^https?://(www|old)\.reddit\.com/r/[^/]+/comments/[a-z0-9]+/[^/]+/\.compact
^https?://(www|old)\.reddit\.com/r/[^/]+/(top|new|rising|controversial|gilded|ads)/.+[\?&]after=
^https?://(www|old)\.reddit\.com/r/[^/]+/related/
^https?://(www|old)\.reddit\.com/r/[^/]+/(gilded)?\.mobile\?
^https?://(www|old)\.reddit\.com/r/[^/]+/search/?\?
^https?://(www|old)\.reddit\.com/r/[^/]+/wiki/(revisions|discussions)/user/.+
^https?://(www|old)\.reddit\.com/user/[^/]+/(comments/)?.+[\?&]sort=
^https?://(www|old)\.reddit\.com/.+/\.rss$
\.reddit\.com/message/compose/?\?
^https?://(m|out|simple)\.reddit\.com/