Archiveteam/grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

global igset: Ignore /CSI/CSI/ loops on blogspot

Browse Source
This commit is contained in:
Ivan Kozik 2016-01-12 22:44:57 +00:00
parent 0214558d5e
commit 7ec2f90534
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
libgrabsite/__init__.py
View File

@ -1 +1 @@
__version__ = '0.9.15'
__version__ = '0.9.16'

2
libgrabsite/ignore_sets/global
View File

@ -265,7 +265,7 @@
^https?://{primary_netloc}/search(/label/[^\?]+|)\?updated-(min|max)=\d{4}-\d\d-\d\dT\d\d:\d\d:\d\d.*&max-results=\d+
# Ignore bogus /CSI/ links on blogspot.com
^https?://.+\.blogspot\.(com|in|com\.au|co\.uk|jp|co\.nz|ca|de|it|fr|se|sg|es|pt|com\.br|ar|mx|kr)/(\d{4}/\d{2}/|search/label/)CSI/$
^https?://.+\.blogspot\.(com|in|com\.au|co\.uk|jp|co\.nz|ca|de|it|fr|se|sg|es|pt|com\.br|ar|mx|kr)/(\d{4}/\d{2}/|search/label/)(CSI/$|.*/CSI/CSI/CSI/)
# Links to ?share=(twitter|facebook|reddit|email|google-plus-1) etc.
# These typically redirect.