Archiveteam/grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Ignore local and private IP ranges

Browse Source
This commit is contained in:
Ivan Kozik 2014-08-16 21:39:32 +00:00
parent a424eede41
commit 3f0f6f169d
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
db/ignore_patterns/global.json
View File

@ -41,6 +41,9 @@
"/%22\\+[^/]+\\+%22",
"/%27%20\\+[^/]+\\+%20%27",
"/%22%20\\+[^/]+\\+%20%22",
"^https?://(127|10)\\.\\d+\\.\\d+\\.\\d+/",
"^https?://172\\.(1[6-9]|2\\d|3[01])\\.\\d+\\.\\d+/",
"^https?://192\\.168\\.\\d+\\.\\d+/",
"^https?://www\\.google\\.com/recaptcha/api",
"^https?://((s-)?static\\.ak\\.fbcdn\\.net|(connect\\.|www\\.)?facebook\\.com)/connect\\.php/js/.*rsrc\\.php",
"^https?://www\\.flickr\\.com/change_language\\.gne",