1066 Commits

Author SHA1 Message Date
Ivan Kozik
ac2c5d97ee README: Python 3.7.0 -> 3.7.1 2018-12-08 23:29:36 +00:00
Ivan Kozik
4471660656 README: use spaces for indentation to avoid tab-completion on Tab paste 2018-10-22 15:25:57 +00:00
Ivan Kozik
e650278421 README: try to get people to stop installing grab-site as root and explain the pip options 2018-10-22 15:24:50 +00:00
Ivan Kozik
d22ea9ad78 README: add install steps for NixOS 18.09 2018-10-18 15:04:50 +00:00
Ivan Kozik
700ea18693 Use ludios/wpull 3.0.7 to fix https://github.com/ludios/grab-site/issues/138 2018-10-16 21:24:44 +00:00
Ivan Kozik
50a3db6e59 Use ludios/wpull 3.0.6 2018-10-16 16:05:06 +00:00
Ivan Kozik
0c18c9c0ea Alignment 2018-10-14 10:11:33 +00:00
Ivan Kozik
4f898d2b06 README: mention pkg-config 2018-10-09 18:32:52 +00:00
Ivan Kozik
e541ad5c26 Fix --which-wpull-args-partial 2018-10-09 18:16:46 +00:00
Ivan Kozik
795a27121c .travis.yml: try to make the travis build work 2018-10-09 18:10:35 +00:00
Ivan Kozik
9022a57f6f README: move pkg-config to the end because it's for grab-site's dependencies and not for Python 2018-10-09 18:09:02 +00:00
Ivan Kozik
886426c566 .travis.yml: make Python 3.7.0 work, according to https://github.com/travis-ci/travis-ci/issues/9069#issuecomment-425720905 2018-10-09 18:02:58 +00:00
Ivan Kozik
db251482cf README: abbreviate webrecorder.io instructions 2018-10-09 17:49:15 +00:00
Ivan Kozik
73587696f2 README: http:// -> https:// links 2018-10-09 17:42:35 +00:00
Ivan Kozik
ab7e20eb4d README: update webrecorder.io instructions 2018-10-09 17:40:01 +00:00
Ivan Kozik
20156b1f76 README: write more about how to archive Twitter users 2018-10-09 17:26:22 +00:00
Ivan Kozik
cee2eb977b Bump version 2018-10-09 17:02:44 +00:00
Ivan Kozik
c05987f93a dashboard: add -apple-system for macOS Firefox
https://bugzilla.mozilla.org/show_bug.cgi?id=1226042
2018-10-09 16:59:54 +00:00
Ivan Kozik
ea94a3d925 README: fix macOS install instructions 2018-10-09 16:53:03 +00:00
Ivan Kozik
d737e09b3b README: fix link 2018-10-09 16:44:19 +00:00
Ivan Kozik
c4bbd26779 wpull_hooks: mention that re also returns useful errors 2018-10-09 16:29:14 +00:00
Ivan Kozik
9e8ad88703 wpull_hooks: validate regexps with re before passing to re2 2018-10-09 16:23:11 +00:00
Ivan Kozik
e6b1709ef3 Use facebook/pyre2 because ludios/pyre2 has a buggy PR applied:
https://github.com/facebook/pyre2/pull/11#issuecomment-428256331
2018-10-09 16:20:09 +00:00
Ivan Kozik
5b67d90cfb README: install instruction fixes 2018-10-09 16:00:57 +00:00
Ivan Kozik
e790ff8329 Use ludios/wpull 3.0.5 2018-10-09 14:40:43 +00:00
Ivan Kozik
caf0497b93 Use wpull 3.0.4 2018-10-09 14:03:07 +00:00
Ivan Kozik
5bad645636 Alignment 2018-10-09 13:26:16 +00:00
Ivan Kozik
8dad425bc7 wpull_hooks: update igoff state less frequently; use f" strings 2018-10-09 13:23:39 +00:00
Ivan Kozik
ce80bcc8c1 wpull_hooks: when igon is enabled, print which ignore was responsible 2018-10-09 13:22:39 +00:00
Ivan Kozik
1aeccf24c5 wpull_hooks: re.escape() the netloc during {any_start_netloc} replacement 2018-10-09 12:17:43 +00:00
Ivan Kozik
4d127249af reddit igset: ignore new simple.reddit.com 2018-10-09 11:57:30 +00:00
Ivan Kozik
53370c78db README: Ubuntu 14.04 and Debian 8 (jessie) are no longer supported 2018-10-09 06:10:03 +00:00
Ivan Kozik
cc839e3468 README: fix TOC link 2018-10-09 04:10:31 +00:00
Ivan Kozik
8e6649d144 README: install libssl-dev instead of libssl1.0-dev now that we no longer use Python 3.4 2018-10-09 04:03:44 +00:00
Ivan Kozik
c38e931485 mediawiki igset: use {any_start_netloc} and add [\?&]lqt_method= 2018-10-08 11:04:54 +00:00
Ivan Kozik
20dfd9966b gs-dump-urls: add support for old wpull 1.x wpull.db files 2018-10-08 10:55:03 +00:00
Ivan Kozik
cbf202fb44 global igset: ignore another endless mp3 stream
https://aechai9hib.cdn.dvmr.fr/franceinfo-midfi.mp3
2018-10-08 09:52:33 +00:00
Ivan Kozik
3316c048b7 wpull_hooks: implement support for {any_start_netloc} (previously {primary_netloc}) 2018-10-08 09:51:27 +00:00
Ivan Kozik
8e7ab58c9d wpull_hooks: reimplement ignores 2018-10-08 09:03:51 +00:00
Ivan Kozik
bec7f36aa1 wpull_hooks: use re2 for icecast checks 2018-10-08 08:30:59 +00:00
Ivan Kozik
2a1f0b9548 README: update macOS instructions for lxml and pyre2 (untested)
Brew has a Python 3.7.0 right now, so there is no need to compile a Python with pyenv.
2018-10-08 07:09:50 +00:00
Ivan Kozik
7589d57e75 Thank falconkirtaran 2018-10-07 22:57:42 +00:00
Ivan Kozik
7373140709 Use ludios/wpull 3.0.3 2018-10-07 22:26:59 +00:00
Ivan Kozik
6ddbf4e3d7 gs-dump-urls: fix for wpull 2.0's new database schema 2018-10-07 22:12:27 +00:00
Ivan Kozik
212af01ede server: move method around 2018-10-07 22:00:16 +00:00
Ivan Kozik
205d4a5378 ' -> " 2018-10-07 21:58:50 +00:00
Ivan Kozik
3e26d38866 dupes: code cleanup 2018-10-07 21:57:25 +00:00
Ivan Kozik
ca6e77e378 dashboard_client: avoid a potential bug with task_done() not being called if send_object raises an exception 2018-10-07 21:43:42 +00:00
Ivan Kozik
f24959ce4a gs-server: alignment; use f"" strings; use camel_case for non-autobahn methods 2018-10-07 21:38:47 +00:00
Ivan Kozik
4403f9fdbb ' -> " 2018-10-07 21:33:21 +00:00