Ivan Kozik
|
e541ad5c26
|
Fix --which-wpull-args-partial
|
2018-10-09 18:16:46 +00:00 |
|
Ivan Kozik
|
795a27121c
|
.travis.yml: try to make the travis build work
|
2018-10-09 18:10:35 +00:00 |
|
Ivan Kozik
|
9022a57f6f
|
README: move pkg-config to the end because it's for grab-site's dependencies and not for Python
|
2018-10-09 18:09:02 +00:00 |
|
Ivan Kozik
|
886426c566
|
.travis.yml: make Python 3.7.0 work, according to https://github.com/travis-ci/travis-ci/issues/9069#issuecomment-425720905
|
2018-10-09 18:02:58 +00:00 |
|
Ivan Kozik
|
db251482cf
|
README: abbreviate webrecorder.io instructions
|
2018-10-09 17:49:15 +00:00 |
|
Ivan Kozik
|
73587696f2
|
README: http:// -> https:// links
|
2018-10-09 17:42:35 +00:00 |
|
Ivan Kozik
|
ab7e20eb4d
|
README: update webrecorder.io instructions
|
2018-10-09 17:40:01 +00:00 |
|
Ivan Kozik
|
20156b1f76
|
README: write more about how to archive Twitter users
|
2018-10-09 17:26:22 +00:00 |
|
Ivan Kozik
|
cee2eb977b
|
Bump version
|
2018-10-09 17:02:44 +00:00 |
|
Ivan Kozik
|
c05987f93a
|
dashboard: add -apple-system for macOS Firefox
https://bugzilla.mozilla.org/show_bug.cgi?id=1226042
|
2018-10-09 16:59:54 +00:00 |
|
Ivan Kozik
|
ea94a3d925
|
README: fix macOS install instructions
|
2018-10-09 16:53:03 +00:00 |
|
Ivan Kozik
|
d737e09b3b
|
README: fix link
|
2018-10-09 16:44:19 +00:00 |
|
Ivan Kozik
|
c4bbd26779
|
wpull_hooks: mention that re also returns useful errors
|
2018-10-09 16:29:14 +00:00 |
|
Ivan Kozik
|
9e8ad88703
|
wpull_hooks: validate regexps with `re` before passing to `re2`
|
2018-10-09 16:23:11 +00:00 |
|
Ivan Kozik
|
e6b1709ef3
|
Use facebook/pyre2 because ludios/pyre2 has a buggy PR applied:
https://github.com/facebook/pyre2/pull/11#issuecomment-428256331
|
2018-10-09 16:20:09 +00:00 |
|
Ivan Kozik
|
5b67d90cfb
|
README: install instruction fixes
|
2018-10-09 16:00:57 +00:00 |
|
Ivan Kozik
|
e790ff8329
|
Use ludios/wpull 3.0.5
|
2018-10-09 14:40:43 +00:00 |
|
Ivan Kozik
|
caf0497b93
|
Use wpull 3.0.4
|
2018-10-09 14:03:07 +00:00 |
|
Ivan Kozik
|
5bad645636
|
Alignment
|
2018-10-09 13:26:16 +00:00 |
|
Ivan Kozik
|
8dad425bc7
|
wpull_hooks: update igoff state less frequently; use f" strings
|
2018-10-09 13:23:39 +00:00 |
|
Ivan Kozik
|
ce80bcc8c1
|
wpull_hooks: when igon is enabled, print which ignore was responsible
|
2018-10-09 13:22:39 +00:00 |
|
Ivan Kozik
|
1aeccf24c5
|
wpull_hooks: re.escape() the netloc during {any_start_netloc} replacement
|
2018-10-09 12:17:43 +00:00 |
|
Ivan Kozik
|
4d127249af
|
reddit igset: ignore new simple.reddit.com
|
2018-10-09 11:57:30 +00:00 |
|
Ivan Kozik
|
53370c78db
|
README: Ubuntu 14.04 and Debian 8 (jessie) are no longer supported
|
2018-10-09 06:10:03 +00:00 |
|
Ivan Kozik
|
cc839e3468
|
README: fix TOC link
|
2018-10-09 04:10:31 +00:00 |
|
Ivan Kozik
|
8e6649d144
|
README: install libssl-dev instead of libssl1.0-dev now that we no longer use Python 3.4
|
2018-10-09 04:03:44 +00:00 |
|
Ivan Kozik
|
c38e931485
|
mediawiki igset: use {any_start_netloc} and add [\?&]lqt_method=
|
2018-10-08 11:04:54 +00:00 |
|
Ivan Kozik
|
20dfd9966b
|
gs-dump-urls: add support for old wpull 1.x wpull.db files
|
2018-10-08 10:55:03 +00:00 |
|
Ivan Kozik
|
cbf202fb44
|
global igset: ignore another endless mp3 stream
https://aechai9hib.cdn.dvmr.fr/franceinfo-midfi.mp3
|
2018-10-08 09:52:33 +00:00 |
|
Ivan Kozik
|
3316c048b7
|
wpull_hooks: implement support for {any_start_netloc} (previously {primary_netloc})
|
2018-10-08 09:51:27 +00:00 |
|
Ivan Kozik
|
8e7ab58c9d
|
wpull_hooks: reimplement ignores
|
2018-10-08 09:03:51 +00:00 |
|
Ivan Kozik
|
bec7f36aa1
|
wpull_hooks: use re2 for icecast checks
|
2018-10-08 08:30:59 +00:00 |
|
Ivan Kozik
|
2a1f0b9548
|
README: update macOS instructions for lxml and pyre2 (untested)
Brew has a Python 3.7.0 right now, so there is no need to compile a Python with pyenv.
|
2018-10-08 07:09:50 +00:00 |
|
Ivan Kozik
|
7589d57e75
|
Thank falconkirtaran
|
2018-10-07 22:57:42 +00:00 |
|
Ivan Kozik
|
7373140709
|
Use ludios/wpull 3.0.3
|
2018-10-07 22:26:59 +00:00 |
|
Ivan Kozik
|
6ddbf4e3d7
|
gs-dump-urls: fix for wpull 2.0's new database schema
|
2018-10-07 22:12:27 +00:00 |
|
Ivan Kozik
|
212af01ede
|
server: move method around
|
2018-10-07 22:00:16 +00:00 |
|
Ivan Kozik
|
205d4a5378
|
' -> "
|
2018-10-07 21:58:50 +00:00 |
|
Ivan Kozik
|
3e26d38866
|
dupes: code cleanup
|
2018-10-07 21:57:25 +00:00 |
|
Ivan Kozik
|
ca6e77e378
|
dashboard_client: avoid a potential bug with task_done() not being called if send_object raises an exception
|
2018-10-07 21:43:42 +00:00 |
|
Ivan Kozik
|
f24959ce4a
|
gs-server: alignment; use f"" strings; use camel_case for non-autobahn methods
|
2018-10-07 21:38:47 +00:00 |
|
Ivan Kozik
|
4403f9fdbb
|
' -> "
|
2018-10-07 21:33:21 +00:00 |
|
Ivan Kozik
|
90307d0e97
|
Alignment
|
2018-10-07 21:32:46 +00:00 |
|
Ivan Kozik
|
21a1e44196
|
wpull_hooks: reimplement the dashboard websocket client
|
2018-10-07 21:31:22 +00:00 |
|
Ivan Kozik
|
6c69fee73f
|
Alignment
|
2018-10-07 19:42:37 +00:00 |
|
Ivan Kozik
|
d87caabead
|
Alignment
|
2018-10-07 19:41:10 +00:00 |
|
Ivan Kozik
|
1f20b5577b
|
Alignment
|
2018-10-07 19:39:40 +00:00 |
|
Ivan Kozik
|
59c803bcd8
|
Bump Firefox UA
|
2018-10-07 19:39:22 +00:00 |
|
Ivan Kozik
|
910734afd0
|
Alignment
|
2018-10-07 19:38:22 +00:00 |
|
Ivan Kozik
|
72db6f5582
|
Alignment
|
2018-10-07 19:38:03 +00:00 |