Ivan Kozik
|
a9727902cd
|
Add back the tumblr Googlebot UA instruction now that it works again; bump Firefox UA
|
2018-12-16 00:19:25 +00:00 |
|
Ivan Kozik
|
d5b7aa6717
|
2.1.11
|
2018-12-14 04:17:08 +00:00 |
|
Ivan Kozik
|
8d1402e410
|
2.1.10
|
2018-12-14 02:17:16 +00:00 |
|
Ivan Kozik
|
700ea18693
|
Use ludios/wpull 3.0.7 to fix https://github.com/ludios/grab-site/issues/138
|
2018-10-16 21:24:44 +00:00 |
|
Ivan Kozik
|
50a3db6e59
|
Use ludios/wpull 3.0.6
|
2018-10-16 16:05:06 +00:00 |
|
Ivan Kozik
|
0c18c9c0ea
|
Alignment
|
2018-10-14 10:11:33 +00:00 |
|
Ivan Kozik
|
e541ad5c26
|
Fix --which-wpull-args-partial
|
2018-10-09 18:16:46 +00:00 |
|
Ivan Kozik
|
cee2eb977b
|
Bump version
|
2018-10-09 17:02:44 +00:00 |
|
Ivan Kozik
|
c05987f93a
|
dashboard: add -apple-system for macOS Firefox
https://bugzilla.mozilla.org/show_bug.cgi?id=1226042
|
2018-10-09 16:59:54 +00:00 |
|
Ivan Kozik
|
c4bbd26779
|
wpull_hooks: mention that re also returns useful errors
|
2018-10-09 16:29:14 +00:00 |
|
Ivan Kozik
|
9e8ad88703
|
wpull_hooks: validate regexps with re before passing to re2
|
2018-10-09 16:23:11 +00:00 |
|
Ivan Kozik
|
e6b1709ef3
|
Use facebook/pyre2 because ludios/pyre2 has a buggy PR applied:
https://github.com/facebook/pyre2/pull/11#issuecomment-428256331
|
2018-10-09 16:20:09 +00:00 |
|
Ivan Kozik
|
e790ff8329
|
Use ludios/wpull 3.0.5
|
2018-10-09 14:40:43 +00:00 |
|
Ivan Kozik
|
caf0497b93
|
Use wpull 3.0.4
|
2018-10-09 14:03:07 +00:00 |
|
Ivan Kozik
|
5bad645636
|
Alignment
|
2018-10-09 13:26:16 +00:00 |
|
Ivan Kozik
|
8dad425bc7
|
wpull_hooks: update igoff state less frequently; use f" strings
|
2018-10-09 13:23:39 +00:00 |
|
Ivan Kozik
|
ce80bcc8c1
|
wpull_hooks: when igon is enabled, print which ignore was responsible
|
2018-10-09 13:22:39 +00:00 |
|
Ivan Kozik
|
1aeccf24c5
|
wpull_hooks: re.escape() the netloc during {any_start_netloc} replacement
|
2018-10-09 12:17:43 +00:00 |
|
Ivan Kozik
|
4d127249af
|
reddit igset: ignore new simple.reddit.com
|
2018-10-09 11:57:30 +00:00 |
|
Ivan Kozik
|
c38e931485
|
mediawiki igset: use {any_start_netloc} and add [\?&]lqt_method=
|
2018-10-08 11:04:54 +00:00 |
|
Ivan Kozik
|
20dfd9966b
|
gs-dump-urls: add support for old wpull 1.x wpull.db files
|
2018-10-08 10:55:03 +00:00 |
|
Ivan Kozik
|
cbf202fb44
|
global igset: ignore another endless mp3 stream
https://aechai9hib.cdn.dvmr.fr/franceinfo-midfi.mp3
|
2018-10-08 09:52:33 +00:00 |
|
Ivan Kozik
|
3316c048b7
|
wpull_hooks: implement support for {any_start_netloc} (previously {primary_netloc})
|
2018-10-08 09:51:27 +00:00 |
|
Ivan Kozik
|
8e7ab58c9d
|
wpull_hooks: reimplement ignores
|
2018-10-08 09:03:51 +00:00 |
|
Ivan Kozik
|
bec7f36aa1
|
wpull_hooks: use re2 for icecast checks
|
2018-10-08 08:30:59 +00:00 |
|
Ivan Kozik
|
6ddbf4e3d7
|
gs-dump-urls: fix for wpull 2.0's new database schema
|
2018-10-07 22:12:27 +00:00 |
|
Ivan Kozik
|
212af01ede
|
server: move method around
|
2018-10-07 22:00:16 +00:00 |
|
Ivan Kozik
|
205d4a5378
|
' -> "
|
2018-10-07 21:58:50 +00:00 |
|
Ivan Kozik
|
3e26d38866
|
dupes: code cleanup
|
2018-10-07 21:57:25 +00:00 |
|
Ivan Kozik
|
ca6e77e378
|
dashboard_client: avoid a potential bug with task_done() not being called if send_object raises an exception
|
2018-10-07 21:43:42 +00:00 |
|
Ivan Kozik
|
f24959ce4a
|
gs-server: alignment; use f"" strings; use camel_case for non-autobahn methods
|
2018-10-07 21:38:47 +00:00 |
|
Ivan Kozik
|
4403f9fdbb
|
' -> "
|
2018-10-07 21:33:21 +00:00 |
|
Ivan Kozik
|
90307d0e97
|
Alignment
|
2018-10-07 21:32:46 +00:00 |
|
Ivan Kozik
|
21a1e44196
|
wpull_hooks: reimplement the dashboard websocket client
|
2018-10-07 21:31:22 +00:00 |
|
Ivan Kozik
|
6c69fee73f
|
Alignment
|
2018-10-07 19:42:37 +00:00 |
|
Ivan Kozik
|
d87caabead
|
Alignment
|
2018-10-07 19:41:10 +00:00 |
|
Ivan Kozik
|
1f20b5577b
|
Alignment
|
2018-10-07 19:39:40 +00:00 |
|
Ivan Kozik
|
59c803bcd8
|
Bump Firefox UA
|
2018-10-07 19:39:22 +00:00 |
|
Ivan Kozik
|
910734afd0
|
Alignment
|
2018-10-07 19:38:22 +00:00 |
|
Ivan Kozik
|
72db6f5582
|
Alignment
|
2018-10-07 19:38:03 +00:00 |
|
Ivan Kozik
|
e0334923ef
|
Code formatting
|
2018-10-07 19:36:42 +00:00 |
|
Ivan Kozik
|
c34fa28b37
|
Alignment
|
2018-10-07 19:36:23 +00:00 |
|
Ivan Kozik
|
4b199bf423
|
Remove the psutil support that hopefully no one was using
grab-site processes can be kill -STOP / kill -CONT'ed externally
|
2018-10-07 19:34:25 +00:00 |
|
Ivan Kozik
|
1123896f45
|
Code formatting
|
2018-10-07 19:33:33 +00:00 |
|
Ivan Kozik
|
7b1cabed9a
|
Remove commented libgrabsite import wpull_hooks as _; import-time errors are viewable in DIR/wpull.log
|
2018-10-07 19:29:32 +00:00 |
|
Ivan Kozik
|
b4f67c80e1
|
Remove unsupported --custom-hooks
The plan is to document some replacement later that might involve
modifying and pointing to another wpull_hooks.py
|
2018-10-07 19:28:27 +00:00 |
|
Ivan Kozik
|
7b40c6b946
|
Refactor wpull_hooks functions to methods on GrabSitePlugin
TODO: add back support for ignores
TODO: add back websocket client
|
2018-10-07 19:14:56 +00:00 |
|
Ivan Kozik
|
8bed843e24
|
Add grab-site --debug flag for turning on wpull --debug
|
2018-10-05 14:21:24 +00:00 |
|
Ivan Kozik
|
0d42842fd0
|
Start porting hooks to wpull 2.0's new plugin system
|
2018-10-05 14:16:56 +00:00 |
|
Ivan Kozik
|
9c12ae390f
|
Bump version
|
2018-10-05 08:15:23 +00:00 |
|