Ivan Kozik
|
cc839e3468
|
README: fix TOC link
|
2018-10-09 04:10:31 +00:00 |
|
Ivan Kozik
|
8e6649d144
|
README: install libssl-dev instead of libssl1.0-dev now that we no longer use Python 3.4
|
2018-10-09 04:03:44 +00:00 |
|
Ivan Kozik
|
c38e931485
|
mediawiki igset: use {any_start_netloc} and add [\?&]lqt_method=
|
2018-10-08 11:04:54 +00:00 |
|
Ivan Kozik
|
20dfd9966b
|
gs-dump-urls: add support for old wpull 1.x wpull.db files
|
2018-10-08 10:55:03 +00:00 |
|
Ivan Kozik
|
cbf202fb44
|
global igset: ignore another endless mp3 stream
https://aechai9hib.cdn.dvmr.fr/franceinfo-midfi.mp3
|
2018-10-08 09:52:33 +00:00 |
|
Ivan Kozik
|
3316c048b7
|
wpull_hooks: implement support for {any_start_netloc} (previously {primary_netloc})
|
2018-10-08 09:51:27 +00:00 |
|
Ivan Kozik
|
8e7ab58c9d
|
wpull_hooks: reimplement ignores
|
2018-10-08 09:03:51 +00:00 |
|
Ivan Kozik
|
bec7f36aa1
|
wpull_hooks: use re2 for icecast checks
|
2018-10-08 08:30:59 +00:00 |
|
Ivan Kozik
|
2a1f0b9548
|
README: update macOS instructions for lxml and pyre2 (untested)
Brew has a Python 3.7.0 right now, so there is no need to compile a Python with pyenv.
|
2018-10-08 07:09:50 +00:00 |
|
Ivan Kozik
|
7589d57e75
|
Thank falconkirtaran
|
2018-10-07 22:57:42 +00:00 |
|
Ivan Kozik
|
7373140709
|
Use ludios/wpull 3.0.3
|
2018-10-07 22:26:59 +00:00 |
|
Ivan Kozik
|
6ddbf4e3d7
|
gs-dump-urls: fix for wpull 2.0's new database schema
|
2018-10-07 22:12:27 +00:00 |
|
Ivan Kozik
|
212af01ede
|
server: move method around
|
2018-10-07 22:00:16 +00:00 |
|
Ivan Kozik
|
205d4a5378
|
' -> "
|
2018-10-07 21:58:50 +00:00 |
|
Ivan Kozik
|
3e26d38866
|
dupes: code cleanup
|
2018-10-07 21:57:25 +00:00 |
|
Ivan Kozik
|
ca6e77e378
|
dashboard_client: avoid a potential bug with task_done() not being called if send_object raises an exception
|
2018-10-07 21:43:42 +00:00 |
|
Ivan Kozik
|
f24959ce4a
|
gs-server: alignment; use f"" strings; use camel_case for non-autobahn methods
|
2018-10-07 21:38:47 +00:00 |
|
Ivan Kozik
|
4403f9fdbb
|
' -> "
|
2018-10-07 21:33:21 +00:00 |
|
Ivan Kozik
|
90307d0e97
|
Alignment
|
2018-10-07 21:32:46 +00:00 |
|
Ivan Kozik
|
21a1e44196
|
wpull_hooks: reimplement the dashboard websocket client
|
2018-10-07 21:31:22 +00:00 |
|
Ivan Kozik
|
6c69fee73f
|
Alignment
|
2018-10-07 19:42:37 +00:00 |
|
Ivan Kozik
|
d87caabead
|
Alignment
|
2018-10-07 19:41:10 +00:00 |
|
Ivan Kozik
|
1f20b5577b
|
Alignment
|
2018-10-07 19:39:40 +00:00 |
|
Ivan Kozik
|
59c803bcd8
|
Bump Firefox UA
|
2018-10-07 19:39:22 +00:00 |
|
Ivan Kozik
|
910734afd0
|
Alignment
|
2018-10-07 19:38:22 +00:00 |
|
Ivan Kozik
|
72db6f5582
|
Alignment
|
2018-10-07 19:38:03 +00:00 |
|
Ivan Kozik
|
e0334923ef
|
Code formatting
|
2018-10-07 19:36:42 +00:00 |
|
Ivan Kozik
|
c34fa28b37
|
Alignment
|
2018-10-07 19:36:23 +00:00 |
|
Ivan Kozik
|
4b199bf423
|
Remove the psutil support that hopefully no one was using
grab-site processes can be kill -STOP / kill -CONT'ed externally
|
2018-10-07 19:34:25 +00:00 |
|
Ivan Kozik
|
1123896f45
|
Code formatting
|
2018-10-07 19:33:33 +00:00 |
|
Ivan Kozik
|
7b1cabed9a
|
Remove commented libgrabsite import wpull_hooks as _; import-time errors are viewable in DIR/wpull.log
|
2018-10-07 19:29:32 +00:00 |
|
Ivan Kozik
|
b4f67c80e1
|
Remove unsupported --custom-hooks
The plan is to document some replacement later that might involve
modifying and pointing to another wpull_hooks.py
|
2018-10-07 19:28:27 +00:00 |
|
Ivan Kozik
|
7b40c6b946
|
Refactor wpull_hooks functions to methods on GrabSitePlugin
TODO: add back support for ignores
TODO: add back websocket client
|
2018-10-07 19:14:56 +00:00 |
|
Ivan Kozik
|
08acad3e1c
|
README: move security note to the end
|
2018-10-05 16:22:19 +00:00 |
|
Ivan Kozik
|
4e0952126e
|
rm extra_docs/custom_hooks_sample.py
|
2018-10-05 16:20:18 +00:00 |
|
Ivan Kozik
|
fca0eaf432
|
README: wrap lines
|
2018-10-05 16:19:55 +00:00 |
|
Ivan Kozik
|
c186df0617
|
README: wrap lines
|
2018-10-05 16:19:18 +00:00 |
|
Ivan Kozik
|
d3da0899ad
|
README: wrap lines
|
2018-10-05 16:19:18 +00:00 |
|
Ivan Kozik
|
ea4e4eff74
|
README: wrap lines
|
2018-10-05 16:19:18 +00:00 |
|
Ivan Kozik
|
65b4f5caca
|
README: remove phantomjs mention because I removed support from ludios/wpull
|
2018-10-05 16:19:18 +00:00 |
|
Ivan Kozik
|
e8a2163dd3
|
README: wrap lines
|
2018-10-05 16:19:15 +00:00 |
|
Ivan Kozik
|
4473c7040e
|
README: wrap lines
|
2018-10-05 16:16:04 +00:00 |
|
Ivan Kozik
|
469dfdd0b9
|
README: wrap lines
|
2018-10-05 16:13:37 +00:00 |
|
Ivan Kozik
|
e45f6f5b97
|
README: remove BrowserStack mention
|
2018-10-05 16:12:41 +00:00 |
|
Ivan Kozik
|
8bf22e410f
|
README: thank JAA
|
2018-10-05 16:12:15 +00:00 |
|
Ivan Kozik
|
fc54bed43a
|
README: don't tell users to file issues on chfoo/wpull
|
2018-10-05 16:10:25 +00:00 |
|
Ivan Kozik
|
ca10585c45
|
README: fix list of options
|
2018-10-05 16:09:11 +00:00 |
|
Ivan Kozik
|
8bed843e24
|
Add grab-site --debug flag for turning on wpull --debug
|
2018-10-05 14:21:24 +00:00 |
|
Ivan Kozik
|
0d42842fd0
|
Start porting hooks to wpull 2.0's new plugin system
|
2018-10-05 14:16:56 +00:00 |
|
Ivan Kozik
|
3f14886435
|
README: pip3 -> pip
|
2018-10-05 08:15:23 +00:00 |
|