1066 Commits

Author SHA1 Message Date
Ivan Kozik
90307d0e97 Alignment 2018-10-07 21:32:46 +00:00
Ivan Kozik
21a1e44196 wpull_hooks: reimplement the dashboard websocket client 2018-10-07 21:31:22 +00:00
Ivan Kozik
6c69fee73f Alignment 2018-10-07 19:42:37 +00:00
Ivan Kozik
d87caabead Alignment 2018-10-07 19:41:10 +00:00
Ivan Kozik
1f20b5577b Alignment 2018-10-07 19:39:40 +00:00
Ivan Kozik
59c803bcd8 Bump Firefox UA 2018-10-07 19:39:22 +00:00
Ivan Kozik
910734afd0 Alignment 2018-10-07 19:38:22 +00:00
Ivan Kozik
72db6f5582 Alignment 2018-10-07 19:38:03 +00:00
Ivan Kozik
e0334923ef Code formatting 2018-10-07 19:36:42 +00:00
Ivan Kozik
c34fa28b37 Alignment 2018-10-07 19:36:23 +00:00
Ivan Kozik
4b199bf423 Remove the psutil support that hopefully no one was using
grab-site processes can be kill -STOP / kill -CONT'ed externally
2018-10-07 19:34:25 +00:00
Ivan Kozik
1123896f45 Code formatting 2018-10-07 19:33:33 +00:00
Ivan Kozik
7b1cabed9a Remove commented libgrabsite import wpull_hooks as _; import-time errors are viewable in DIR/wpull.log 2018-10-07 19:29:32 +00:00
Ivan Kozik
b4f67c80e1 Remove unsupported --custom-hooks
The plan is to document some replacement later that might involve
modifying and pointing to another wpull_hooks.py
2018-10-07 19:28:27 +00:00
Ivan Kozik
7b40c6b946 Refactor wpull_hooks functions to methods on GrabSitePlugin
TODO: add back support for ignores
TODO: add back websocket client
2018-10-07 19:14:56 +00:00
Ivan Kozik
08acad3e1c README: move security note to the end 2018-10-05 16:22:19 +00:00
Ivan Kozik
4e0952126e rm extra_docs/custom_hooks_sample.py 2018-10-05 16:20:18 +00:00
Ivan Kozik
fca0eaf432 README: wrap lines 2018-10-05 16:19:55 +00:00
Ivan Kozik
c186df0617 README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik
d3da0899ad README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik
ea4e4eff74 README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik
65b4f5caca README: remove phantomjs mention because I removed support from ludios/wpull 2018-10-05 16:19:18 +00:00
Ivan Kozik
e8a2163dd3 README: wrap lines 2018-10-05 16:19:15 +00:00
Ivan Kozik
4473c7040e README: wrap lines 2018-10-05 16:16:04 +00:00
Ivan Kozik
469dfdd0b9 README: wrap lines 2018-10-05 16:13:37 +00:00
Ivan Kozik
e45f6f5b97 README: remove BrowserStack mention 2018-10-05 16:12:41 +00:00
Ivan Kozik
8bf22e410f README: thank JAA 2018-10-05 16:12:15 +00:00
Ivan Kozik
fc54bed43a README: don't tell users to file issues on chfoo/wpull 2018-10-05 16:10:25 +00:00
Ivan Kozik
ca10585c45 README: fix list of options 2018-10-05 16:09:11 +00:00
Ivan Kozik
8bed843e24 Add grab-site --debug flag for turning on wpull --debug 2018-10-05 14:21:24 +00:00
Ivan Kozik
0d42842fd0 Start porting hooks to wpull 2.0's new plugin system 2018-10-05 14:16:56 +00:00
Ivan Kozik
3f14886435 README: pip3 -> pip 2018-10-05 08:15:23 +00:00
Ivan Kozik
9c12ae390f Bump version 2018-10-05 08:15:23 +00:00
Ivan Kozik
e6d81e81c5 Require ludios/wpull 3.0.2 and remove the install_requires that are in wpull 2018-10-05 08:15:16 +00:00
Ivan Kozik
e1e60c6072 Bump version 2018-10-05 07:54:13 +00:00
Ivan Kozik
f27c61bdfe wpull_hooks: remove method confusion 2018-10-05 07:54:13 +00:00
Ivan Kozik
82c94683d4 Remove unused html5lib dependency 2018-10-05 07:54:13 +00:00
Ivan Kozik
4d8218db7f Use wpull 1.3.1 2018-10-05 07:54:13 +00:00
Ivan Kozik
8ec6659cc8 .travis.yml: test only on Python 3.7 2018-10-05 07:54:13 +00:00
Ivan Kozik
01d0fc28b8 Bump version 2018-10-05 07:54:13 +00:00
Ivan Kozik
b7dfb14dd8 Upgrade to and require Python 3.7.0 2018-10-05 07:53:58 +00:00
Ivan Kozik
7ec5accb22 Remove trollius 2018-10-04 14:58:03 +00:00
Ivan Kozik
b32da83a0f Install ludios/pyre2, to be used soon for processing ignores 2018-10-04 14:13:05 +00:00
Ivan Kozik
f7ed026010 wpull_hooks: "Picked up the changes to" -> "Imported" 2018-10-04 14:09:16 +00:00
Ivan Kozik
837551c201 README: link to ludios/wpull 2018-10-04 13:40:28 +00:00
Ivan Kozik
b6127f2077 Use ludios/wpull 1.2.5 2018-10-04 12:32:47 +00:00
Ivan Kozik
bc512c696d README: fix pip3 install step 2018-10-04 11:27:53 +00:00
Ivan Kozik
7c14a909ef README: Python 3.4.8 -> 3.4.9 2018-10-04 11:22:41 +00:00
Ivan Kozik
ba960e0ea8 README: fix pip3 install step for new setup.py 2018-10-04 11:22:21 +00:00
Ivan Kozik
eaaf0ec06e Use ludios/wpull for html5-parser support 2018-10-04 11:13:35 +00:00