Archiveteam
/
grab-site
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,158 Commits
1 Branch
0 Tags
1.4 MiB
Commit Graph

1158 Commits (master)

Author SHA1 Message Date
Ivan Kozik e0334923ef Code formatting 2018-10-07 19:36:42 +00:00
Ivan Kozik c34fa28b37 Alignment 2018-10-07 19:36:23 +00:00
Ivan Kozik 4b199bf423 Remove the psutil support that hopefully no one was using 
grab-site processes can be kill -STOP / kill -CONT'ed externally
 2018-10-07 19:34:25 +00:00
Ivan Kozik 1123896f45 Code formatting 2018-10-07 19:33:33 +00:00
Ivan Kozik 7b1cabed9a Remove commented `libgrabsite import wpull_hooks as _`; import-time errors are viewable in DIR/wpull.log 2018-10-07 19:29:32 +00:00
Ivan Kozik b4f67c80e1 Remove unsupported --custom-hooks 
The plan is to document some replacement later that might involve
modifying and pointing to another wpull_hooks.py
 2018-10-07 19:28:27 +00:00
Ivan Kozik 7b40c6b946 Refactor wpull_hooks functions to methods on GrabSitePlugin 
TODO: add back support for ignores
TODO: add back websocket client
 2018-10-07 19:14:56 +00:00
Ivan Kozik 08acad3e1c README: move security note to the end 2018-10-05 16:22:19 +00:00
Ivan Kozik 4e0952126e rm extra_docs/custom_hooks_sample.py 2018-10-05 16:20:18 +00:00
Ivan Kozik fca0eaf432 README: wrap lines 2018-10-05 16:19:55 +00:00
Ivan Kozik c186df0617 README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik d3da0899ad README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik ea4e4eff74 README: wrap lines 2018-10-05 16:19:18 +00:00
Ivan Kozik 65b4f5caca README: remove phantomjs mention because I removed support from ludios/wpull 2018-10-05 16:19:18 +00:00
Ivan Kozik e8a2163dd3 README: wrap lines 2018-10-05 16:19:15 +00:00
Ivan Kozik 4473c7040e README: wrap lines 2018-10-05 16:16:04 +00:00
Ivan Kozik 469dfdd0b9 README: wrap lines 2018-10-05 16:13:37 +00:00
Ivan Kozik e45f6f5b97 README: remove BrowserStack mention 2018-10-05 16:12:41 +00:00
Ivan Kozik 8bf22e410f README: thank JAA 2018-10-05 16:12:15 +00:00
Ivan Kozik fc54bed43a README: don't tell users to file issues on chfoo/wpull 2018-10-05 16:10:25 +00:00
Ivan Kozik ca10585c45 README: fix list of options 2018-10-05 16:09:11 +00:00
Ivan Kozik 8bed843e24 Add grab-site --debug flag for turning on wpull --debug 2018-10-05 14:21:24 +00:00
Ivan Kozik 0d42842fd0 Start porting hooks to wpull 2.0's new plugin system 2018-10-05 14:16:56 +00:00
Ivan Kozik 3f14886435 README: pip3 -> pip 2018-10-05 08:15:23 +00:00
Ivan Kozik 9c12ae390f Bump version 2018-10-05 08:15:23 +00:00
Ivan Kozik e6d81e81c5 Require ludios/wpull 3.0.2 and remove the install_requires that are in wpull 2018-10-05 08:15:16 +00:00
Ivan Kozik e1e60c6072 Bump version 2018-10-05 07:54:13 +00:00
Ivan Kozik f27c61bdfe wpull_hooks: remove method confusion 2018-10-05 07:54:13 +00:00
Ivan Kozik 82c94683d4 Remove unused html5lib dependency 2018-10-05 07:54:13 +00:00
Ivan Kozik 4d8218db7f Use wpull 1.3.1 2018-10-05 07:54:13 +00:00
Ivan Kozik 8ec6659cc8 .travis.yml: test only on Python 3.7 2018-10-05 07:54:13 +00:00
Ivan Kozik 01d0fc28b8 Bump version 2018-10-05 07:54:13 +00:00
Ivan Kozik b7dfb14dd8 Upgrade to and require Python 3.7.0 2018-10-05 07:53:58 +00:00
Ivan Kozik 7ec5accb22 Remove trollius 2018-10-04 14:58:03 +00:00
Ivan Kozik b32da83a0f Install ludios/pyre2, to be used soon for processing ignores 2018-10-04 14:13:05 +00:00
Ivan Kozik f7ed026010 wpull_hooks: "Picked up the changes to" -> "Imported" 2018-10-04 14:09:16 +00:00
Ivan Kozik 837551c201 README: link to ludios/wpull 2018-10-04 13:40:28 +00:00
Ivan Kozik b6127f2077 Use ludios/wpull 1.2.5 2018-10-04 12:32:47 +00:00
Ivan Kozik bc512c696d README: fix pip3 install step 2018-10-04 11:27:53 +00:00
Ivan Kozik 7c14a909ef README: Python 3.4.8 -> 3.4.9 2018-10-04 11:22:41 +00:00
Ivan Kozik ba960e0ea8 README: fix pip3 install step for new setup.py 2018-10-04 11:22:21 +00:00
Ivan Kozik eaaf0ec06e Use ludios/wpull for html5-parser support 2018-10-04 11:13:35 +00:00
Ivan Kozik 29b9825dc5 Bump version 2018-10-02 04:07:16 +00:00
Ivan Kozik 9575ed4ec2 global igset: remove Google Finance ignore as the site no longer exists 2018-10-02 04:05:31 +00:00
Ivan Kozik fa68cc68f0 global igset: combine some ignores 2018-10-02 04:05:08 +00:00
Ivan Kozik 2ad9d18d41 global igset: ignore telegram share URL 2018-10-02 04:02:22 +00:00
Ivan Kozik 6ea44ae862 global igset: combine some ignores 2018-10-02 04:01:58 +00:00
Ivan Kozik a045da3b82 default_cookies.txt: skip the quarantine gate on reddit.com 2018-09-28 04:27:15 +00:00
Ivan Kozik e664e4fd54 README: mention cookies.txt extension for Firefox 2018-09-08 04:30:01 +00:00
Ivan Kozik 424e58a173 README: document DIR/scrape 2018-08-28 01:30:35 +00:00