Ivan Kozik
|
49271c77e8
|
Merge branch 'ws-http-same-port'
|
2016-02-25 01:07:32 +00:00 |
|
Ivan Kozik
|
f9db61259c
|
README: Be more specific about port deprecation
|
2016-02-25 00:33:45 +00:00 |
|
Ivan Kozik
|
bfb866dfed
|
s/started/listening/
|
2016-02-25 00:32:42 +00:00 |
|
Ivan Kozik
|
147e6d913f
|
README: Add note about port 29001
|
2016-02-25 00:23:48 +00:00 |
|
Ivan Kozik
|
fcc3a7f904
|
Listen on port 29001 as well until everyone's old port-29001 crawls finish
|
2016-02-25 00:20:23 +00:00 |
|
Ivan Kozik
|
be8418f52c
|
Don't allow anyone to frame/iframe us
|
2016-02-25 00:01:27 +00:00 |
|
Ivan Kozik
|
0f5342b9c0
|
Factor out a sendPage
|
2016-02-24 23:58:43 +00:00 |
|
Ivan Kozik
|
25b3c9c076
|
Read bytes from file and send the correct Content-Length
|
2016-02-24 23:52:37 +00:00 |
|
Ivan Kozik
|
7486daa33f
|
Use \r\n instead of \x0d\x0a
|
2016-02-24 23:47:03 +00:00 |
|
Ivan Kozik
|
7024f1e232
|
Fix comment
|
2016-02-24 23:46:21 +00:00 |
|
Ivan Kozik
|
c20a0f76ba
|
Merge branch 'pr_76' into ws-http-same-port
|
2016-02-24 23:43:23 +00:00 |
|
12As
|
5da8e85d43
|
Update server.py
fixed errors
|
2016-02-24 16:44:13 -06:00 |
|
12As
|
e7e3030d4e
|
Update server.py based on comments in PR #76
Changed server to handle paths, added a send404 method and fixed letter case on variables
|
2016-02-24 16:03:34 -06:00 |
|
12As
|
3f0c433668
|
Update dashboard.html, per comments in PR.
|
2016-02-24 15:22:31 -06:00 |
|
12As
|
4a51ee1c83
|
Create 404 Not Found page
|
2016-02-24 15:10:33 -06:00 |
|
12As
|
990f24684a
|
Remove aiohttp dependency from setup.py
|
2016-02-23 14:10:15 -06:00 |
|
Ivan Kozik
|
21ab037cf1
|
README: Expand on abuse@ complaints
|
2016-02-21 06:24:33 +00:00 |
|
Ivan Kozik
|
b368a7b210
|
Add more tests to .travis.yml
|
2016-02-21 05:20:52 +00:00 |
|
Ivan Kozik
|
be685a7e65
|
README: Tweak
|
2016-02-21 05:10:34 +00:00 |
|
Ivan Kozik
|
37910d0382
|
README: Tweak
|
2016-02-21 05:08:52 +00:00 |
|
Ivan Kozik
|
eb6f90ad84
|
README: Document --which-wpull-args-partial and --which-wpull-command
|
2016-02-21 05:06:16 +00:00 |
|
Ivan Kozik
|
506a7604ef
|
Rename --which-wpull-args-full to --which-wpull-command
|
2016-02-21 04:49:53 +00:00 |
|
Ivan Kozik
|
5805e4c155
|
Implement --which-wpull-args-partial and --which-wpull-args-full for figuring out which wpull arguments grab-site would use, without actually starting wpull
|
2016-02-21 04:33:14 +00:00 |
|
Ivan Kozik
|
bda4d8cf6d
|
Pass maybe_log_ignore and print_to_terminal as globals to custom_hooks.py as well
|
2016-02-21 00:53:03 +00:00 |
|
Ivan Kozik
|
bc04df2dd2
|
README: Point to update_custom_hooks
|
2016-02-21 00:42:46 +00:00 |
|
Ivan Kozik
|
4b0740ecf6
|
Move pause-or-resume grab-sites script to extra_docs/
|
2016-02-21 00:40:24 +00:00 |
|
Ivan Kozik
|
c37b32bd1c
|
Implement --custom-hooks so that users can modify wpull_hook
|
2016-02-21 00:23:18 +00:00 |
|
12As
|
e01e0a38b1
|
Update Readme.md to remove multiple port mention
|
2016-02-20 15:28:18 -06:00 |
|
12As
|
dec4150969
|
Change default port in wpull_hooks.py
|
2016-02-20 15:25:20 -06:00 |
|
12As
|
492625a09d
|
Change default port in dashboard.html
|
2016-02-20 15:23:31 -06:00 |
|
12As
|
53e079228d
|
Make gs-server use single port
Remove the need for gs-server to require multiple ports
|
2016-02-20 15:20:53 -06:00 |
|
Ivan Kozik
|
7f426d2aad
|
README: Tweak
|
2016-02-20 17:03:26 +00:00 |
|
Ivan Kozik
|
557ae40982
|
README: Tweak
|
2016-02-20 17:03:08 +00:00 |
|
Ivan Kozik
|
67d650c288
|
README: Tweak
|
2016-02-20 17:00:50 +00:00 |
|
Ivan Kozik
|
6189c7c124
|
README: Fix GCE name
|
2016-02-18 04:13:18 +00:00 |
|
Ivan Kozik
|
08a90865a2
|
README: Tweak
|
2016-02-17 22:00:04 +00:00 |
|
Ivan Kozik
|
e53a8a8956
|
README: Add warnings section
|
2016-02-17 21:49:35 +00:00 |
|
Ivan Kozik
|
0f2d7afc8f
|
README Move pause-resume-grab-site script to a gist
|
2016-02-17 21:24:47 +00:00 |
|
Ivan Kozik
|
292682a48f
|
Bump version
|
2016-02-16 17:25:11 +00:00 |
|
Daniel Oaks
|
95012d1e0c
|
gs-server: Use env instead of py3 directly, makes virtualenvs nicer
|
2016-02-16 17:24:20 +00:00 |
|
Ivan Kozik
|
12eb6e20af
|
README: Tweak
|
2016-02-16 17:22:05 +00:00 |
|
Ivan Kozik
|
c7927a155f
|
README: Document locale requirement on OS X
|
2016-02-16 17:19:53 +00:00 |
|
Ivan Kozik
|
dbed789ff9
|
README: Tweak
|
2016-02-08 20:15:51 +00:00 |
|
Ivan Kozik
|
50ff7759ba
|
README: Automatically pausing grab-site processes when free disk space runs low
|
2016-02-08 20:09:32 +00:00 |
|
Ivan Kozik
|
7c1afbefe0
|
Use wpull 1.2.3
|
2016-02-05 19:15:25 +00:00 |
|
Ivan Kozik
|
ef5137ae86
|
Update UA
|
2016-02-01 16:19:49 +00:00 |
|
Ivan Kozik
|
1e06fa0a6e
|
.travis.yml: a grab-site of github.com/ludios/grab-site is returning exit code 8 because img.shields.io is down, so crawl google.com instead
|
2016-01-31 13:47:51 +00:00 |
|
Ivan Kozik
|
7ec2f90534
|
global igset: Ignore /CSI/CSI/ loops on blogspot
|
2016-01-12 22:44:57 +00:00 |
|
Ivan Kozik
|
0214558d5e
|
global igset: ignore bogus /search/label/CSI/ links on blogspot
|
2016-01-12 03:20:44 +00:00 |
|
Ivan Kozik
|
192553d6b9
|
Mention that the defaults work for Discourse forums
|
2016-01-11 04:51:23 +00:00 |
|