Ivan Kozik
f4f445b7dd
igoff by default
2015-07-18 08:23:56 +00:00
Ivan Kozik
0d8288e6fb
Send more job_data stats
2015-07-18 08:21:34 +00:00
Ivan Kozik
8c9ce8c24b
ignore_sets -> igsets
2015-07-18 06:23:24 +00:00
Ivan Kozik
3965233862
Tweak README
2015-07-18 06:22:47 +00:00
Ivan Kozik
02502c5260
Tweak README
2015-07-18 06:21:03 +00:00
Ivan Kozik
804cb0a1ee
Document grab-site dashboard
2015-07-18 06:16:46 +00:00
Ivan Kozik
35ad90cecb
Allow customizing grab-site server location
2015-07-18 05:57:42 +00:00
Ivan Kozik
14b59e17dc
Broadcast ignores
2015-07-18 05:55:51 +00:00
Ivan Kozik
09418a905a
Better asserts
2015-07-18 05:51:53 +00:00
Ivan Kozik
3cd416f477
Fix formatting
2015-07-18 05:51:25 +00:00
Ivan Kozik
19107cbe28
Fix formatting
2015-07-18 05:51:15 +00:00
Ivan Kozik
1f789d204c
Fix just in case wpull stops titlecasing headers
2015-07-18 05:50:07 +00:00
Ivan Kozik
0526f8c96e
Log URLs being fetched to real stdout
2015-07-18 05:48:33 +00:00
Ivan Kozik
758ec1301a
Camelcase
2015-07-18 05:40:35 +00:00
Ivan Kozik
952eb4c33f
print some messages only to real stdout
2015-07-18 05:38:59 +00:00
Ivan Kozik
787db7da55
Make stdout/stderr capture actually work
2015-07-18 05:35:57 +00:00
Ivan Kozik
f1100e7223
Try to send stdout/stderr to dashboard and fail at it
2015-07-18 05:24:54 +00:00
Ivan Kozik
93adc1ad48
Refactor job_data broadcasting
2015-07-18 04:34:24 +00:00
Ivan Kozik
937908ef52
Report bytes downloaded to dashboard
2015-07-18 04:31:54 +00:00
Ivan Kozik
dcbcb28852
Reported started_at to dashboard
2015-07-18 04:21:35 +00:00
Ivan Kozik
a8eb218fa2
Don't say '1 crawls'
2015-07-18 04:17:08 +00:00
Ivan Kozik
e804f7171e
Show job URLs on dashboard
2015-07-18 04:14:50 +00:00
Ivan Kozik
933d293305
Guess WebSocket port based on HTTP port; read dashboard.html on each request
2015-07-18 04:10:15 +00:00
Ivan Kozik
f155cbc4ed
Make the dashboard sort-of work
2015-07-18 03:49:24 +00:00
Ivan Kozik
a4ce13001d
Link to AutobahnPython bug
2015-07-18 03:33:57 +00:00
Ivan Kozik
53fd04a29e
Make reconnecting work
2015-07-18 03:17:27 +00:00
Ivan Kozik
18a192739b
Make WebSocket client/server sort of work; rename ignore_sets to igsets
2015-07-18 02:11:18 +00:00
Ivan Kozik
db21e530e2
Generate a grab id and put in the dir name; add some temporary print debugging
2015-07-18 01:06:56 +00:00
Ivan Kozik
5621863b09
Refactor the WebSocket client in hooks
2015-07-17 23:57:46 +00:00
Ivan Kozik
cc43d39a8e
Remove License note in README
2015-07-17 23:53:28 +00:00
Ivan Kozik
aa0d7b280f
Fix LICENSE
2015-07-17 23:53:11 +00:00
Ivan Kozik
69e56e3d12
grab-site -> grab site server
2015-07-17 23:47:18 +00:00
Ivan Kozik
8353827a02
Update UA
2015-07-17 23:45:18 +00:00
Ivan Kozik
2cdd7e1150
Add .gitignore
2015-07-17 23:44:43 +00:00
Ivan Kozik
a6a806986a
CRLF -> LF
2015-07-17 23:44:26 +00:00
Ivan Kozik
7ea44c2d79
Remove ArchiveBot-specific stuff from dashboard
2015-07-17 23:42:51 +00:00
Ivan Kozik
134d1e2318
Remove framebusting
2015-07-17 23:38:24 +00:00
Ivan Kozik
732aeb0d5f
Start up both an HTTP server and WebSocket server
2015-07-17 23:37:55 +00:00
Ivan Kozik
bce0d8f5b3
dashboard: Fix comment
2015-07-17 23:13:53 +00:00
Ivan Kozik
cf989b47e7
Go versionless on the dashboard
2015-07-17 23:13:53 +00:00
Ivan Kozik
38b212b3a4
Move 3.0 dashboard link to help text, to make header fit in FF
2015-07-17 23:13:53 +00:00
Ivan Kozik
658504b61a
Enable the custom context menu in Firefox 41+
2015-07-17 23:13:53 +00:00
Ivan Kozik
1bea898a36
Fix styling when nicks are not shown
2015-07-17 23:13:53 +00:00
Ivan Kozik
355acb5737
Don't treat Logging error as fatal error
...
Maybe revert this when https://github.com/chfoo/wpull/issues/268
is fixed
2015-07-17 23:13:53 +00:00
Ivan Kozik
fe6b727e70
Revert "Use better font-size in Firefox"
...
This reverts commit 66533bf58984e65e215d0fab2a9d9b5c1627b32c.
Well, that was embarassing. My page zoom settings were screwing
things up on my end; 13px is fine.
2015-07-17 23:13:53 +00:00
Ivan Kozik
f06ccd4f3f
Use better font-size in Firefox
2015-07-17 23:13:53 +00:00
Ivan Kozik
a34a56430a
Enable custom context menu in IE10 and IE11
2015-07-17 23:13:53 +00:00
Ivan Kozik
963147e934
Reorder and reword some help text
2015-07-17 23:13:53 +00:00
Ivan Kozik
052768f512
Document &moreDom=1
2015-07-17 23:13:53 +00:00
Ivan Kozik
7b8924a85b
Make context menu work with moreDom=1
2015-07-17 23:13:53 +00:00