201 Commits

Author SHA1 Message Date
Ivan Kozik
f4f445b7dd igoff by default 2015-07-18 08:23:56 +00:00
Ivan Kozik
0d8288e6fb Send more job_data stats 2015-07-18 08:21:34 +00:00
Ivan Kozik
8c9ce8c24b ignore_sets -> igsets 2015-07-18 06:23:24 +00:00
Ivan Kozik
3965233862 Tweak README 2015-07-18 06:22:47 +00:00
Ivan Kozik
02502c5260 Tweak README 2015-07-18 06:21:03 +00:00
Ivan Kozik
804cb0a1ee Document grab-site dashboard 2015-07-18 06:16:46 +00:00
Ivan Kozik
35ad90cecb Allow customizing grab-site server location 2015-07-18 05:57:42 +00:00
Ivan Kozik
14b59e17dc Broadcast ignores 2015-07-18 05:55:51 +00:00
Ivan Kozik
09418a905a Better asserts 2015-07-18 05:51:53 +00:00
Ivan Kozik
3cd416f477 Fix formatting 2015-07-18 05:51:25 +00:00
Ivan Kozik
19107cbe28 Fix formatting 2015-07-18 05:51:15 +00:00
Ivan Kozik
1f789d204c Fix just in case wpull stops titlecasing headers 2015-07-18 05:50:07 +00:00
Ivan Kozik
0526f8c96e Log URLs being fetched to real stdout 2015-07-18 05:48:33 +00:00
Ivan Kozik
758ec1301a Camelcase 2015-07-18 05:40:35 +00:00
Ivan Kozik
952eb4c33f print some messages only to real stdout 2015-07-18 05:38:59 +00:00
Ivan Kozik
787db7da55 Make stdout/stderr capture actually work 2015-07-18 05:35:57 +00:00
Ivan Kozik
f1100e7223 Try to send stdout/stderr to dashboard and fail at it 2015-07-18 05:24:54 +00:00
Ivan Kozik
93adc1ad48 Refactor job_data broadcasting 2015-07-18 04:34:24 +00:00
Ivan Kozik
937908ef52 Report bytes downloaded to dashboard 2015-07-18 04:31:54 +00:00
Ivan Kozik
dcbcb28852 Reported started_at to dashboard 2015-07-18 04:21:35 +00:00
Ivan Kozik
a8eb218fa2 Don't say '1 crawls' 2015-07-18 04:17:08 +00:00
Ivan Kozik
e804f7171e Show job URLs on dashboard 2015-07-18 04:14:50 +00:00
Ivan Kozik
933d293305 Guess WebSocket port based on HTTP port; read dashboard.html on each request 2015-07-18 04:10:15 +00:00
Ivan Kozik
f155cbc4ed Make the dashboard sort-of work 2015-07-18 03:49:24 +00:00
Ivan Kozik
a4ce13001d Link to AutobahnPython bug 2015-07-18 03:33:57 +00:00
Ivan Kozik
53fd04a29e Make reconnecting work 2015-07-18 03:17:27 +00:00
Ivan Kozik
18a192739b Make WebSocket client/server sort of work; rename ignore_sets to igsets 2015-07-18 02:11:18 +00:00
Ivan Kozik
db21e530e2 Generate a grab id and put in the dir name; add some temporary print debugging 2015-07-18 01:06:56 +00:00
Ivan Kozik
5621863b09 Refactor the WebSocket client in hooks 2015-07-17 23:57:46 +00:00
Ivan Kozik
cc43d39a8e Remove License note in README 2015-07-17 23:53:28 +00:00
Ivan Kozik
aa0d7b280f Fix LICENSE 2015-07-17 23:53:11 +00:00
Ivan Kozik
69e56e3d12 grab-site -> grab site server 2015-07-17 23:47:18 +00:00
Ivan Kozik
8353827a02 Update UA 2015-07-17 23:45:18 +00:00
Ivan Kozik
2cdd7e1150 Add .gitignore 2015-07-17 23:44:43 +00:00
Ivan Kozik
a6a806986a CRLF -> LF 2015-07-17 23:44:26 +00:00
Ivan Kozik
7ea44c2d79 Remove ArchiveBot-specific stuff from dashboard 2015-07-17 23:42:51 +00:00
Ivan Kozik
134d1e2318 Remove framebusting 2015-07-17 23:38:24 +00:00
Ivan Kozik
732aeb0d5f Start up both an HTTP server and WebSocket server 2015-07-17 23:37:55 +00:00
Ivan Kozik
bce0d8f5b3 dashboard: Fix comment 2015-07-17 23:13:53 +00:00
Ivan Kozik
cf989b47e7 Go versionless on the dashboard 2015-07-17 23:13:53 +00:00
Ivan Kozik
38b212b3a4 Move 3.0 dashboard link to help text, to make header fit in FF 2015-07-17 23:13:53 +00:00
Ivan Kozik
658504b61a Enable the custom context menu in Firefox 41+ 2015-07-17 23:13:53 +00:00
Ivan Kozik
1bea898a36 Fix styling when nicks are not shown 2015-07-17 23:13:53 +00:00
Ivan Kozik
355acb5737 Don't treat Logging error as fatal error
Maybe revert this when https://github.com/chfoo/wpull/issues/268
is fixed
2015-07-17 23:13:53 +00:00
Ivan Kozik
fe6b727e70 Revert "Use better font-size in Firefox"
This reverts commit 66533bf58984e65e215d0fab2a9d9b5c1627b32c.

Well, that was embarassing.  My page zoom settings were screwing
things up on my end; 13px is fine.
2015-07-17 23:13:53 +00:00
Ivan Kozik
f06ccd4f3f Use better font-size in Firefox 2015-07-17 23:13:53 +00:00
Ivan Kozik
a34a56430a Enable custom context menu in IE10 and IE11 2015-07-17 23:13:53 +00:00
Ivan Kozik
963147e934 Reorder and reword some help text 2015-07-17 23:13:53 +00:00
Ivan Kozik
052768f512 Document &moreDom=1 2015-07-17 23:13:53 +00:00
Ivan Kozik
7b8924a85b Make context menu work with moreDom=1 2015-07-17 23:13:53 +00:00