Ivan Kozik
|
1957154321
|
Mention --no-skip-getaddrinfo
|
2015-10-07 08:13:19 +00:00 |
|
Ivan Kozik
|
ea483bc74b
|
README: Tweak
|
2015-09-30 23:46:46 +00:00 |
|
Ivan Kozik
|
8260a0d7cf
|
Add note about Python 3.5
|
2015-09-30 23:44:25 +00:00 |
|
Ivan Kozik
|
bfe92c9605
|
Document how to upgrade grab-site
|
2015-09-30 22:31:46 +00:00 |
|
Ivan Kozik
|
7a63a3dcd1
|
Add --no-dupespotter for turning off dupespotter which sometimes has false positives
|
2015-09-30 22:16:56 +00:00 |
|
Ivan Kozik
|
f1548521ec
|
Write URLs skipped by --max-content-length= to DIR/skipped_max_content_length
|
2015-09-02 19:15:00 +00:00 |
|
Ivan Kozik
|
b782c23389
|
Add --no-video option to skip the download of videos
|
2015-08-21 08:28:27 +00:00 |
|
Arkiver2
|
6f6754f81e
|
Add --warc-max-size=BYTES option for controlling WARC size
|
2015-08-21 07:47:12 +00:00 |
|
Ivan Kozik
|
49aa6d0dcf
|
Remove mentions of blogs ignore set
|
2015-08-21 05:20:26 +00:00 |
|
Ivan Kozik
|
13d73ad59f
|
README: tweak
|
2015-08-12 07:49:20 +00:00 |
|
Ivan Kozik
|
26c7ea84d8
|
Implement --wpull-args for passing additional arguments to wpull
|
2015-08-12 06:39:49 +00:00 |
|
Ivan Kozik
|
db212f6716
|
Reorder options in README
|
2015-08-12 05:39:16 +00:00 |
|
Ivan Kozik
|
668c03d5d2
|
Implement -i / --input-file, supporting both local input files and URLs
|
2015-08-12 05:24:09 +00:00 |
|
Ivan Kozik
|
37a6cb655c
|
README: tweak
|
2015-08-10 13:40:52 +00:00 |
|
Ivan Kozik
|
b7743e780a
|
Implement --ua= for setting the User-Agent
|
2015-08-10 13:38:00 +00:00 |
|
Ivan Kozik
|
ee4dbe162e
|
Implement --igon / --igoff
|
2015-08-10 13:23:43 +00:00 |
|
Ivan Kozik
|
76ba117d34
|
Document DIR/max_content_length
|
2015-08-10 13:15:20 +00:00 |
|
Ivan Kozik
|
bf080c7cb4
|
Implement --max-content-length=N for skipping large responses
|
2015-08-10 13:12:34 +00:00 |
|
Ivan Kozik
|
e1bb1ec749
|
README: tweak
|
2015-07-31 22:47:58 +00:00 |
|
Ivan Kozik
|
ed869864d4
|
README: link to ArchiveBot
|
2015-07-31 03:52:42 +00:00 |
|
Ivan Kozik
|
6cd50f9688
|
README: tweak
|
2015-07-31 03:50:39 +00:00 |
|
Ivan Kozik
|
412ea7791f
|
README: changes to ignores may take up to 3 seconds to apply
|
2015-07-30 23:36:12 +00:00 |
|
Ivan Kozik
|
a418beaff8
|
README: tweak for the non-ArchiveBot audience
|
2015-07-29 08:55:06 +00:00 |
|
Ivan Kozik
|
deb05d981d
|
README: link to correct ignore sets
|
2015-07-29 08:45:25 +00:00 |
|
Ivan Kozik
|
e6f830764e
|
Allow changing concurrency using DIR/concurrency file
|
2015-07-28 14:21:28 +00:00 |
|
Ivan Kozik
|
1198c88f2a
|
Document --delay in README
|
2015-07-28 14:01:28 +00:00 |
|
Ivan Kozik
|
7cf8db39d3
|
Mention pipe to sort | less -S
|
2015-07-28 11:40:14 +00:00 |
|
Ivan Kozik
|
0dc440ffd8
|
Tweak README
|
2015-07-28 11:34:58 +00:00 |
|
Ivan Kozik
|
975f328c95
|
Document gs-dump-urls
|
2015-07-28 11:33:51 +00:00 |
|
Ivan Kozik
|
dbe1deb9f0
|
Clarify ignore sets
|
2015-07-27 13:28:49 +00:00 |
|
Ivan Kozik
|
41f7683d98
|
+1 is OK
|
2015-07-27 08:52:48 +00:00 |
|
Ivan Kozik
|
015df2a0df
|
Link yipdw
|
2015-07-27 08:06:33 +00:00 |
|
Ivan Kozik
|
a89ef4b22b
|
README: add Thanks and P.S.
|
2015-07-27 07:59:57 +00:00 |
|
Ivan Kozik
|
3b5f8b4be3
|
Clarify --concurrency
|
2015-07-27 07:38:06 +00:00 |
|
Ivan Kozik
|
b7c2f1d1bd
|
Add --sitemaps/--no-sitemaps
|
2015-07-27 06:55:20 +00:00 |
|
Ivan Kozik
|
2e7d928614
|
Update README
|
2015-07-27 06:50:48 +00:00 |
|
Ivan Kozik
|
8d2acd669a
|
README: minor tweaks
|
2015-07-20 09:53:13 +00:00 |
|
Ivan Kozik
|
a7f2ee7684
|
Document webarchiveplayer for viewing your WARCs
|
2015-07-20 09:47:22 +00:00 |
|
Ivan Kozik
|
5e85e00201
|
README: document --concurrency=
|
2015-07-20 09:30:51 +00:00 |
|
Ivan Kozik
|
08933f60e2
|
Clarify ?host= dashboard option
|
2015-07-20 08:50:47 +00:00 |
|
Ivan Kozik
|
3f78e5f4bf
|
README: use an <h3>
|
2015-07-20 08:30:57 +00:00 |
|
Ivan Kozik
|
58b560257a
|
README: improve docs for options
|
2015-07-20 08:29:37 +00:00 |
|
Ivan Kozik
|
9af02f122b
|
Unbreak README
|
2015-07-20 08:25:33 +00:00 |
|
Ivan Kozik
|
1fce3af4a0
|
Add --1 option for turning off recursion; document options
|
2015-07-20 08:23:35 +00:00 |
|
Ivan Kozik
|
e83375382d
|
README: there are control files in DIR too
|
2015-07-20 08:04:14 +00:00 |
|
Ivan Kozik
|
210c3d03b5
|
README: include suggestions from @ethus3h (thanks!) and wrap long lines
|
2015-07-20 07:50:49 +00:00 |
|
Ivan Kozik
|
c7a272d7ba
|
Document how to fix your PATH for grab-site
|
2015-07-20 07:25:06 +00:00 |
|
Ivan Kozik
|
0e38441234
|
Add OS X support
|
2015-07-20 06:35:32 +00:00 |
|
Ivan Kozik
|
3ffed7dfbb
|
Tell people to use GitHub issues
|
2015-07-19 20:15:23 +00:00 |
|
Ivan Kozik
|
55e3507122
|
Tweak README
|
2015-07-18 12:09:51 +00:00 |
|