mikf/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
2,194 Commits 1 Branch 0 Tags
Commit Graph

2194 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
2852691d78
[paheal] replace test URL 
searching for 'k-on' doesn't yield any results anymore
 2020-01-27 22:19:41 +01:00
Mike Fährmann
2a9be48511
improve util.load/save_cookiestxt() and add tests 
- take a file object as argument instead of an filename
- accept whitespace before comments ("   # comment")
- map expiration "0" to None and not the number 0
 2020-01-25 23:02:15 +01:00
Mike Fährmann
e35c2ea1a6
[weibo] use youtube-dl to download from m3u8 manifests 2020-01-24 23:39:34 +01:00
Mike Fährmann
6703b8a86b
[blogger] implement video extraction (closes #587) 2020-01-24 23:37:23 +01:00
Mike Fährmann
b3b5754f2d
update test_cookies.py 2020-01-21 22:46:58 +01:00
Mike Fährmann
c1a6862863
implement functions to load/save cookies.txt files (closes #586) 
The methods of the standard libraries' MozillaCookieJar have
several shortcomings (#HttpOnly_ cookies, 0 expiration timestamps, etc.)
and require construction of an ultimately pointless CookieJar object.
 2020-01-21 21:59:36 +01:00
Mike Fährmann
5d73b7f29c
release version 1.12.3 2020-01-19 23:31:28 +01:00
Mike Fährmann
37247dbaff
miscellaneous fixes 2020-01-19 22:53:06 +01:00
Mike Fährmann
0e9dc5c88e
fix AttributeError when accessing 'temppath' 
[ci skip]
 2020-01-19 00:41:21 +01:00
Mike Fährmann
25d5ec4ff3
[twitter] add option to extract TwitPic embeds (#579) 2020-01-18 21:31:29 +01:00
Mike Fährmann
254f7c3999
implement a post-processor module to compare file versions 
(#530)
 2020-01-18 21:08:25 +01:00
Mike Fährmann
32d7195d08
[pinterest] improve detection of invalid pin.it links 2020-01-18 21:06:44 +01:00
Mike Fährmann
0b84068d84
remove temp files before downloading from fallback URLs 
otherwise the next call to download() with a fallback URL could see
the partially downloaded "remains" from the previous, failed download
attempt and "continue" it, writing the second half of a potentially
different version of that file.
 2020-01-18 00:47:17 +01:00
Mike Fährmann
760b9b4db4
add remove_file() and remove_directory() helpers 
these functions call os.unlink() or os.rmdir()
while catching and suppressing potential OSErrors
 2020-01-18 00:21:26 +01:00
Mike Fährmann
b2d542ad40
improve PathFormat._enum_file() 
open only one try-except block for the whole loop,
instead of one for each iteration in os.path.exists()
 2020-01-18 00:21:25 +01:00
Mike Fährmann
174117f827
allow multiple hashes for content tests 2020-01-18 00:19:35 +01:00
Alice
f498a9057f [twitter] Fix stop before real end (#573) 
* [twitter] Fix stop before real end

Fix for https://github.com/mikf/gallery-dl/issues/544. Makes sure that it really reached the end by checking that both "min_position" is null and "has_more_items" is false before stopping.

* [twitter] Fix stop before real end (update)
 2020-01-14 12:24:30 +01:00
Mike Fährmann
8bb32ee188
[hitomi] fix image URLs 2020-01-14 12:04:48 +01:00
Mike Fährmann
bd5ce9855c
allow GalleryExtractors to set URL-independent extensions 2020-01-14 11:53:32 +01:00
Mike Fährmann
60a43f0264
fix downloader tests 2020-01-14 11:51:06 +01:00
Mike Fährmann
af42c75152
[mangadex] revert domain to 'mangadex.org' 2020-01-14 09:49:57 +01:00
Mike Fährmann
a6b98d3bec
fix auto-generation of supportedsites.rst 2020-01-14 09:48:32 +01:00
Mike Fährmann
3c534d8c2c
remove pyOpenSSL from README and setup.py 2020-01-13 22:11:39 +01:00
Mike Fährmann
200aea308a
[downloader:common] enable 'job'/'extractor' for logging messages 
(#574)
 2020-01-12 21:41:16 +01:00
Mike Fährmann
e89413da22
update test results 2020-01-12 21:41:06 +01:00
Mike Fährmann
88ccfe984d
update mentioned Python version for standalone executables 2020-01-12 20:06:02 +01:00
Mike Fährmann
33a6e0ac6e
[hentaifoundry] extract more metadata (closes #565) 2020-01-11 23:22:50 +01:00
Mike Fährmann
5cac79c3d9
[erolord] remove extractor 2020-01-10 14:40:30 +01:00
Mike Fährmann
b9cbf932b4
[pixiv] update URL patterns (fixes #568) 
Pixiv now uses new URLs for
- user profiles and illustration listings:
  - https://www.pixiv.net/en/users/<ID>
  - https://www.pixiv.net/en/users/<ID>/artworks
- bookmarks:
  - https://www.pixiv.net/en/users/<ID>/bookmarks/artworks
 2020-01-10 13:38:09 +01:00
Mike Fährmann
9d369de592
release version 1.12.2 2020-01-05 21:47:13 +01:00
Mike Fährmann
988cc2ec23
[mangadex] change domain to mangadex.cc (closes #559) 2020-01-05 21:21:40 +01:00
Mike Fährmann
f8e137d6b4
[deviantart] show warning about private deviations only once 
… per call to '_pagination()'
 2020-01-05 17:43:05 +01:00
Mike Fährmann
939fec8ecd
[deviantart] match new search/popular URLs (closes #538) 2020-01-05 17:32:06 +01:00
Mike Fährmann
09cc88b715
[deviantart] match '/favourites/all' URLs (closes #555) 2020-01-05 13:59:35 +01:00
Mike Fährmann
3811fd8a25
fix time formatting for Python 3.4 and 3.5 
'datetime.time.isoformat()' only has an optional 'timespec' argument
since Python 3.6.
 2020-01-05 00:47:10 +01:00
Mike Fährmann
43ab9572b4
[twitter] handle API rate limits (#526) 2020-01-04 23:46:29 +01:00
Mike Fährmann
569747a78d
implement extractor.wait() 2020-01-04 23:42:07 +01:00
Mike Fährmann
5532e9c158
[twitter] handle quoted tweets (#526) 
… and categorize them as retweets
 2020-01-04 21:26:55 +01:00
Mike Fährmann
0b4cb8e57a
[mangahere] send 'isAdult' cookie (fixes #556) 2020-01-04 21:25:35 +01:00
Mike Fährmann
025f6e3398
add fallback for missing WITHOUT ROWID support (#553) 2020-01-03 22:58:28 +01:00
Mike Fährmann
87c8b89ddd
[postprocessor:metadata] add 'directory' option (#520) 2020-01-02 20:58:10 +01:00
Mike Fährmann
1afb91363c
[imagefap] generalize URL patterns and add tests (#552) 2020-01-02 14:26:18 +01:00
Xope Totec
f701e9f33a Handle beta.imagefap.com URLs (#552) 2020-01-02 14:22:00 +01:00
Mike Fährmann
ce54b8c04c
let extractors opt-out of cookie option usage 
useful to avoid sending unnecessary cookies when all authentication
is done through OAuth tokens
 2020-01-01 21:12:37 +01:00
Mike Fährmann
5ad92fc196
[newgrounds] fix tags metadata extraction 2020-01-01 16:06:58 +01:00
Mike Fährmann
82f7f4172a
update test results 2020-01-01 16:05:38 +01:00
Mike Fährmann
1f2a69f3c5
add '_extractor' information to redirect results 2019-12-29 23:37:34 +01:00
Mike Fährmann
2d4887b75b
improve KeywordJob output for "parent" extractors (closes #548) 2019-12-28 22:26:49 +01:00
Mike Fährmann
a27f43dad1
[pixiv] wait and retry after rate limit error (closes #535) 2019-12-28 22:06:58 +01:00
Mike Fährmann
6b373cb7e2
[exhentai] restrict default directory name length (#545) 2019-12-27 21:29:00 +01:00