552 Commits

Author SHA1 Message Date
Mike Fährmann
df94182e11
implement 'parent-metadata' option (#1364)
experimental, might not work as expected, etc.
2021-03-11 01:10:34 +01:00
Mike Fährmann
4be27ff0fe
[nozomi] support '/index-N.html' URLs (closes #1365)
and '/index-Popular-N.html'
2021-03-11 01:06:47 +01:00
Mike Fährmann
83f465faca
[deviantart] refactor 'extra' (#1356)
- change its expected type to string
- let users specify a list of sources (stash, posts) or 'all'
2021-03-07 22:23:52 +01:00
Mike Fährmann
5c32a7bf58
[deviantart] allow selecting source for 'extra' (#1356)
Setting 'extra' to "stash" or "deviations" will only download embedded
sta.sh content or deviations. 'true' still downloads both.
2021-03-06 21:31:28 +01:00
Mike Fährmann
a677123abb
[instagram] recognize 'reels' as option for 'include' (#1329) 2021-03-06 18:50:19 +01:00
Mike Fährmann
7440d1f112
[pixiv] add 'translated-tags' option (closes #1354)
(a lot more straight forward than I thought ...)
2021-03-05 17:18:51 +01:00
Mike Fährmann
106cdc37c0
[instagram] support '/user/reels/' URLs (closes #1329) 2021-03-04 21:31:18 +01:00
Mike Fährmann
f59e63669b
[hentaicafe] add 'search' and 'tag' extractors (#1345) 2021-03-03 23:09:34 +01:00
Mike Fährmann
38e66940c1
[tumblrgallery] simplify 2021-03-03 15:37:56 +01:00
Mike Fährmann
6a28b7045c
update 'docs/gallery-dl.conf' 2021-03-03 03:11:48 +01:00
Mike Fährmann
bae874f370
replace 'wait-min/-max' with 'sleep-request'
on exhentai, idolcomplex, reactor
2021-03-02 22:55:45 +01:00
Mike Fährmann
faf561b6ca
[wallhaven] add 'collection' extractor (#1351) 2021-03-01 17:12:11 +01:00
Mike Fährmann
1a38fae785
add option to use different youtube-dl modules (fixes #1330)
by setting the 'downloader.ytdl.module' value. For example

{
    "downloader": {
        "ytdl": {
            "module": "yt_dlp"
        }
    }
}

or '-o module=yt_dlp'
2021-03-01 03:10:42 +01:00
Mike Fährmann
e58039358d
[mangadex] use 'api.mangadex.org' as default API server
The caching issues seem to be gone.
(#1290, #1310)
2021-02-28 01:31:50 +01:00
Mike Fährmann
29ea54dc41
[patreon] use '"browser": "firefox"' by default (#1117) 2021-02-27 16:26:42 +01:00
Mike Fährmann
61fbbd2dae
[exhentai] rename metadata fields to match API results (#1325)
- gallery_id    -> gid
- gallery_token -> token
- title_jp      -> title_jpn
- visible       -> expunged
- gallery_size  -> filesize
- count         -> filecount

Also changes the function of the 'metadata' option.
It is now boolean and causes extra data fields from the API to be added
instead of completely replacing the data from HTML when activated.
2021-02-26 18:21:04 +01:00
Mike Fährmann
5d69e437d0
[twitter] add option to download all media from a conversation
(fixes #1319)
2021-02-26 13:50:46 +01:00
Mike Fährmann
cf5fa75d4c
add 'browser' option (#1117)
- change default user agent to Firefox ESR 78 on Windows 10
- remove 'ciphers' option
2021-02-26 13:41:27 +01:00
Mike Fährmann
e5735361ed
[exhentai] add 'metadata' option (#1325)
to select between gallery metadata from 'api' or 'html'
2021-02-23 00:23:42 +01:00
loragja
7b5ee922b7
cyberdrop extractor (#1328)
* create cyberdrop extractor

* add cyberdrop to list of extractors

* fix formatting

* change class name from CyberdropExtractor to CyberdropAlbumExtractor

* add cyberdrop to list of supported sites

* attempt to clean up diff of supportedsites.rst

* replace regex with functions from text library
2021-02-21 20:42:45 +01:00
Mike Fährmann
5ad2b9c82b
[deviantart] extend 'extra' option
also download from embedded DeviantArt posts
2021-02-21 19:27:04 +01:00
Mike Fährmann
560277394e
[downloader:http] add 'headers' option (#1322) 2021-02-21 19:13:39 +01:00
Mike Fährmann
6b0ecbf6bc
[hentainexus] add 'orignal' option (#1322) 2021-02-21 19:06:12 +01:00
Mike Fährmann
03b219db9d
fix supportedsites.py 2021-02-20 22:31:21 +01:00
Mike Fährmann
8974f0361c
[pixiv] update (#1304)
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality

See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
2021-02-12 18:07:16 +01:00
Mike Fährmann
95a66bdad6
[imgclick] add 'image' extractor (closes #1307)
basically reverts b0e8daf4154f92e21896728be6fa373a40d5d7be
2021-02-10 17:22:12 +01:00
Mike Fährmann
ae530f6365
[erome] add extractors for albums, users, searches (closes #409) 2021-02-07 22:58:19 +01:00
Mike Fährmann
cdb0b02e30
[pillowfort] add 'reblogs' option (#846) 2021-01-25 15:03:59 +01:00
Mike Fährmann
7ca3bf7cb0
[pillowfort] add 'user' and 'post' extractors (#846) 2021-01-25 15:03:22 +01:00
Mike Fährmann
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst 2021-01-23 17:24:02 +01:00
Mike Fährmann
0eea424a52
update supportedsites.rst 2021-01-22 19:41:50 +01:00
Federico Ravasio
25297815bc
[photovogue] added portfolio extractor (#1253) 2021-01-22 19:36:13 +01:00
Mike Fährmann
7a096c443f
[unsplash] add 'format' option (#1197) 2021-01-22 17:23:46 +01:00
v-delta
e707e060cb
[vipr] add image extractor (#1258)
* [vipr] add image extractor

Adds support for images hosted on https://vipr.im

* Fix codestyle issues
2021-01-20 21:38:43 +01:00
Mike Fährmann
89a2bcbb2d
[furaffinity] add 'descriptions' option (#1231) 2021-01-19 19:09:29 +01:00
Mike Fährmann
36f281330a
[newgrounds] fix flash file extraction (closes #1257)
… and add a 'flash' option to choose between flash and video formats.
2021-01-19 17:48:14 +01:00
Mike Fährmann
534194bf92
[unsplash] add extractors (#1197)
for
- single photos  (/photos/ID)
- user profiles  (/@USER)
- user likes     (/@USER/likes)
- search results (/s/photos/SEARCH)
2021-01-19 02:23:39 +01:00
Mike Fährmann
c008cb5100
[pixiv] add 'related' option (#1237) 2021-01-17 22:48:32 +01:00
Mike Fährmann
01b9ccd4de
[derpibooru] use the "Everything" filter by default (#1243)
when neither 'api-key' nor 'filter' are set
2021-01-14 18:29:09 +01:00
Mike Fährmann
5d4494b15f
add "ascii" as a special 'path-restrict' value 2021-01-09 02:41:20 +01:00
Mike Fährmann
20bd9cd296
[wikiart] add extractor for single paintings (closes #1233)
There is no API endpoint for single paintings from what I can tell,
so this uses the site's search.
2021-01-08 23:19:00 +01:00
Mike Fährmann
fa8ee6eac4
[derpibooru] add search and gallery extractors (#862) 2021-01-07 18:05:32 +01:00
Mike Fährmann
8a88025dc4
[pinterest] support generic user URLs (#1205)
i.e. https://www.pinterest.com/USERNAME

also renames 'BoardsExtractor' to 'UserExtractor'
2021-01-02 02:36:53 +01:00
Mike Fährmann
56b460dcea
[foolfuuka] add 'search' extractors (#1174) 2021-01-02 02:34:06 +01:00
Mike Fährmann
fb64183d53
[foolfuuka] add 'board' extractors (closes #1044) 2021-01-01 19:33:35 +01:00
Mike Fährmann
b0beed7a06
[sankaku] add support for book searches (closes #1204) 2020-12-29 17:36:37 +01:00
Mike Fährmann
459a0af4f8
[sankaku] add support for sankaku.app URLs (closes #1193) 2020-12-22 01:57:53 +01:00
Mike Fährmann
371e9ca6df
[pinterest] implement video support (closes #1189) 2020-12-21 16:09:06 +01:00
Mike Fährmann
bf629a2818
[instagram] add 'include' option (closes #1180)
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
2020-12-21 02:06:28 +01:00
Mike Fährmann
212ae0c399
[mangapanda] remove module
site now redirects to mangareader.net
2020-12-20 17:42:15 +01:00