3266 Commits

Author SHA1 Message Date
Mike Fährmann
280b1ac16d
[slideshare] fix extraction 2021-02-08 22:29:30 +01:00
Mike Fährmann
ae530f6365
[erome] add extractors for albums, users, searches (closes #409) 2021-02-07 22:58:19 +01:00
ticklebits
fa6d4d73c7
[hentaifox] support searching by group (#1294)
Groups on hentaifox lists the items to download the same way as the other pages (artists, search, tag, etc). Added group to the pattern to search, and the test.
2021-02-06 17:52:00 +01:00
Mike Fährmann
2cc1e04fe5
[kemonoparty] extract inline images (fixes #1286) 2021-02-05 20:10:20 +01:00
Mike Fährmann
56a8968435
remove 'Message.Metadata' (#866) 2021-01-31 02:12:37 +01:00
Mike Fährmann
1d145a6186
[mastodon] use cache for OAuth tokens (#616) 2021-01-31 01:38:23 +01:00
Mike Fährmann
a041a017d1
[pillowfort] ignore files without download URL (#846) 2021-01-30 21:50:56 +01:00
Mike Fährmann
23ff936d46
[nsfwalbum] use fallback for deleted content (fixes #1259) 2021-01-29 23:35:20 +01:00
Mike Fährmann
a228bb3a5f
[downloader:http] support callbacks to validate responses 2021-01-29 22:15:21 +01:00
Mike Fährmann
6b2bce3b7d
[behance] support 'video' modules (closes #1282)
(requires youtube-dl to download from m3u8 manifests)
2021-01-29 21:30:14 +01:00
Mike Fährmann
b0cff979b1
[inkbunny] raise NotFoundError for invalid/private submissions
instead of crashing
2021-01-28 17:05:52 +01:00
Mike Fährmann
e61b125fcc
[inkbunny] add 'sid' parameter to private file downloads
(fixes #1281)
2021-01-28 15:45:48 +01:00
Mike Fährmann
36bf76fa44
update 'oauth:mastodon:<instance>' code 2021-01-28 02:20:12 +01:00
Mike Fährmann
88fae99811
remove 'generate_extractors()' 2021-01-28 01:04:50 +01:00
Mike Fährmann
fa33f13453
[mastodon] update
- inherit from BaseExtractor
- remove custom generate_extractors() and config()
- improve layout of MastodonAPI internals
2021-01-27 23:49:01 +01:00
Mike Fährmann
231bcad614
[shopify] use BaseExtractor 2021-01-27 23:45:22 +01:00
Mike Fährmann
2de8ebc098
[moebooru] use BaseExtractor 2021-01-27 01:33:40 +01:00
Mike Fährmann
0978c1e184
[booru] use BaseExtractor 2021-01-27 01:33:01 +01:00
Mike Fährmann
c6cc86d7d0
[deviantart] update parameters for '/browse/popular'
- limit results to 50 when also querying metadata (fixes #1267)
- remove deprecated 'category_path' parameter
2021-01-26 23:35:32 +01:00
Mike Fährmann
993856b866
[foolslide] use BaseExtractor 2021-01-26 18:50:32 +01:00
Mike Fährmann
671a95cae5
[foolfuuka] use BaseExtractor 2021-01-26 18:48:37 +01:00
Mike Fährmann
745a114c61
[common] implement BaseExtractor class
Should be used when the same extractor logic applies to different
instances/domains of several sites, e.g. FoolFuuka, Shopify, etc.

This will replace the functionality of 'generate_extractors()' in
a more efficient way, by condensing everything into 1 class and not
dynamically generating an extractor class for each instance.
2021-01-26 03:48:02 +01:00
Mike Fährmann
b549c53b36
add long option for '-G' 2021-01-26 01:01:22 +01:00
Mike Fährmann
c26de0929d
[deviantart] provide 'extension' for original file downloads
(#1272)
2021-01-25 19:11:00 +01:00
Mike Fährmann
24e8e398e0
[twitter] skip login if 'auth_token' cookie is present 2021-01-25 15:03:59 +01:00
Mike Fährmann
cdb0b02e30
[pillowfort] add 'reblogs' option (#846) 2021-01-25 15:03:59 +01:00
Mike Fährmann
7ca3bf7cb0
[pillowfort] add 'user' and 'post' extractors (#846) 2021-01-25 15:03:22 +01:00
Mike Fährmann
ebf417f31f
remove support for deprecated options
- instagram.highlights
- metadata.bypost
- exec.final
2021-01-24 22:30:16 +01:00
Mike Fährmann
477ed010c1
release version 1.16.4 2021-01-23 17:34:59 +01:00
Mike Fährmann
1d13e48512
[unsplash] implement 'skip()' 2021-01-23 17:24:18 +01:00
Mike Fährmann
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst 2021-01-23 17:24:02 +01:00
Mike Fährmann
0eea424a52
update supportedsites.rst 2021-01-22 19:41:50 +01:00
Mike Fährmann
6cdbfb79e9
[photovogue] update (#1253) 2021-01-22 19:38:10 +01:00
Federico Ravasio
25297815bc
[photovogue] added portfolio extractor (#1253) 2021-01-22 19:36:13 +01:00
Mike Fährmann
0265fbda61
[mangakakalot] fix extraction 2021-01-22 17:24:18 +01:00
Mike Fährmann
7a096c443f
[unsplash] add 'format' option (#1197) 2021-01-22 17:23:46 +01:00
Mike Fährmann
3188ac16d1
[unsplash] add 'collection' extractor (#1197) 2021-01-21 22:30:01 +01:00
Mike Fährmann
247cc73446
[derpibooru] update 'date' parsing 2021-01-21 21:51:04 +01:00
Mike Fährmann
193dca2ce1
update extractor test results 2021-01-21 21:35:42 +01:00
Mike Fährmann
89ea1384fc
[unsplash] fix typo 2021-01-20 22:51:02 +01:00
Mike Fährmann
e5e591b848
[vipr] simplify and add test (#1258) 2021-01-20 21:40:04 +01:00
v-delta
e707e060cb
[vipr] add image extractor (#1258)
* [vipr] add image extractor

Adds support for images hosted on https://vipr.im

* Fix codestyle issues
2021-01-20 21:38:43 +01:00
Mike Fährmann
95e5911895
[twitter] match '/i/user/ID' URLs 2021-01-20 00:33:57 +01:00
Mike Fährmann
069b113cbf
[twitter] improve and fix retry after hitting rate limit
- replace recursive call with infinite loop
- fix function arguments for recursive call
2021-01-19 23:50:07 +01:00
Mike Fährmann
89a2bcbb2d
[furaffinity] add 'descriptions' option (#1231) 2021-01-19 19:09:29 +01:00
Mike Fährmann
36f281330a
[newgrounds] fix flash file extraction (closes #1257)
… and add a 'flash' option to choose between flash and video formats.
2021-01-19 17:48:14 +01:00
Mike Fährmann
534194bf92
[unsplash] add extractors (#1197)
for
- single photos  (/photos/ID)
- user profiles  (/@USER)
- user likes     (/@USER/likes)
- search results (/s/photos/SEARCH)
2021-01-19 02:23:39 +01:00
Mike Fährmann
1fc16cb8c5
[instagram] fix regex for '/saved' URLs (fixes #1251)
The URL pattern erroneously had two '([^/?#]+)' capture groups,
which would split any username into 'usernam' for the first group
and 'e' for the ignored second group.
2021-01-17 23:34:45 +01:00
Mike Fährmann
c008cb5100
[pixiv] add 'related' option (#1237) 2021-01-17 22:48:32 +01:00
Mike Fährmann
e9a75e27d9
[foolfuuka] stop search when results are exhausted (#1174) 2021-01-17 22:48:21 +01:00