Commit Graph

3893 Commits (master)

Author SHA1 Message Date
Mike Fährmann 444dfb4aa6
[instagram] add 'highlight_title' and 'date' metadata
to highlight posts (#2879)
2022-09-03 16:21:26 +02:00
Mike Fährmann 7f764ebee6
[redgifs] "fix" download URLs (#2884) 2022-09-02 23:25:38 +02:00
Mike Fährmann 3cb8327c60
[zerochan] add 'metadata' option (#2861) 2022-09-02 23:25:19 +02:00
blankie 9745b48830
[tumblr] attempt to fetch high-quality inline images (#2877)
* [tumblr] attempt to fetch high-quality images (again)

Fixes #1846, and fixes #1344

* slight refactor

* update configuration.rst entry
2022-08-31 10:53:50 +02:00
Mike Fährmann daef91c925
[smugmug] update default API credentials (#2881)
The old key lacked v2 access and I'm unable to accept
the new terms of service since my old account got deleted
2022-08-31 10:28:25 +02:00
Mike Fährmann 4d78ca89db
[twitter] add 'cards-blacklist' option (#2875) 2022-08-31 10:28:25 +02:00
Mike Fährmann 4d7cb0bf56
[twitter] general support for unified cards (#2875)
just removing the 'type' check seems to work
2022-08-31 10:25:27 +02:00
Mike Fährmann 8839b0d2ee
add section about global replacement fields to formatting.md
(#2862)
2022-08-30 21:32:22 +02:00
Mike Fährmann 1da415c160
update chapter filter section in README (#2864)
- use -o lang0fr for mangadex
- update URL
2022-08-30 21:31:55 +02:00
Mike Fährmann f16fbe9f93
document 'extractor.twitter.expand' (#2848) 2022-08-30 18:16:20 +02:00
Mike Fährmann 7ddfff957c
[twitter] support "image_website" unified cards (#2875) 2022-08-30 18:16:10 +02:00
Mike Fährmann 51f14223a8
release version 1.23.0 2022-08-28 19:54:55 +02:00
Mike Fährmann 2eb0ddd083
[hitomi] fix error when number of tag results is multiple of 25
(#2870)
2022-08-28 17:06:11 +02:00
Mike Fährmann 3cebf787c4
[slideshare] fix metadata extraction 2022-08-28 10:52:28 +02:00
Mike Fährmann da11fb32d0
update extractor test results 2022-08-28 00:16:12 +02:00
Mike Fährmann 636d03df95
[nijie] reduce cache maxage to 90 days 2022-08-27 21:57:45 +02:00
Mike Fährmann f375ec0ffa
[vsco] fix 'collection' extraction 2022-08-27 21:16:22 +02:00
Mike Fährmann 8672f8a2b9
[skeb] fix archive_ids for thumbnails and article images
8cf5981ded (commitcomment-82316040)
2022-08-27 16:46:53 +02:00
Mike Fährmann 69995d789b
Revert "[twitter] use '{author[name]' in default directory names"
This reverts commit 9ad3cdc5d8.
2022-08-27 15:11:59 +02:00
Mike Fährmann 946643c23c
[hitomi] use maxage for gg.js cache (#2863)
cached values become invalid after 1-2 hours
2022-08-26 17:57:17 +02:00
Mike Fährmann d508b2c049
[gelbooru] implement 'pool' pagination (#2853) 2022-08-26 17:57:17 +02:00
Mike Fährmann 67a2efb885
[rule34] implement 'pool' pagination (#2853) 2022-08-26 17:57:17 +02:00
Mike Fährmann 70dc4ce911
[skeb] ignore article images with empty URL
8cf5981ded (commitcomment-81980633)
2022-08-26 17:57:17 +02:00
Mike Fährmann f362d4a3c7
[e621] fix 'popular' extraction 2022-08-26 17:57:17 +02:00
Mike Fährmann 7e385ed63e
[foolfuuka] update domains
- remove nyafuu
- add rozenarcana (https://archive.alice.al/)
- add tokyochronos (https://www.tokyochronos.net)
2022-08-26 17:57:17 +02:00
Mike Fährmann 6ba72b6bc6
[twitter] ignore invalid user entries (#2850) 2022-08-26 17:57:17 +02:00
Mike Fährmann 67bad04dda
[formatter] add 'g' conversion to sluGify a string (#2410) 2022-08-26 17:57:17 +02:00
blankie e4cff67aaa
[tumblr] add count metadata field (#2804)
Fixes #2778
2022-08-18 18:24:37 +02:00
enduser420 574e38a287
[kemonoparty] add 'favorites' option (#2826) (#2831)
* [kemonoparty] add 'favorites' option (#2826)

* [kemonoparty] add regex for the url parameter and fallback on the config
option

* [kemonoparty] simplify
2022-08-18 18:01:42 +02:00
Mike Fährmann a799fae2df
[catbox] add 'album' extractor (#2410)
adapted from https://github.com/mikf/gallery-dl/pull/2805

- rewrite using GalleryExtractor
- extract more metadata
- match lolisafe names
- add test
2022-08-18 18:00:24 +02:00
Mike Fährmann 264f1336ad
[twitter] unescape '+' in search queries (#2226)
... and do not raise exception if searched user does not exist
2022-08-17 22:20:26 +02:00
Mike Fährmann 6990ad0ba8
[formatter] do NOT apply :J to strings (#2833) 2022-08-16 16:41:19 +02:00
Mike Fährmann 590f2e270c
[postprocessor:metadata] fix error with '..' in directory 2022-08-14 17:44:46 +02:00
Mike Fährmann 21ff77fea0
[zerochan] extract more metadata for single posts
Neither HTML pages nor RSS feed entries have *all* metadata.
It might be necessary to do 1-2 extra HTTP requests to grab everything.
2022-08-14 17:26:29 +02:00
Mike Fährmann 391aecf219
[instagram] provide 'date' for directories (#2830) 2022-08-14 17:24:48 +02:00
Martin Juhasz 9ea521bec5
[oauth] add host config option (#2806) 2022-08-14 17:08:01 +02:00
Mike Fährmann 9ad3cdc5d8
[twitter] use '{author[name]' in default directory names
with the changes to 'user' (749802c7),
'{user[name]' with enabled retweets / quote tweets
would put a lot of them in a wrong directory
2022-08-12 11:36:55 +02:00
Mike Fährmann 764906e1af
allow tabstops as whitespace before input file comments (#2808) 2022-08-11 12:39:19 +02:00
Mike Fährmann 1c89ccb27d
[weibo] prevent errors when paginating over album entries (#2817) 2022-08-11 12:22:14 +02:00
Mike Fährmann a27b17481f
[tumblr] restrict condition for calling _original_image 2022-08-11 12:20:39 +02:00
Mike Fährmann df1c643dda
[tumblr] attempt to extract full-resolution photos
- for photos with apparent width == 2048 or height == 3072
- can be disabled with 'original' option
2022-08-10 20:01:46 +02:00
Mike Fährmann d0adc13e23
allow comments after input file URLs (#2808)
everything after the first " #" (space + hash) gets ignored
2022-08-09 23:26:02 +02:00
Mike Fährmann a69f198ac9
[wallhaven] implement 'metadata' option (#2803) 2022-08-08 21:46:36 +02:00
Mike Fährmann c0051d7d4c
fix test 2022-08-01 21:40:35 +02:00
Mike Fährmann dd3a6a9fd1
make 'enumerate_reversed()' work with generators (#2795) 2022-08-01 14:08:44 +02:00
Mike Fährmann 033faf67ec
[poipiku] update filter for static images (#2796) 2022-08-01 12:36:19 +02:00
Mike Fährmann b9a14b5758
[poipiku] fix posts with more than one image (#2796) 2022-08-01 12:28:52 +02:00
Mike Fährmann 72389658b6
use legacy flake8 for linting 2022-07-31 19:45:21 +02:00
Mike Fährmann 0f5826e884
[weibo] prevent exception for missing 'playback_list' (#2792) 2022-07-30 16:49:08 +02:00
Mike Fährmann 7d1a95ada6
implement 'path-metadata' option (#2734) 2022-07-30 12:31:45 +02:00