mikf/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3,810 Commits 1 Branch 0 Tags
Commit Graph

3532 Commits

Author SHA1 Message Date
Mike Fährmann
1da3ccf608
[twitter] implement 'expand' option (#2665) 2022-06-12 17:26:51 +02:00
Mike Fährmann
0add1fc090
[twitter] improve strategy for user URLs (#2665) 
- use '/with_replies' when appropriate
- consider 'text-tweets'
- build search query as necessary
 2022-06-12 17:24:53 +02:00
Mike Fährmann
45c980daf0
[weibo] fix retweets (#2601) 2022-06-11 15:30:26 +02:00
Mike Fährmann
34c428abf1
support cygwin/BSD/etc for --cookies-from-browser 
https://github.com/yt-dlp/yt-dlp/pull/3975
 2022-06-11 15:30:11 +02:00
Mike Fährmann
ae1b24aa6a
[instagram] automatically invalidate expired login sessions 2022-06-10 22:43:11 +02:00
Mike Fährmann
42525cfe8d
fix '{…!j}' for otherwise non-serializable types (##2624) 
like 'datetime'
 2022-06-07 17:47:07 +02:00
Mike Fährmann
47a92c8c7e
[instagram] provide 'date' for 'carousel_media' files (#2660) 2022-06-07 15:11:49 +02:00
Mike Fährmann
2064f20e11
[instagram} fix 'tag' extractor (#2659) 2022-06-06 14:30:44 +02:00
Mike Fährmann
6c0fa2f258
[readcomiconline] update 2022-06-05 21:40:08 +02:00
Mike Fährmann
61cbf8318c
[weibo] fix URLs generated by 'user' extractor (#2601) 2022-06-05 21:37:57 +02:00
Mike Fährmann
c2d117163f
release version 1.22.1 2022-06-04 19:43:48 +02:00
Mike Fährmann
4b78bd423f
[paheal] add 'metadata' option (#2641) 2022-06-04 16:05:49 +02:00
Mike Fährmann
535cbcb185
cache extracted browser cookies 
(in memory, for as long as gallery-dl is running)

Extracting encrypted cookies from a chromium-based browser can take a
long time, so repeating this process for each extractor should be
avoided.

Same goes for creating a temporary copy of the entire cookie database.
 2022-06-04 12:38:38 +02:00
Mike Fährmann
541a61d344
[subscribestar] fix 'date' metadata (#2642) 
Handle instances where the actual datetime information
is preceded by "Updated on "
 2022-06-04 12:24:08 +02:00
Mike Fährmann
46d171c938
[instagram] fix stories (#2644) 
fixing the fix ...
 2022-06-03 19:01:32 +02:00
Mike Fährmann
e59bcb8437
[weibo] ensure media URLs use https:// 2022-06-03 17:37:57 +02:00
Mike Fährmann
73f673e3ca
[weibo] handle 'gif' pictures 2022-06-03 17:33:14 +02:00
Mike Fährmann
345199a3ec
[pixiv] include '.gif' in background fallback URLs (#2495) 2022-06-03 17:25:23 +02:00
Mike Fährmann
57508d3bb7
[weibo] support all different 'tabtype' listings (#686, #2601) 2022-06-03 16:36:22 +02:00
Mike Fährmann
2687ef6bd9
[nozomi] remove slashes from search terms (fixes #2653) 2022-06-02 22:17:15 +02:00
Mike Fährmann
ee7cea888e
[instagram] 
it is now possible to use 'id:…' instead of a user's screen name:
- https://www.instagram.com/instagram/
- https://www.instagram.com/id:25025320/

similar to the same functionality for twitter:
a3b473bd2f675b6f07da730aacce67f3e7998a00

for /tagged/ URLs, using a user ID will only have 'tagged_owner_id'
defined. 'tagged_username' and 'tagged_full_name', which are available
when using a screen name, will not be defined.
 2022-06-02 21:49:09 +02:00
Mike Fährmann
d0dc29f312
[instagram] fix stories (#2644) 2022-06-02 13:14:19 +02:00
Mike Fährmann
2fb01938f4
[instagram] fix and update extractors (#2644) 
- use different way to fetch user IDs
- use new API endpoints for /tagged/ and single posts
 2022-06-01 22:05:45 +02:00
Mike Fährmann
05d4a0215a
[sankaku] extend URL patterns (fixes #2647) 
- support URLs with ISO 639-1 language codes
- support black.… and white.… subdomains
 2022-06-01 21:31:11 +02:00
Mike Fährmann
e0ac358aa5
[gofile] fix 401 Unauthorized errors (#2632) 2022-06-01 13:02:34 +02:00
Mike Fährmann
8a42d859bf
[bunkr] change domain to 'app.bunkr.is' (#2634) 2022-06-01 11:30:27 +02:00
Mike Fährmann
7a9cba9c10
[weibo] add support for usernames in URLs (#1662) 2022-05-31 22:48:34 +02:00
Mike Fährmann
4bf5bc2403
[weibo] support 'livephoto' entries (#2146) 2022-05-31 15:35:24 +02:00
Mike Fährmann
a0692818af
[weibo] switch to desktop API (#2601) 2022-05-31 12:46:35 +02:00
Mike Fährmann
5b43faffed
[postprocessor:metadata] write to stdout by setting filename to "-" 
(#2624)
 2022-05-30 21:17:31 +02:00
Mike Fährmann
61fa9b535a
[paheal] improve metadata extraction (#2641) 
- unescape 'tags'
- add 'date', 'source', and 'uploader' for single posts
 2022-05-30 17:23:08 +02:00
Mike Fährmann
603af48265
implement 'output.ansi' option (#2628) 2022-05-29 19:15:25 +02:00
Mike Fährmann
415c208c1f
[gfycat] cleanup 2022-05-29 15:24:23 +02:00
Mike Fährmann
a80ba17ed4
[gfycat] add 'collections' extractor (#2629) 2022-05-29 14:39:08 +02:00
Mike Fährmann
ff5e10a86d
[hypnohub] move to gelbooru_v02 instances (#2631) 2022-05-28 21:10:05 +02:00
Mike Fährmann
d6e744bf0f
[gfycat] add 'collection' extractor (#2629) 2022-05-28 16:53:27 +02:00
Mike Fährmann
4f7fe9b4be
[deviantart] fix folder listings with 'pagination: manual' 
(#2488)
 2022-05-27 18:41:06 +02:00
Mike Fährmann
7990fe84f1
support user-defined 'output.mode' settings (#2529) 
work in progress

the same output as produced by "mode": "color" can be achieved with

"output": {
    "mode": {
        "start"  : "{}",
        "success": "\r\u001b[1;32m{}\u001b[0m\n",
        "skip"   : "\u001b[2m{}\u001b[0m\n",
        "progress"      : "\r{0:>7}B {1:>7}B/s ",
        "progress-total": "\r{3:>3}% {0:>7}B {1:>7}B/s "
    }
}

to make 'output.shorten' work correctly, it is necessary to manually
specify the number of extra characters:

        "start"  : [12, "Downloading {}"]
 2022-05-27 15:03:54 +02:00
Mike Fährmann
310fee99d5
[readcomiconline] remove automatic 'browser' setting (#2625) 2022-05-27 13:44:28 +02:00
Mike Fährmann
d4e9d51760
[reddit] add 'home' extractor (#2614) 2022-05-26 15:28:33 +02:00
Mike Fährmann
b51f5fd345
fix command-line argument name of --cookies-from-browser (#1606) 2022-05-26 14:03:18 +02:00
Mike Fährmann
1d5145a280
release version 1.22.0 2022-05-25 20:30:22 +02:00
Infinitay
f54525573b
[Instagram] Add tagged_users to keywords for stories (#2582) (#2584) 2022-05-25 17:02:42 +02:00
thatfuckingbird
da0696e1f5
recognize vxtwitter URLs (#2621) 2022-05-25 17:01:58 +02:00
Mike Fährmann
dcb580240d
[twitter] extract alt texts as 'description' (closes #2617) 2022-05-24 12:37:38 +02:00
Mike Fährmann
44ffc017ea
remove useless 'tries' argument from out.success 2022-05-24 10:45:09 +02:00
Mike Fährmann
915dba8345
[twitter] improve results for regular user URLs 
- continuation of 3346f58a
- use media timeline results (or tweet timeline if retweets are enabled)
  plus search results starting from the last tweet id of the first
  timeline, similar to how Twitter Media Downloader operates
- the old behavior can be forced by appending '/tweets' to a user URL,
  like with '/media' (https://twitter.com/USER/tweets)
  although there should be no need to ever do that
 2022-05-23 18:33:52 +02:00
Mike Fährmann
6ad39f2b68
add ytdl tests 
they only run when youtube-dl or yt-dlp are installed,
i.e. if __import__("<ytdl-package>") succeeds
 2022-05-23 18:30:26 +02:00
Mike Fährmann
9df4e0f65b
[twitter] disable 'cards' by default 2022-05-21 15:39:25 +02:00
Mike Fährmann
79dce8ae68
[weasyl] implement 'metadata' option (#2610) 2022-05-20 22:32:35 +02:00