mikf/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
1,554 Commits 1 Branch 0 Tags
Commit Graph

38 Commits

Author SHA1 Message Date
Mike Fährmann
4b1880fa5e
propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
Mike Fährmann
6284731107
simplify extractor constants 
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
 2019-02-08 13:45:40 +01:00
Mike Fährmann
4d656a81ca
replace SharedConfigExtractor class with a Mixin 2019-02-04 13:46:02 +01:00
Mike Fährmann
1d43cbbf52
[gelbooru] tag-splitting for non-api mode 2018-07-06 15:24:19 +02:00
Mike Fährmann
3dbc7c5f8d
[gelbooru] restore pool functionality 2018-07-04 12:21:41 +02:00
Mike Fährmann
a2c74bc6f0
[gelbooru] inherit from BooruExtractor class 
Breaks pool functionality when using API calls (for now),
but reduces code clutter and enables the `tags` option.
 2018-07-04 12:21:41 +02:00
Mike Fährmann
4a57509392
generalize tag-splitting option (#92) 
- extend functionality to other booru sites:
  - http://behoimi.org/
  - https://konachan.com/
  - https://e621.net/
  - https://rule34.xxx/
  - https://safebooru.org/
  - https://yande.re/
 2018-07-04 12:21:16 +02:00
Mike Fährmann
87853538b4
[yandere] add option to split tags by type (#92) 2018-06-29 19:38:53 +02:00
Mike Fährmann
95392554ee
use text.urljoin() 2018-04-26 17:00:26 +02:00
Mike Fährmann
3905474805
[booru] call update_page() with correct dict (closes #82) 2018-03-19 11:33:19 +01:00
Mike Fährmann
5008e105ee
update archive IDs 
... to behave in a more straightforward way when dealing with
bookmarks/favourites/etc.

specific IDs are now grouped by their owner, album-id, ... to
allow for duplicates when it would be expected.
 2018-03-01 18:20:50 +01:00
Mike Fährmann
34873dbd90
set 'archive_fmt' values 
These are going to be used to create an unique id for each image.
 2018-02-01 15:30:49 +01:00
Mike Fährmann
974e73bdbb
[booru] smaller code adjustments 2018-01-06 17:48:49 +01:00
Mike Fährmann
9e8a84ab6c
[booru] rewrite using Mixin classes (#59) 
- improved code structure
- improved URL patterns
- better pagination to work around page limits on
  - Danbooru
  - e621
  - 3dbooru
 2018-01-04 00:01:39 +01:00
Mike Fährmann
00420ff202
[booru] consistent order for "popular" results 2017-09-06 12:33:19 +02:00
Mike Fährmann
be30fb2f98
add common config category for boorus and foolslide 2017-08-29 22:42:48 +02:00
Mike Fährmann
07214f4007
[booru] place subcategories into base classes 2017-08-26 22:27:55 +02:00
Mike Fährmann
18e6ed1c7e
[booru] add extractors for "Popular" images 2017-08-24 21:29:22 +02:00
Mike Fährmann
58e95a7487
share extractor and downloader sessions 
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
 2017-06-30 19:38:14 +02:00
Mike Fährmann
c184e47ee3
put common directory- and filename formats in base classes 2017-05-30 12:10:16 +02:00
Mike Fährmann
85a46ed700
[booru] fix issue with multiple tags 2017-05-04 11:58:51 +02:00
Mike Fährmann
ff92674379
[booru] simple skip functionality 
(#6)
 2017-03-04 23:21:55 +01:00
Mike Fährmann
94e10f249a
code adjustments according to pep8 nr2 2017-02-01 00:53:19 +01:00
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords 2016-09-25 14:22:07 +02:00
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings 2016-09-12 10:34:31 +02:00
Mike Fährmann
bb8f2a3e9d
[gelbooru] update to new format 2015-11-21 02:40:30 +01:00
Mike Fährmann
1bce63124b
[3dbooru] update to new format 2015-11-21 01:48:44 +01:00
Mike Fährmann
74199422a8
[booru] add base classes for tag/pool/post extractors 2015-11-21 00:54:29 +01:00
Mike Fährmann
80917f5392
[danbooru] rewrite to use multiple extractors 2015-11-20 20:24:15 +01:00
Mike Fährmann
c2f0720184
code cleanup to use nameext_from_url 2015-11-16 17:32:26 +01:00
Mike Fährmann
3b0fe8f544
unify booru filename-patterns 2015-11-06 16:48:33 +01:00
Mike Fährmann
76f32addf9 [booru] skip images without 'file-url' attribute 2015-10-05 20:27:27 +02:00
Mike Fährmann
539faa0322 remove SequentialExtractor class 2015-10-05 17:15:31 +02:00
Mike Fährmann
3c13548f29 rewrite extractors to use config-module 2015-10-05 15:51:08 +02:00
Mike Fährmann
42b8e81a68 rewrite extractors to use text-module 2015-10-03 15:43:02 +02:00
Mike Fährmann
a2cfbe445f add extractor '3dbooru' 2015-04-15 22:24:27 +02:00
Mike Fährmann
762ad7426a add extractor 'yandere' 2015-04-15 17:35:30 +02:00
Mike Fährmann
8c7da93d19 move and update BooruExtractor classes 2015-04-11 00:16:17 +02:00