18 Commits

Author SHA1 Message Date
Mike Fährmann
42b9633c7e
update test results 2019-11-26 23:27:15 +01:00
Mike Fährmann
d45fabb79d
match user profile handling on deviantart and newgrounds 2019-11-22 23:20:21 +01:00
Mike Fährmann
b1f0609de5
[newgrounds] rewrite (#394)
- restructure extractor hierarchy
- extract more metadata
- extract videos without youtube-dl
- be more resilient to errors

TODO:
- favorites
- games, but that might be near impossible for non-flash titles
2019-11-18 21:13:33 +01:00
Mike Fährmann
3ece3976ae
[newgrounds] implement login support (#394) 2019-11-16 23:45:32 +01:00
Mike Fährmann
3a07c06865
[newgrounds] update
- create directory per post
- rename variables and methods
2019-11-14 23:17:14 +01:00
Mike Fährmann
a732e9c430
[instagram] update query hashes and headers 2019-08-10 14:13:08 +02:00
Mike Fährmann
1133b7fcbd
[smugmug] update unit tests
The account used for tests before has been deleted.
2019-07-19 17:16:24 +02:00
Mike Fährmann
04b8d0894a
[newgrounds] improve metadata extraction 2019-07-08 17:53:55 +02:00
Mike Fährmann
b89f0d8d3c
update extractor result tests 2019-07-01 20:02:47 +02:00
Mike Fährmann
74c7304c6b
[newgrounds] extract 'date', 'favorites', and 'score' 2019-05-08 18:09:17 +02:00
Mike Fährmann
5530871b5a
change results of text.nameext_from_url()
Instead of getting a complete 'filename' from an URL and splitting that
into 'name' and 'extension', the new approach gets rid of the complete
version and renames 'name' to 'filename'. (Using anything other than
{extension} for a filename extension doesn't really work anyway)

Example: "https://example.org/path/filename.ext"

before:
- filename : filename.ext
- name     : filename
- extension: ext

now:
- filename : filename
- extension: ext
2019-02-14 16:07:17 +01:00
Mike Fährmann
4b1880fa5e
propagate 'match' to base extractor constructor 2019-02-11 13:31:10 +01:00
Mike Fährmann
6284731107
simplify extractor constants
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
2019-02-08 13:45:40 +01:00
Mike Fährmann
a50e9faf0e
[newgrounds] recognize direct links 2019-01-25 16:35:12 +01:00
Mike Fährmann
66460337f1
[mangapark] fix extraction 2019-01-17 21:24:53 +01:00
Mike Fährmann
2fbf072723
[newgrounds] ensure consistent tag order
... plus some code restructuring
2019-01-14 16:14:19 +01:00
Mike Fährmann
98314aa04c
[mangapark] detect non-existent chapters 2018-12-27 21:41:50 +01:00
Mike Fährmann
ba56827f36
[newgrounds] add user-, video-, image-extractors (#119) 2018-11-27 15:44:53 +01:00