Mike Fährmann
915a0137de
improve 'extractor.request'
...
- add 'fatal' argument
- improve internal logic and flow
- raise known exception on error
- update exception hierarchy
2017-08-05 16:11:46 +02:00
Mike Fährmann
7aa9fa796a
code cleanup and fixes
2017-07-25 14:59:41 +02:00
Mike Fährmann
55f048d02b
ignore case of cookiejar magic strings
2017-07-24 18:33:42 +02:00
Mike Fährmann
808f67ba7d
use 'cookiedomain' for cookies set by object-config-values
...
otherwise these cookies would not be picked up by the
_check_cookies() method.
2017-07-22 15:43:35 +02:00
Mike Fährmann
0610ae5000
skip login if cookies are present
2017-07-17 10:33:36 +02:00
Mike Fährmann
726c6f01ae
allow 'cookies' config option to be a dictionary
2017-07-07 18:01:46 +02:00
Mike Fährmann
a804a42e23
add '--cookies' command-line option
2017-07-03 15:02:19 +02:00
Mike Fährmann
d3b04076f7
add .netrc support ( #22 )
...
Use the '--netrc' cmdline option or set the 'netrc' config option
to 'true' to enable the use of .netrc authentication data.
The 'machine' names for the .netrc info are the lowercase extractor
names (or categories): batoto, exhentai, nijie, pixiv, seiga.
2017-06-24 12:17:26 +02:00
Mike Fährmann
c184e47ee3
put common directory- and filename formats in base classes
2017-05-30 12:10:16 +02:00
Mike Fährmann
f226417420
simplify code by using a MangaExtractor base class
2017-05-20 11:27:43 +02:00
Mike Fährmann
4b967fa189
implement and use extractor.config() method
2017-04-25 17:12:48 +02:00
Mike Fährmann
f782282f97
add logger objects to extractors
2017-03-07 23:50:19 +01:00
Mike Fährmann
7a9d66fbce
implement basic way to tell extractors to skip ahead
2017-03-03 17:26:50 +01:00
Mike Fährmann
0b59d9f8c7
disable urllib3s InsecureConnectionWarning
2017-02-11 21:21:57 +01:00
Mike Fährmann
37d4d07d9b
compatibility fixes to make a standalone exe work
2017-01-23 00:07:36 +01:00
Mike Fährmann
cc0b4f2661
[yomanga] add chapter extractor
2017-01-13 00:03:12 +01:00
Mike Fährmann
ad4b02508f
trying to understand travis-ci unit test failures
...
- added some debug output via logging module
- unit tests work on my machine (tm)
2017-01-12 22:35:42 +01:00
Mike Fährmann
e6d26f0476
don't overwrite a response's encoding with None
2016-10-30 20:38:22 +01:00
Mike Fährmann
f0f7306db6
re-raise async exceptions in main thread
2016-07-24 22:16:59 +02:00
Mike Fährmann
000df8d1fa
add 'encoding' argument for Extractor.request
2016-07-12 12:06:17 +02:00
Mike Fährmann
81dcfbec90
initial support for extractor-subcategories
2015-11-30 00:30:02 +01:00
Mike Fährmann
1497da07de
remove unused format-strings
2015-11-29 23:41:43 +01:00
Mike Fährmann
3fb5a8b834
delay 'requests'-import
2015-11-24 19:47:51 +01:00
Mike Fährmann
539faa0322
remove SequentialExtractor class
2015-10-05 17:15:31 +02:00
Mike Fährmann
3c13548f29
rewrite extractors to use config-module
2015-10-05 15:51:08 +02:00
Mike Fährmann
42b8e81a68
rewrite extractors to use text-module
2015-10-03 15:43:02 +02:00
Mike Fährmann
5806e02f97
better support for KeyboardInterrupt exceptions
2015-04-10 17:31:49 +02:00
Mike Fährmann
1cd25b5369
[pixiv] update to new extractor interface
2015-04-10 15:29:09 +02:00
Mike Fährmann
cd4a699dd2
add 'Headers' and 'Cookies' message
2015-04-08 19:06:50 +02:00
Mike Fährmann
513808d156
move code from util.py
2015-04-08 01:46:04 +02:00
Mike Fährmann
41f00809ff
update extractor base classes
2015-04-08 01:43:25 +02:00
Mike Fährmann
deef91eddc
initial commit
2014-10-12 21:56:44 +02:00
