Commit Graph

649 Commits

Author SHA1 Message Date
henryptung
79fd1255cb Encoding handling fixes:
1. Introduce string.safe_chars, safe_print as ways to ensure that a
string is encodable using the specified encoding.  Unsafe characters
are replaced with '?'.  safe_print delegates to print and satisfies
the same interface, so it can be used as a drop-in override for print
in any file.

2. Move get_filename to fs, since that's where it belongs (fs-related
filename handling).  Move appending of ID, part number, and extension
(when applicable) to get_filename, to avoid accidental truncation.

3. Remove common.tr, since the print override supercedes it.

4. Refactor of log module to work with changes (use print with different
files instead of direct writes to stdout, stderr).

5. Modify other files to accommodate the changes (remove calls to tr)

6. Random cleanup I found:

a. Some changes to impl of download_urls, download_urls_chunked (is this
one even used?)).
b. sina_download_by_id?
c. ffmpeg_convert_ts_to_mkv tries to convert multiple input files onto
the same output file, overwriting its own output each time?
d. @staticmethod annotations (IDE sads otherwise).

7. Tests for the new encoding handling.
2015-01-10 22:13:09 -08:00
Mort Yao
1b55b01b04 Tudou: improve regex 2015-01-05 01:02:41 +01:00
Mort Yao
205cc3138f Disable special conversion for non-UTF encoding.
- Windows users should take care of their code page themselves
2015-01-04 09:28:23 +01:00
Mort Yao
ef16e74fe7 Tudou: fix #460 2014-12-20 03:08:40 +01:00
Mort Yao
cbf0a6afcc Merge branch 'develop' of https://github.com/merlinran/you-get into merlinran-develop 2014-12-11 21:51:19 +01:00
Mort Yao
ded684f58a version 0.3.32 2014-12-10 04:04:25 +01:00
Merlin Ran
08a9e73406 force override when concat files 2014-12-08 21:35:46 +08:00
Mort Yao
245a00e4c8 Merge branch 'merlinran-patch-1' into develop 2014-12-04 06:47:22 +01:00
Merlin Ran
cc03d86909 open concat list file with 'encoding="utf-8"'
To prevent error when video file name contains non-ascii characters.
2014-12-04 10:24:53 +08:00
Mort Yao
235b5a014d README.md: remove byte order mark <U+FEFF> 2014-11-30 16:06:30 +01:00
pl
7afeecf4d7 support zhanqi.tv #444 2014-11-30 15:57:08 +01:00
pl
810535a64b modified: src/you_get/extractors/douyutv.py
switch to newer common functions.
2014-11-30 15:57:07 +01:00
Mort Yao
204b11017b Merge branch 'Snise-patch-1' into develop 2014-11-30 15:44:05 +01:00
Snise
2e79912c4c Update douyutv.py 2014-11-30 15:43:32 +01:00
Mort Yao
f421fe83a3 Vine: minor fix 2014-11-28 14:53:44 +01:00
Mort Yao
4e972e75ea Makefile: remove bdist_wheel from target install 2014-11-19 21:51:19 +01:00
Mort Yao
a5a28c1d7a Youku: match vid more precisely (underscores excluded) 2014-11-13 21:21:07 +01:00
Mort Yao
153d8649ca Merge branch 'twlz0ne-add-support-for-baomihua' into develop 2014-11-11 22:38:47 +01:00
Mort Yao
0932b51acf update README 2014-11-11 22:38:09 +01:00
gongqijian
f104b9987f Add support for baomihua 2014-11-07 23:26:00 +08:00
Mort Yao
ca21abd3e3 Merge branch 'twlz0ne-fix_tumblr-video-download-error' into develop 2014-11-07 09:46:11 +01:00
gongqijian
67a7f3b67c Tumblr: video download error 2014-11-07 16:11:05 +08:00
Mort Yao
fe9c6d8898 Tudou: fix #433 2014-11-04 11:16:23 +01:00
Mort Yao
0e32fe7c6d Merge branch 'develop' of https://github.com/0x00-pl/you-get into 0x00-pl-develop 2014-11-03 20:19:03 +01:00
pl
b1ee95517b douyutv.com tittle fix. 2014-11-04 02:10:48 +08:00
Mort Yao
ea60299d71 update README: Windows support 2014-11-02 10:16:25 +01:00
Mort Yao
b2254a68b8 version 0.3.31 2014-11-01 17:28:31 +01:00
Mort Yao
45c0b5a078 update README: add Dongting 2014-11-01 17:22:23 +01:00
Mort Yao
1c91ffe486 Merge branch 'develop' of https://github.com/abcfy2/you-get into abcfy2-develop 2014-11-01 15:18:22 +01:00
Mort Yao
24c1db411f NetEase: more fix for #428 2014-11-01 14:13:42 +01:00
Mort Yao
990b673ac7 update README: add DouyuTV 2014-11-01 12:20:39 +01:00
Mort Yao
8dd37070d3 Merge branch 'develop' of https://github.com/0x00-pl/you-get into 0x00-pl-develop 2014-10-31 10:39:26 +01:00
Mort Yao
e2cba21ad9 NetEase: fix #428 2014-10-31 10:21:30 +01:00
Mort Yao
9466981f4f AcFun: fix #422 2014-10-31 10:09:12 +01:00
Mort Yao
a5eff0ec88 remove unused _letvcloud.py 2014-10-31 09:16:30 +01:00
Mort Yao
1b5894df11 fix 3c9a774 to get everything works 2014-10-31 09:14:58 +01:00
cnbeining
3c9a77429c Add Letvcloud support, as in #422
Have to redo this sh*t for 3 times due to the stupidity of the damned
editor and Git. FML.
2014-10-26 23:00:19 +08:00
pl
c09238fe8a modified: extractors/bilibili.py 2014-10-25 21:08:28 +08:00
pl
66f8da8efc douyutv.com now can download online flv.
modified:   common.py
	modified:   extractors/douyutv.py
2014-10-25 19:46:25 +08:00
pl
1efb88c8c8 support live.bilibili.com 2014-10-24 21:25:10 +08:00
pl
c88cfe0734 fix douyutv title regex 2014-10-24 21:25:10 +08:00
pl
8a1d7b5fa1 fix douyutv support. 2014-10-24 21:25:10 +08:00
pl
2d76cc208c fix douyutv support. 2014-10-24 21:25:10 +08:00
pl
b37480100d add douyutv support. 2014-10-24 21:25:10 +08:00
Mort Yao
b84831c8e5 Merge branch lilydjwg-develop into develop (close #407) 2014-10-17 07:11:41 +02:00
lilydjwg
d24b2ca700 move parse_size to dongting.py 2014-10-17 07:09:11 +02:00
lilydjwg
a00d8a60b0 add Dongting (天天动听) support
example URL: http://www.dongting.com/?song_id=281575
2014-10-17 07:09:11 +02:00
Mort Yao
861e3af351 bilibili: fix more 2014-10-05 21:57:53 +02:00
Mort Yao
ef71427891 Merge branch 'zguangyu0000-bilibili_new' into develop 2014-10-05 21:55:04 +02:00
Guangyu Zhang
cbc2f2fe32 regex support new Bilibili web page 2014-10-05 17:45:16 +08:00