Commit Graph

275 Commits

Author SHA1 Message Date
JayXon
854386f22f Retry request if timeout in get_content 2016-05-24 20:13:32 -07:00
NickeyKim
677040a39e add Naver support
add Naver support
2016-05-19 14:48:45 +09:00
Mort Yao
6938894337
Merge branch 'print-merged-filename' of https://github.com/zmwangx/you-get into zmwangx-print-merged-filename 2016-05-14 23:49:57 +02:00
Zhiming Wang
03a4d3cc91
common.py: Print merged filename after successful merge
Instead of just "Done.".
2016-05-12 23:56:34 -07:00
iliul
e697287b95 add support Panda.tv 2016-05-11 14:28:50 +08:00
David Zhuang
6c3828cc32 [MangGuoTV]Add support 2016-05-06 16:30:08 -04:00
Rokic
cda4d2ae89 [Pornhub] Add Support, Universal Solution
Bypass anti-spider strategies of Pornhub.
2016-04-11 22:55:18 +08:00
Mort Yao
e752181fcb
Merge branch 'develop' of https://github.com/botusun/you-get into botusun-develop 2016-04-06 20:07:16 +02:00
Mort Yao
4c012aeba4 [common] do not download captions with --player 2016-03-26 16:56:54 +01:00
Botu Sun
39ceacd8d6 fix to handle new domain of douyu.com (was douyutv.com) 2016-03-25 16:44:32 +09:00
Zhiming Wang
d02b5bb9ad
common.py: Print URL of get_content call when --debug is enabled
Use logging, and raise the root logger level from WARNING (default) to
DEBUG when --debug is enabled.

This logging facility can be extended to other functions.
2016-03-20 11:39:17 -07:00
wenLiangcan
343c410973 Add huaban.com support. 2016-03-16 00:23:28 +08:00
Mort Yao
225f18d347 [common] catch UnicodeEncodeError and instruct users to change the locale 2016-03-10 22:48:35 +01:00
Mort Yao
221fda25b3 [common] maybe_print(): fix positional arguments 2016-03-05 16:58:57 +01:00
Mort Yao
cd5cfc775f [common] maybe_print() ignores any non-printable characters (which used to cause an exception, which is not intuitive) 2016-03-05 16:18:14 +01:00
Mort Yao
35a5dac007 [infoq] add support 2016-03-05 02:26:29 +01:00
Mort Yao
fd1c63618a [letv] fix #947 2016-03-03 21:49:47 +01:00
Mort Yao
81a81b0abe [common] fix #943 2016-03-02 02:50:15 +01:00
David Zhuang
178a9a54ad Merge branch 'develop' into THVideo 2016-02-19 00:28:24 -05:00
cnbeining
051895c901 [THVideo] Add Support 2016-02-16 00:29:40 -05:00
lilydjwg
bf59adcd8b [bar] handle speed >= 1GiB/s nicely
I suppose there won't be >= 1TiB/s speed in the near future.
2016-02-10 16:42:58 +08:00
lilydjwg
af42e7cedc [bar] show "100%" instead of "100.0%" 2016-02-10 16:42:58 +08:00
lilydjwg
9fa6ef1f6f [bar] don't overflow on large files (>1G)
https://github.com/soimort/you-get/pull/898#issuecomment-180015169
2016-02-10 16:42:58 +08:00
lilydjwg
4e05b55394 Revert "Revert pull request #898"
This reverts commit 966840e22a.
2016-02-10 16:41:52 +08:00
Mort Yao
966840e22a Revert pull request #898 2016-02-04 20:29:03 +01:00
xyuanmu
9c0abc6c64 fix m5.music.126.net return 404 2016-02-04 11:48:16 +08:00
lilydjwg
3941e0d1c6 [bar] fix bar size 2016-01-24 18:46:41 +08:00
lilydjwg
af588b2f9f [bar] update bar display at the beginning
or it may not show up itself promptly, leaving the user wondering why it
doesn't start.

I met this problem with http://www.letv.com/ptv/vplay/1709438.html,
which downloads really fast, but I have to wait a few seconds before the
bar shows up.
2016-01-23 13:07:18 +08:00
lilydjwg
28d04b0ad4 [bar] dynamically calculate bar size
or it'll may be too short or too long as 'total_pieces' changes
old one has problems with http://www.letv.com/ptv/vplay/1709438.html
2016-01-23 13:06:23 +08:00
Mort Yao
f596b36ac7 [common] add new option: --no-caption 2016-01-08 16:55:14 +01:00
Mort Yao
aa724f3a57 [youku] Use fallback stream data in case of HTTP 404, fix #857 (replace and close #853) 2016-01-06 22:23:57 +01:00
Mort Yao
cfad01e464 [videomega] add support 2015-12-31 12:50:38 +01:00
Mort Yao
ef966931a3 [imgur] add support 2015-12-31 11:20:37 +01:00
Mort Yao
79d1a41804 [twitter] fix #842 2015-12-29 16:10:45 +01:00
Mort Yao
944a166c02 [common] fix urls_size (support faker and headers) 2015-12-13 04:55:50 +01:00
Mort Yao
9bb12ad115 Merge branch 'fc2' of https://github.com/cnbeining/you-get into cnbeining-fc2
- Fix #102
2015-12-13 03:56:07 +01:00
cnbeining
683a475904 [FC2Video] Add support, fix #102 ; Add custom header support on all download functions
How could this project survive without customizing Headers?

Now Able to call with

download_urls([video_url], title, ext, size, output_dir, merge=merge,
headers = fake_headers)

and everywhere where you can use Faker.
2015-12-02 20:58:08 -05:00
cnbeining
a137ac22df Add Xiaokaxiu, redo Yixia logic 2015-12-02 17:55:02 -05:00
Mort Yao
dcf59e8754 [common] do not take SystemExit wrongly 2015-11-21 05:11:58 +01:00
Mort Yao
7ce003caa3 [musicplayon] new site support (using VideoExtractor) 2015-11-11 08:26:48 +01:00
Mort Yao
f44a995366 [pinterest] new site support (using VideoExtractor) 2015-11-10 02:56:53 +01:00
Mort Yao
22b0c5c7ed [common] fix division by zero 2015-11-09 02:47:55 +00:00
cnbeining
651e472f3b [dilidili] Add support 2015-10-26 01:34:22 -04:00
Mort Yao
9875939d18 [common] option -d is short for --debug 2015-10-22 23:00:24 +02:00
cnbeining
b0128fd879 Add Interest.me (CJ E&M) support 2015-10-22 14:56:07 -04:00
Mort Yao
d80a799569 Remove support:
* Blip.tv <http://blip.tv>
* Catfun (喵星球) <http://www.catfun.tv>
* Coursera <https://www.coursera.org>
* SongTaste <http://www.songtaste.com>
* VID48 <http://vid48.com>
* VideoBam <http://videobam.com>

See #732 for details.
2015-10-22 16:58:44 +02:00
cnbeining
58b8d479ac Add Veoh support, fix #79 2015-10-22 03:19:21 -04:00
Mort Yao
f65158fe70 [common] update google_search(), fix #727 2015-10-21 22:36:11 +02:00
Mort Yao
5dd7b5fd10 [youtube] fix VEVO when no 's' field presents 2015-10-21 20:53:14 +02:00
cnbeining
901cbaaf73 Add Pixnet support, fix #129, replace #633 2015-10-21 20:33:07 +02:00
cnbeining
49549a8624 Add Yixia-Miaopai support, replace #639 2015-10-21 20:29:35 +02:00
Mort Yao
d8e2a9333b [common] add new option: --output-filename (close #425) 2015-10-21 20:28:49 +02:00
Mort Yao
f3d9c5df2b [common] improve error message, display a brief instruction to tell users what to do 2015-10-21 17:49:36 +02:00
Mort Yao
d60eafeacb redefine version (0.4.x) 2015-10-21 17:01:31 +02:00
Mort Yao
f8b0064286 [common] add google_search() 2015-10-21 15:01:10 +02:00
Mort Yao
5916c96a6e [common] url_info: more MIME types 2015-10-21 04:23:12 +02:00
Mort Yao
8eebb1a9d4 [common] print_info: more MIME types 2015-10-21 02:49:14 +02:00
Mort Yao
15c79c6f67 [common] adjust progress bar (shorten display of speed) 2015-10-21 00:46:00 +02:00
Mort Yao
febc875009 [common] "Video Site" -> "Site" 2015-10-20 03:49:32 +02:00
Mort Yao
5a26200c98 [common] add handy get_head(url) 2015-10-20 00:48:48 +02:00
Mort Yao
48182e852f [common] oops 2015-10-19 21:30:02 +02:00
Mort Yao
41c8b6f1bc [common] set the proper width of progress bar 2015-10-19 21:25:55 +02:00
Mort Yao
d1b346ed12 [common] show download speed on progress bar
- Close #178 (also requested in #284 and #700)
- Close #305
2015-10-19 15:04:15 +02:00
Mort Yao
c5d0c78cfb [universal] universal extractor and direct downloader 2015-10-19 03:50:17 +02:00
Mort Yao
02f5781486 [common] use importlib to import modules from dict SITES 2015-10-18 22:51:41 +02:00
Mort Yao
a52c50e8aa [heavymusic] new site support 2015-10-18 06:03:27 +02:00
Mort Yao
cc436fa9cc [bandcamp] new site support 2015-10-18 05:12:26 +02:00
Mort Yao
d3051f77c1 [common] beautify progress bar 2015-10-18 02:40:24 +02:00
Mort Yao
f22fd8769c [common] update download_urls_chunked() 2015-10-18 01:25:01 +02:00
Mort Yao
01729891e5 [common] download_urls: support A/V merge using ffmpeg_concat_av() 2015-10-17 21:16:00 +02:00
Mort Yao
e458c3380e update README.md 2015-10-17 14:08:22 +02:00
Mort Yao
d3c3ca34ae [common] update help message 2015-10-17 05:12:12 +02:00
Mort Yao
67a6b9bc45 [common] if it's not moz_cookies, pass 2015-10-17 04:28:32 +02:00
Mort Yao
ede432659c [common] support both cookies.txt and cookies.sqlite 2015-10-17 03:38:55 +02:00
Mort Yao
acf990fed6 [common] --cookies loads Mozilla cookies.sqlite instead of Netscape cookies.txt 2015-10-17 02:53:27 +02:00
Mort Yao
8e53ba72af Merge branch 'suntv' of https://github.com/cnbeining/you-get into cnbeining-suntv 2015-10-17 01:21:21 +02:00
Mort Yao
1994198b65 [bilibili] do not download danmaku for dry_run 2015-10-16 22:34:19 +02:00
cnbeining
f012db3e63 Add suntv support 2015-10-14 17:39:04 -04:00
Mort Yao
8fa57ef85b [flickr] new site support 2015-10-12 20:59:43 +02:00
sceext
1d7758b107 --json option now can support more extractors not using VideoExtractor 2015-09-26 18:42:26 +08:00
sceext
0c18a0873d add --json option: output video information in json text 2015-09-24 17:37:41 +08:00
Mort Yao
8985d57768 [archive] new site support 2015-09-21 10:28:59 +02:00
Mort Yao
e075433563 [common] fix infinite redirecting 2015-09-21 10:17:56 +02:00
Mort Yao
b7814f6652 [755] new site support 2015-09-21 00:24:22 +02:00
Jun Zhou
20ebd902e0 [common] fix skipping download of file existence in some cases 2015-09-14 20:14:42 -04:00
Mort Yao
b277d8d5d4 [common] divide the import of extractors into multiple lines 2015-09-12 23:38:02 +02:00
cnbeining
0fc9e207a3 Add iQilu support 2015-09-10 14:43:39 -04:00
Mort Yao
b5112da1b2 Merge branch 'cnbeining-metacafe' into develop 2015-09-08 20:02:22 +02:00
Zhang Ning
c73a636d43 support multi video in one page
add matchall api

matchall: almost same as match1, but it will return a list
of all matches.
2015-09-03 18:07:20 +08:00
Zhang Ning
b50cc2338f support embed player for youku/tudou
try sites one by one, to search video.
but not in video order.

Signed-off-by: Zhang Ning <zhangn1985@gmail.com>
2015-09-03 14:47:22 +08:00
cnbeining
f0826dd1e9 Add metacafe support 2015-09-02 15:37:50 -04:00
cnbeining
81cd814e3d Add funshion support, fix #215, replace #601, #604 2015-09-02 14:54:09 -04:00
cnbeining
01a137b002 Add Weibo Miaopai support 2015-08-23 02:14:12 -04:00
cnbeining
89c301a7cd Add support for Qianmo
http://qianmo.com/

Tested on my machine.
2015-08-20 00:45:32 -04:00
lilydjwg
a1879ff563 [netease] support for 163.fm short url
e.g. http://163.fm/LzbHaQN
2015-07-31 16:13:06 +08:00
liushuyu
c5e09fd549 Fix zhanqi
Zhanqi extractor works again...
And added ts merging implementation...

Signed-off-by: liushuyu <liushuyu_011@163.com>
2015-06-16 18:33:45 +08:00
Mort Yao
2054b89042 [twitter] add support 2015-06-15 00:04:57 +08:00
Mort Yao
29dcad4824 Merge branch 'develop' of https://github.com/daniellowtw/you-get into daniellowtw-develop 2015-05-13 23:03:15 +08:00
Zhiming Wang
4a4b6ceac0
print urls one per line instead of as a list...
when the --url option is specified.
2015-05-03 22:03:54 -07:00
D Low
acc5e90777 Add extractor for vidto 2015-04-22 21:59:03 +01:00
jackyzy823
228bb26f5b support for lizhifm 2015-04-02 10:30:31 +08:00
Mort Yao
205cc3138f Disable special conversion for non-UTF encoding.
- Windows users should take care of their code page themselves
2015-01-04 09:28:23 +01:00
pl
7afeecf4d7 support zhanqi.tv #444 2014-11-30 15:57:08 +01:00
gongqijian
f104b9987f Add support for baomihua 2014-11-07 23:26:00 +08:00
Mort Yao
8dd37070d3 Merge branch 'develop' of https://github.com/0x00-pl/you-get into 0x00-pl-develop 2014-10-31 10:39:26 +01:00
Mort Yao
1b5894df11 fix 3c9a774 to get everything works 2014-10-31 09:14:58 +01:00
cnbeining
3c9a77429c Add Letvcloud support, as in #422
Have to redo this sh*t for 3 times due to the stupidity of the damned
editor and Git. FML.
2014-10-26 23:00:19 +08:00
pl
66f8da8efc douyutv.com now can download online flv.
modified:   common.py
	modified:   extractors/douyutv.py
2014-10-25 19:46:25 +08:00
pl
8a1d7b5fa1 fix douyutv support. 2014-10-24 21:25:10 +08:00
pl
b37480100d add douyutv support. 2014-10-24 21:25:10 +08:00
lilydjwg
d24b2ca700 move parse_size to dongting.py 2014-10-17 07:09:11 +02:00
lilydjwg
a00d8a60b0 add Dongting (天天动听) support
example URL: http://www.dongting.com/?song_id=281575
2014-10-17 07:09:11 +02:00
Mort Yao
2c1d354635 support Content-Type: audio/mp4 2014-09-21 02:22:57 +02:00
Mort Yao
1952c90d10 use byte string for all when default encoding is not UTF-8 (fix #147 and close #222) 2014-09-21 02:10:05 +02:00
Mort Yao
a52cd83335 silly me 2014-09-21 01:54:43 +02:00
Mort Yao
fa1d1938d7 common: remove deprecated, unused function filenameable() 2014-09-20 23:46:21 +02:00
Mort Yao
b0a8c579b2 enable merging f4v segments 2014-09-08 23:38:11 +02:00
cnbeining
a4763fc6a2 Add VideoBam as requested in #117 2014-08-08 01:41:38 -04:00
Mort Yao
d6ec844902 Youku: fix a regression bug which caused '-y' not work 2014-07-31 22:28:30 +02:00
jackyzy823
dfd52fdd9f import tucao in common and __init__ 2014-07-31 22:30:54 +08:00
Mort Yao
61ac0da5c1 resolve a namespace conflict 2014-07-21 04:00:47 +02:00
Mort Yao
7f2f203510 fix tests 2014-07-21 03:17:30 +02:00
Mort Yao
13d40fa694 Major refactoring
* Change entry point to you_get.__main__:main
* New entry point for development (you-get-dev): you_get.__main__:main_dev
* you_get.extractor -> you_get.extractors
2014-07-21 02:39:40 +02:00
Mort Yao
c1f3340137 hotfix: unexpected keyword argument 'lang' 2014-07-21 01:37:21 +02:00
Mort Yao
fb475bf0c2 fix version again 2014-07-20 21:52:04 +02:00
Mort Yao
8a032df683 fix NameError: name get_version is not defined 2014-07-20 21:43:17 +02:00
Mort Yao
c3b56def6d remove sogou_proxy 2014-07-20 21:26:47 +02:00
Mort Yao
cebaa890f4 id -> format 2014-07-20 15:36:29 +02:00
Mort Yao
7a9855f269 Prompt for alternative audio languages, fix #369 2014-07-20 15:15:33 +02:00
Mort Yao
64f9e8e8ba YouTube: OOP style 2014-07-17 09:01:44 +02:00
Mort Yao
baf94e7593 common.py: add p_i() and p_playlist() for displaying playlists 2014-07-17 07:08:53 +02:00
Mort Yao
93f1cb8863 update common.py 2014-07-17 05:04:15 +02:00
jackyzy823
e286d91a09 refactor rtmp processor to support rtmp parameters 2014-07-15 14:24:21 +08:00
Mort Yao
95eea9f511 add option: --format 2014-06-28 18:10:29 +02:00
Mort Yao
12dd63c310 prepare() with extractor_proxy 2014-06-28 16:01:34 +02:00
Mort Yao
78f5e1b6b1 Youku: fix #352 2014-06-28 13:22:50 +02:00
Mort Yao
5dbeb09daa cleanup after download or info_only 2014-06-24 12:49:04 +02:00
Mort Yao
1411c8986e Youku: fix #331, refactoring 2014-06-24 03:59:47 +02:00
Mort Yao
6dd119436b add play_rtmpdump_stream() 2014-05-22 14:21:17 +02:00
Mort Yao
94b99128a5 show real URL of RTMP stream, fix #329 2014-05-22 14:04:22 +02:00
Mort Yao
6eced06b11 show real URL of RTMP stream 2014-05-22 13:56:40 +02:00
lilydjwg
25ab7a8428 better HTML unescaping in filenames 2014-05-21 02:21:44 +02:00
lilydjwg
cd5040b617 let's replace old unescape_html 2014-04-11 19:58:55 +08:00
lilydjwg
2bca2e771c better unescape, also unescape in xiami lyrics filename 2014-04-11 19:58:55 +08:00
lilydjwg
36f7cf798f unescape HTML entities in media titles 2014-04-11 19:58:55 +08:00
HU Pili
d59532b387 add global variable cookies_txt
Test case does not enter via script_main.
Without this definition test cases will fail,
although the new feature works correctly.
2014-03-29 21:42:34 +08:00
HU Pili
95cd795241 Support load cookies.txt 2014-03-28 14:02:50 +08:00
lilydjwg
3f21a0672d avoid zombie git process 2014-03-07 21:12:32 +08:00
Mort Yao
0f38ed615d Update README to reflect merge of #286 2014-02-08 04:13:29 +01:00
liuerfire
afdf7d2587 fix decode bug 2014-01-05 02:29:50 +08:00