PublicMirrors/you-get
1
0
Fork 0
mirror of https://github.com/soimort/you-get.git synced 2025-02-03 16:53:56 +03:00
Code Issues Actions Packages Projects Releases 1 Wiki Activity
2,285 Commits 4 Branches 165 Tags 6.6 MiB
bd06317fcc
Commit Graph

311 Commits

Author SHA1 Message Date
MaxwellGoblin
86493087d4 [common.py] switch to gnu_getopt 2017-03-06 10:43:35 +08:00
Mort Yao
96398d8f6c
[common] revert #1644 (per #1728) 2017-03-05 23:58:00 +01:00
Mort Yao
8bddd170f3
[common] fix non-ascii url issues, close #1728 (per #1644) 2017-03-05 10:57:55 +01:00
MaxwellGoblin
fa9c51dfea add support for ximalaya.py 2017-03-01 04:04:36 +08:00
Zhiming Wang
37dbb4a3ce
[common] print user agent when dumping URLs (-u, --url) 
Certain sites (known example: tudou.com) deny access to video URLs unless user
agent matches the one used when retrieving URLs from the API, effectively
rendering the URLs useless without the proper user agent. Therefore, exposing
the user agent in -u, --url output could come in handy at times.

This commit does not affect --json output.
 2017-02-27 00:51:16 -05:00
Zhiming Wang
1997ea45ce
[common] log URLs in more functions with network requests 
This is a follow-up to #999.

This commit adds the

    <function_name>: <url>

debug message, which was previously only emitted by get_content and
post_content, to all high level utility functions with network requests
except url_size, url_save and url_save_chunked (in order not to ruin
progress bars).
 2017-02-10 11:47:24 -05:00
Mort Yao
8afb998d59
Remove dead sites (2017-02-01) 
* JPopsuki TV http://www.jpopsuki.tv/
* 天天动听 http://www.dongting.com/
* THVideo http://thvideo.tv/
* 阡陌视频 http://qianmo.com/
 2017-02-01 23:39:46 +01:00
Mort Yao
7e2d84dbed
Merge branch 'develop' of https://github.com/hjk41/you-get into hjk41-develop 2017-01-27 22:13:18 +01:00
Mort Yao
f299d30161
[common] update fake_headers 2017-01-25 21:21:49 +01:00
Chuntao Hong
61225b1552 fix non-ascii url 2017-01-24 12:36:57 +08:00
JayXon
374e1032db [common] also retry if timeout in url_save, post_content, etc. 2017-01-16 09:56:24 -08:00
Mort Yao
ecdcf5dcf8
Merge branch 'Yizhibo-support' of https://github.com/Erk-/you-get into Erk--Yizhibo-support 2017-01-06 15:06:02 +01:00
Valdemar Erk
60b6834e54 Quanmin support. 2017-01-03 23:58:56 +01:00
Valdemar Erk
44e60c3e21 Initial support for yizhibo.com 2016-12-10 12:23:35 +01:00
Mort Yao
474f4d724a
[common] pass valid filename in download_url_ffmpeg 2016-12-03 17:40:29 +01:00
Mort Yao
538f1796f2
[universal] workaround for websites that block HEAD requests 2016-11-26 17:09:28 +01:00
Yohohaha
fe2720544a fix syntax error 2016-11-25 20:03:38 +08:00
Yohohaha
c44a7ec1b9 Merge pull request #1 from soimort/develop 
Project Updatding
 2016-11-25 19:16:16 +08:00
Mort Yao
79bb217c4b
Merge branch 'icourses' of https://github.com/liushuyu/you-get into liushuyu-icourses 2016-11-03 16:58:00 +01:00
liushuyu
ae4e533ec9
common: add dynamic url support for url_save_chunked 2016-10-25 14:26:38 -06:00
liushuyu
4bbafeb9e4
icourse: add supprt 2016-10-24 20:09:58 -06:00
Mort Yao
4561be553c
Merge branch 'fix-baidu-support' of https://github.com/liushuyu/you-get into liushuyu-fix-baidu-support 2016-10-21 17:46:08 +02:00
liushuyu
78fa116131
Add POST method to common.py 2016-10-20 22:35:21 -06:00
Cheng Gu
95a8d1e8af [huomaotv] add huomao.com suppport 2016-10-20 14:31:03 +08:00
zhangchao
8674f43c36 fix bug about renaming videos when downloading with ffmpeg 2016-09-27 23:04:01 +08:00
H.G
2baeed762a [universal] fix issue: "flush" is not available in Python under 3.3 2016-09-05 10:50:58 +12:00
David Zhuang
e60981f91e [Wanmen]Add support 2016-08-24 23:12:06 -04:00
Mort Yao
3a8ce8819d
[ffmpeg] remove unuseful ffmpeg_play_stream(), fix #1336 2016-08-14 03:52:02 +02:00
David Zhuang
d0215aa238 [Bigthink]Add Bigthink 2016-08-01 05:39:38 -04:00
Chuntao Hong
fdb1809455 fix socks DNS resolve issue 2016-07-20 15:26:25 +08:00
David Zhuang
5a99b2f42f [Showroom] Add support via HLS M3U 2016-07-01 01:07:32 -04:00
Mort Yao
2fdea30d8d
Merge branch 'ffmpeg-live' of https://github.com/cnbeining/you-get into cnbeining-ffmpeg-live 2016-07-01 06:40:44 +02:00
David Zhuang
62a9e35ed0 [CNTV] Fix CCAV domain, Add pattern, fix #1193 ,#909 , replace #1031 2016-06-30 02:36:07 -04:00
David Zhuang
5966a090f4 [Common, ffmpeg]Exp: Add a ffmpeg downloader and player for any URL 2016-06-29 15:56:39 -04:00
Chuntao Hong
d370e9952f enable --socks-proxy 2016-06-28 16:44:54 +08:00
JayXon
48640e279f Add -t and --timeout option 
To set socket timeout, default is 600 seconds.
 2016-05-24 20:58:28 -07:00
JayXon
854386f22f Retry request if timeout in get_content 2016-05-24 20:13:32 -07:00
NickeyKim
677040a39e add Naver support 
add Naver support
 2016-05-19 14:48:45 +09:00
Mort Yao
6938894337
Merge branch 'print-merged-filename' of https://github.com/zmwangx/you-get into zmwangx-print-merged-filename 2016-05-14 23:49:57 +02:00
Zhiming Wang
03a4d3cc91
common.py: Print merged filename after successful merge 
Instead of just "Done.".
 2016-05-12 23:56:34 -07:00
iliul
e697287b95 add support Panda.tv 2016-05-11 14:28:50 +08:00
David Zhuang
6c3828cc32 [MangGuoTV]Add support 2016-05-06 16:30:08 -04:00
Rokic
cda4d2ae89 [Pornhub] Add Support, Universal Solution 
Bypass anti-spider strategies of Pornhub.
 2016-04-11 22:55:18 +08:00
Mort Yao
e752181fcb
Merge branch 'develop' of https://github.com/botusun/you-get into botusun-develop 2016-04-06 20:07:16 +02:00
Mort Yao
4c012aeba4 [common] do not download captions with --player 2016-03-26 16:56:54 +01:00
Botu Sun
39ceacd8d6 fix to handle new domain of douyu.com (was douyutv.com) 2016-03-25 16:44:32 +09:00
Zhiming Wang
d02b5bb9ad
common.py: Print URL of get_content call when --debug is enabled 
Use logging, and raise the root logger level from WARNING (default) to
DEBUG when --debug is enabled.

This logging facility can be extended to other functions.
 2016-03-20 11:39:17 -07:00
wenLiangcan
343c410973 Add huaban.com support. 2016-03-16 00:23:28 +08:00
Mort Yao
225f18d347 [common] catch UnicodeEncodeError and instruct users to change the locale 2016-03-10 22:48:35 +01:00
Mort Yao
221fda25b3 [common] maybe_print(): fix positional arguments 2016-03-05 16:58:57 +01:00
Mort Yao
cd5cfc775f [common] maybe_print() ignores any non-printable characters (which used to cause an exception, which is not intuitive) 2016-03-05 16:18:14 +01:00
Mort Yao
35a5dac007 [infoq] add support 2016-03-05 02:26:29 +01:00
Mort Yao
fd1c63618a [letv] fix #947 2016-03-03 21:49:47 +01:00
Mort Yao
81a81b0abe [common] fix #943 2016-03-02 02:50:15 +01:00
David Zhuang
178a9a54ad Merge branch 'develop' into THVideo 2016-02-19 00:28:24 -05:00
cnbeining
051895c901 [THVideo] Add Support 2016-02-16 00:29:40 -05:00
lilydjwg
bf59adcd8b [bar] handle speed >= 1GiB/s nicely 
I suppose there won't be >= 1TiB/s speed in the near future.
 2016-02-10 16:42:58 +08:00
lilydjwg
af42e7cedc [bar] show "100%" instead of "100.0%" 2016-02-10 16:42:58 +08:00
lilydjwg
9fa6ef1f6f [bar] don't overflow on large files (>1G) 
https://github.com/soimort/you-get/pull/898#issuecomment-180015169
 2016-02-10 16:42:58 +08:00
lilydjwg
4e05b55394 Revert "Revert pull request #898" 
This reverts commit 966840e22a.
 2016-02-10 16:41:52 +08:00
Mort Yao
966840e22a Revert pull request #898 2016-02-04 20:29:03 +01:00
xyuanmu
9c0abc6c64 fix m5.music.126.net return 404 2016-02-04 11:48:16 +08:00
lilydjwg
3941e0d1c6 [bar] fix bar size 2016-01-24 18:46:41 +08:00
lilydjwg
af588b2f9f [bar] update bar display at the beginning 
or it may not show up itself promptly, leaving the user wondering why it
doesn't start.

I met this problem with http://www.letv.com/ptv/vplay/1709438.html,
which downloads really fast, but I have to wait a few seconds before the
bar shows up.
 2016-01-23 13:07:18 +08:00
lilydjwg
28d04b0ad4 [bar] dynamically calculate bar size 
or it'll may be too short or too long as 'total_pieces' changes
old one has problems with http://www.letv.com/ptv/vplay/1709438.html
 2016-01-23 13:06:23 +08:00
Mort Yao
f596b36ac7 [common] add new option: --no-caption 2016-01-08 16:55:14 +01:00
Mort Yao
aa724f3a57 [youku] Use fallback stream data in case of HTTP 404, fix #857 (replace and close #853) 2016-01-06 22:23:57 +01:00
Mort Yao
cfad01e464 [videomega] add support 2015-12-31 12:50:38 +01:00
Mort Yao
ef966931a3 [imgur] add support 2015-12-31 11:20:37 +01:00
Mort Yao
79d1a41804 [twitter] fix #842 2015-12-29 16:10:45 +01:00
Mort Yao
944a166c02 [common] fix urls_size (support faker and headers) 2015-12-13 04:55:50 +01:00
Mort Yao
9bb12ad115 Merge branch 'fc2' of https://github.com/cnbeining/you-get into cnbeining-fc2 
- Fix #102
 2015-12-13 03:56:07 +01:00
cnbeining
683a475904 [FC2Video] Add support, fix #102 ; Add custom header support on all download functions 
How could this project survive without customizing Headers?

Now Able to call with

download_urls([video_url], title, ext, size, output_dir, merge=merge,
headers = fake_headers)

and everywhere where you can use Faker.
 2015-12-02 20:58:08 -05:00
cnbeining
a137ac22df Add Xiaokaxiu, redo Yixia logic 2015-12-02 17:55:02 -05:00
Mort Yao
dcf59e8754 [common] do not take SystemExit wrongly 2015-11-21 05:11:58 +01:00
Mort Yao
7ce003caa3 [musicplayon] new site support (using VideoExtractor) 2015-11-11 08:26:48 +01:00
Mort Yao
f44a995366 [pinterest] new site support (using VideoExtractor) 2015-11-10 02:56:53 +01:00
Mort Yao
22b0c5c7ed [common] fix division by zero 2015-11-09 02:47:55 +00:00
cnbeining
651e472f3b [dilidili] Add support 2015-10-26 01:34:22 -04:00
Mort Yao
9875939d18 [common] option -d is short for --debug 2015-10-22 23:00:24 +02:00
cnbeining
b0128fd879 Add Interest.me (CJ E&M) support 2015-10-22 14:56:07 -04:00
Mort Yao
d80a799569 Remove support: 
* Blip.tv <http://blip.tv>
* Catfun (喵星球) <http://www.catfun.tv>
* Coursera <https://www.coursera.org>
* SongTaste <http://www.songtaste.com>
* VID48 <http://vid48.com>
* VideoBam <http://videobam.com>

See #732 for details.
 2015-10-22 16:58:44 +02:00
cnbeining
58b8d479ac Add Veoh support, fix #79 2015-10-22 03:19:21 -04:00
Mort Yao
f65158fe70 [common] update google_search(), fix #727 2015-10-21 22:36:11 +02:00
Mort Yao
5dd7b5fd10 [youtube] fix VEVO when no 's' field presents 2015-10-21 20:53:14 +02:00
cnbeining
901cbaaf73 Add Pixnet support, fix #129, replace #633 2015-10-21 20:33:07 +02:00
cnbeining
49549a8624 Add Yixia-Miaopai support, replace #639 2015-10-21 20:29:35 +02:00
Mort Yao
d8e2a9333b [common] add new option: --output-filename (close #425) 2015-10-21 20:28:49 +02:00
Mort Yao
f3d9c5df2b [common] improve error message, display a brief instruction to tell users what to do 2015-10-21 17:49:36 +02:00
Mort Yao
d60eafeacb redefine version (0.4.x) 2015-10-21 17:01:31 +02:00
Mort Yao
f8b0064286 [common] add google_search() 2015-10-21 15:01:10 +02:00
Mort Yao
5916c96a6e [common] url_info: more MIME types 2015-10-21 04:23:12 +02:00
Mort Yao
8eebb1a9d4 [common] print_info: more MIME types 2015-10-21 02:49:14 +02:00
Mort Yao
15c79c6f67 [common] adjust progress bar (shorten display of speed) 2015-10-21 00:46:00 +02:00
Mort Yao
febc875009 [common] "Video Site" -> "Site" 2015-10-20 03:49:32 +02:00
Mort Yao
5a26200c98 [common] add handy get_head(url) 2015-10-20 00:48:48 +02:00
Mort Yao
48182e852f [common] oops 2015-10-19 21:30:02 +02:00
Mort Yao
41c8b6f1bc [common] set the proper width of progress bar 2015-10-19 21:25:55 +02:00
Mort Yao
d1b346ed12 [common] show download speed on progress bar 
- Close #178 (also requested in #284 and #700)
- Close #305
 2015-10-19 15:04:15 +02:00
Mort Yao
c5d0c78cfb [universal] universal extractor and direct downloader 2015-10-19 03:50:17 +02:00
Mort Yao
02f5781486 [common] use importlib to import modules from dict SITES 2015-10-18 22:51:41 +02:00
Mort Yao
a52c50e8aa [heavymusic] new site support 2015-10-18 06:03:27 +02:00
Mort Yao
cc436fa9cc [bandcamp] new site support 2015-10-18 05:12:26 +02:00
Mort Yao
d3051f77c1 [common] beautify progress bar 2015-10-18 02:40:24 +02:00
Mort Yao
f22fd8769c [common] update download_urls_chunked() 2015-10-18 01:25:01 +02:00
Mort Yao
01729891e5 [common] download_urls: support A/V merge using ffmpeg_concat_av() 2015-10-17 21:16:00 +02:00
Mort Yao
e458c3380e update README.md 2015-10-17 14:08:22 +02:00
Mort Yao
d3c3ca34ae [common] update help message 2015-10-17 05:12:12 +02:00
Mort Yao
67a6b9bc45 [common] if it's not moz_cookies, pass 2015-10-17 04:28:32 +02:00
Mort Yao
ede432659c [common] support both cookies.txt and cookies.sqlite 2015-10-17 03:38:55 +02:00
Mort Yao
acf990fed6 [common] --cookies loads Mozilla cookies.sqlite instead of Netscape cookies.txt 2015-10-17 02:53:27 +02:00
Mort Yao
8e53ba72af Merge branch 'suntv' of https://github.com/cnbeining/you-get into cnbeining-suntv 2015-10-17 01:21:21 +02:00
Mort Yao
1994198b65 [bilibili] do not download danmaku for dry_run 2015-10-16 22:34:19 +02:00
cnbeining
f012db3e63 Add suntv support 2015-10-14 17:39:04 -04:00
Mort Yao
8fa57ef85b [flickr] new site support 2015-10-12 20:59:43 +02:00
sceext
1d7758b107 --json option now can support more extractors not using VideoExtractor 2015-09-26 18:42:26 +08:00
sceext
0c18a0873d add --json option: output video information in json text 2015-09-24 17:37:41 +08:00
Mort Yao
8985d57768 [archive] new site support 2015-09-21 10:28:59 +02:00
Mort Yao
e075433563 [common] fix infinite redirecting 2015-09-21 10:17:56 +02:00
Mort Yao
b7814f6652 [755] new site support 2015-09-21 00:24:22 +02:00
Jun Zhou
20ebd902e0 [common] fix skipping download of file existence in some cases 2015-09-14 20:14:42 -04:00
Mort Yao
b277d8d5d4 [common] divide the import of extractors into multiple lines 2015-09-12 23:38:02 +02:00
cnbeining
0fc9e207a3 Add iQilu support 2015-09-10 14:43:39 -04:00
Mort Yao
b5112da1b2 Merge branch 'cnbeining-metacafe' into develop 2015-09-08 20:02:22 +02:00
Zhang Ning
c73a636d43 support multi video in one page 
add matchall api

matchall: almost same as match1, but it will return a list
of all matches.
 2015-09-03 18:07:20 +08:00
Zhang Ning
b50cc2338f support embed player for youku/tudou 
try sites one by one, to search video.
but not in video order.

Signed-off-by: Zhang Ning <zhangn1985@gmail.com>
 2015-09-03 14:47:22 +08:00
cnbeining
f0826dd1e9 Add metacafe support 2015-09-02 15:37:50 -04:00
cnbeining
81cd814e3d Add funshion support, fix #215, replace #601, #604 2015-09-02 14:54:09 -04:00
cnbeining
01a137b002 Add Weibo Miaopai support 2015-08-23 02:14:12 -04:00
cnbeining
89c301a7cd Add support for Qianmo 
http://qianmo.com/

Tested on my machine.
 2015-08-20 00:45:32 -04:00
lilydjwg
a1879ff563 [netease] support for 163.fm short url 
e.g. http://163.fm/LzbHaQN
 2015-07-31 16:13:06 +08:00
liushuyu
c5e09fd549 Fix zhanqi 
Zhanqi extractor works again...
And added ts merging implementation...

Signed-off-by: liushuyu <liushuyu_011@163.com>
 2015-06-16 18:33:45 +08:00
Mort Yao
2054b89042 [twitter] add support 2015-06-15 00:04:57 +08:00
Mort Yao
29dcad4824 Merge branch 'develop' of https://github.com/daniellowtw/you-get into daniellowtw-develop 2015-05-13 23:03:15 +08:00
Zhiming Wang
4a4b6ceac0
print urls one per line instead of as a list... 
when the --url option is specified.
 2015-05-03 22:03:54 -07:00
D Low
acc5e90777 Add extractor for vidto 2015-04-22 21:59:03 +01:00
jackyzy823
228bb26f5b support for lizhifm 2015-04-02 10:30:31 +08:00
Mort Yao
205cc3138f Disable special conversion for non-UTF encoding. 
- Windows users should take care of their code page themselves
 2015-01-04 09:28:23 +01:00
pl
7afeecf4d7 support zhanqi.tv #444 2014-11-30 15:57:08 +01:00
gongqijian
f104b9987f Add support for baomihua 2014-11-07 23:26:00 +08:00
Mort Yao
8dd37070d3 Merge branch 'develop' of https://github.com/0x00-pl/you-get into 0x00-pl-develop 2014-10-31 10:39:26 +01:00
Mort Yao
1b5894df11 fix 3c9a774 to get everything works 2014-10-31 09:14:58 +01:00
cnbeining
3c9a77429c Add Letvcloud support, as in #422 
Have to redo this sh*t for 3 times due to the stupidity of the damned
editor and Git. FML.
 2014-10-26 23:00:19 +08:00
pl
66f8da8efc douyutv.com now can download online flv. 
modified:   common.py
	modified:   extractors/douyutv.py
 2014-10-25 19:46:25 +08:00
pl
8a1d7b5fa1 fix douyutv support. 2014-10-24 21:25:10 +08:00
pl
b37480100d add douyutv support. 2014-10-24 21:25:10 +08:00
lilydjwg
d24b2ca700 move parse_size to dongting.py 2014-10-17 07:09:11 +02:00
lilydjwg
a00d8a60b0 add Dongting (天天动听) support 
example URL: http://www.dongting.com/?song_id=281575
 2014-10-17 07:09:11 +02:00
Mort Yao
2c1d354635 support Content-Type: audio/mp4 2014-09-21 02:22:57 +02:00
Mort Yao
1952c90d10 use byte string for all when default encoding is not UTF-8 (fix #147 and close #222) 2014-09-21 02:10:05 +02:00