PublicMirrors/you-get
1
0
Fork 0
mirror of https://github.com/soimort/you-get.git synced 2025-02-03 16:53:56 +03:00
Code Issues Actions Packages Projects Releases 1 Wiki Activity
1,635 Commits 4 Branches 165 Tags 6.6 MiB
dbe272a8af
Commit Graph

1230 Commits

Author SHA1 Message Date
MaxwellGoblin
63eca70f86 [ximalaya]support downloading (is_paid and is_free) tracks 2017-03-01 17:08:22 +08:00
MaxwellGoblin
36bdff7c16 [ximalaya]ignore paid item in an album 2017-03-01 04:04:36 +08:00
MaxwellGoblin
fa9c51dfea add support for ximalaya.py 2017-03-01 04:04:36 +08:00
Mort Yao
d361b55de8
[nanagogo] skip more 2017-02-26 23:07:52 +01:00
MaxwellGoblin
925415fa2b add support for dilidili.mobi and dilidili.wang 2017-02-25 02:37:45 +08:00
MaxwellGoblin
251a1bff48 ckplayer.py: fix when got data without a ckplayer->info and clean the code 2017-02-25 02:37:45 +08:00
MaxwellGoblin
9b9d80b32d do not print size when the container is m3u8 2017-02-25 02:31:07 +08:00
YK Liu
8799197bef Print audiolang in json output 2017-02-20 15:09:38 +08:00
Mort Yao
1497d713a0
Merge branch 'develop' of https://github.com/alanyang/you-get into alanyang-develop 2017-02-19 21:14:08 +01:00
Zhiming Wang
4d0dac2968
[ffmpeg] call ffmpeg with stdin redirected to the null device 
Prevent FFmpeg from consuming stdin and interpreting the character
stream as a stream of interactive commands, specifically:

    ?      show this help
    +      increase verbosity
    -      decrease verbosity
    c      Send command to first matching filter supporting it
    C      Send/Queue command to all matching filters
    D      cycle through available debug modes
    h      dump packets/hex press to cycle through the 3 states
    q      quit
    s      Show QP histogram

This prevents misclicking a key or key sequence (e.g., h) produces a
large amount of debugging output which may confuse the unseasoned
user. It is also useful in a batch environment where an unsuspecting
user may not realize you-get could consume stdin through FFmpeg, e.g.

    while read url; do you-get $url; done <urllist

(Related: BashFAQ/089.)

Note that interactive commands are enabled in debug mode (which also
doesn't suppress FFmpeg's default logging).

---

A note on implementation:

An alternative would be FFmpeg's -nostdin option, which explicitly
disables interaction, but adding such an option to existing code would
be even more destructive than the stdin=DEVNULL approach taken here.

---

This commit also happens to fix a dual-call bug in
ffmpeg_concat_mp4_to_mpg.
 2017-02-19 12:08:31 -05:00
Mort Yao
192eb82dcf
Merge branch 'improve-youtube-livestream' of https://github.com/L34p/you-get into L34p-improve-youtube-livestream 2017-02-12 17:04:44 +01:00
Mort Yao
dd0545bf83
Merge branch 'more-debug-messages' of https://github.com/zmwangx/you-get into zmwangx-more-debug-messages 2017-02-12 17:01:44 +01:00
Mort Yao
c1ed0d7e15
[youtube] fix signature extraction (regression in #1662) 2017-02-12 00:40:16 +01:00
Zhiming Wang
1997ea45ce
[common] log URLs in more functions with network requests 
This is a follow-up to #999.

This commit adds the

    <function_name>: <url>

debug message, which was previously only emitted by get_content and
post_content, to all high level utility functions with network requests
except url_size, url_save and url_save_chunked (in order not to ruin
progress bars).
 2017-02-10 11:47:24 -05:00
l34p
69714046b8 [youtube] improve livestream detection, fix #1673 2017-02-06 18:04:52 +09:00
Mort Yao
858435d503
version 0.4.652 2017-02-02 06:03:23 +01:00
Mort Yao
098b6a9dd8
[youtube] fix signature extraction 2017-02-02 05:50:00 +01:00
Mort Yao
ed99b91d18
[xiami] fix #1650 2017-02-02 05:43:57 +01:00
Mort Yao
62a535a418
version 0.4.648 2017-02-01 23:55:03 +01:00
Mort Yao
8afb998d59
Remove dead sites (2017-02-01) 
* JPopsuki TV http://www.jpopsuki.tv/
* 天天动听 http://www.dongting.com/
* THVideo http://thvideo.tv/
* 阡陌视频 http://qianmo.com/
 2017-02-01 23:39:46 +01:00
Mort Yao
2f4dc0f9a0
[google] quick fix for Google+ videos 2017-02-01 17:33:57 +01:00
l34p
5139b40b44 [youtube] fix broken link of html5player 2017-02-01 21:07:59 +09:00
Mort Yao
db3a52fbd1
Merge branch 'develop' of https://github.com/haoflynet/you-get into haoflynet-develop 2017-01-31 01:53:23 +01:00
Mort Yao
753879b497
[netease] fix #1642 2017-01-28 03:20:17 +01:00
Mort Yao
7e2d84dbed
Merge branch 'develop' of https://github.com/hjk41/you-get into hjk41-develop 2017-01-27 22:13:18 +01:00
Mort Yao
fff596764a
Merge branch 'fix_zhanqi' of https://github.com/Justsoos/you-get into Justsoos-fix_zhanqi 2017-01-27 21:38:47 +01:00
Justsoos
15ae8feb5b little fix 2017-01-28 03:08:54 +08:00
Justsoos
4108e2112d fix:[zhanqi.tv]recode all 2017-01-26 16:31:56 +08:00
Mort Yao
f299d30161
[common] update fake_headers 2017-01-25 21:21:49 +01:00
Mort Yao
10624ca5b3
[google] add UA in get_html 2017-01-25 21:21:09 +01:00
Chuntao Hong
61225b1552 fix non-ascii url 2017-01-24 12:36:57 +08:00
haoflynet
fc1646d74e fix youku.py bug 2017-01-22 23:35:23 +08:00
AlanYang
a520eb051e fixed mgtv.com 1.17 change api address and stream domain 2017-01-19 11:15:42 +08:00
Mort Yao
015871dfa9
[acfun] correct active p title, fix #1617 2017-01-16 23:49:27 +01:00
Mort Yao
50f5d857dc
Merge branch 'timeout_retry' of https://github.com/JayXon/you-get into JayXon-timeout_retry 2017-01-16 23:31:59 +01:00
Mort Yao
0f131e38d4
[facebook] fix #1615 2017-01-16 23:29:21 +01:00
Mort Yao
0f0da0ccd7
Merge branch 'develop' of https://github.com/Naville/you-get into Naville-develop 2017-01-16 23:20:59 +01:00
JayXon
374e1032db [common] also retry if timeout in url_save, post_content, etc. 2017-01-16 09:56:24 -08:00
Valdemar Erk
0c1553b97d Fixes #1612 2017-01-15 12:43:34 +01:00
Mort Yao
866876e59f
version 0.4.626 2017-01-10 17:46:04 +01:00
Mort Yao
a7cd3e2c6e
[bilibili] bangumi titling with episode_id 2017-01-10 17:45:09 +01:00
Mort Yao
c401c9b9f8
[bilibili] fix #1605 2017-01-10 17:31:57 +01:00
Mort Yao
4b782f92be
[nanagogo] skip erroneous posts 2017-01-10 17:25:37 +01:00
Mort Yao
64dca2182e
[youku] do not override existing proxy handler (fix #1546, close #1548) 2017-01-09 01:14:03 +01:00
lilydjwg
f452eec729 [qq] support for videos embedded in weixin 
example url:
http://mp.weixin.qq.com/s?__biz=MzA3OTgxODI4NQ==&mid=2653200488&idx=1&sn=bd6d0279b2430cc208d9da74226871db&chksm=847dbb2ab30a323c4b1735887158daf1e295abe586aff0a646ce4257a48010f80bcfb1379c95&scene=0#rd
 2017-01-08 21:36:03 +08:00
Mort Yao
f72b34f3dc
Merge branch 'develop' of https://github.com/liujianshan/you-get into liujianshan-develop 2017-01-06 22:57:45 +01:00
Mort Yao
ecdcf5dcf8
Merge branch 'Yizhibo-support' of https://github.com/Erk-/you-get into Erk--Yizhibo-support 2017-01-06 15:06:02 +01:00
Mort Yao
4c19940fbf
Merge branch 'quanmin-support' of https://github.com/Erk-/you-get into Erk--quanmin-support 2017-01-04 14:44:03 +01:00
Valdemar Erk
fc2c77effa Fixes quanmin, when stream is offline. 2017-01-04 13:56:32 +01:00
Valdemar Erk
60b6834e54 Quanmin support. 2017-01-03 23:58:56 +01:00
Mort Yao
9408cc4b9d
Merge branch 'develop' of https://github.com/zjuchenyuan/you-get into zjuchenyuan-develop 2017-01-02 16:20:08 +01:00
Mort Yao
fee7193b77
Merge branch 'ffmpeg-dynamic-loglevel' of https://github.com/zmwangx/you-get into zmwangx-ffmpeg-dynamic-loglevel 2017-01-02 16:10:44 +01:00
ChenYuan
76399e8561 fix bilibili bangumi 
modify the regex to get eposide id
 2017-01-01 00:44:56 +08:00
liujianshan
927a1cb91f Fix soku.com vid download error problem 2016-12-29 19:47:53 +08:00
Zhiming Wang
f7b6f6b40f
ffmpeg: set loglevel to info in debug mode 
Occasionally, the FFmpeg invocation fails (which could be due to bugs in
you-get; see #1558 for instance), but -loglevel quiet means nothing is
printed other than the exit status (pretty much always 1) in Python's
traceback, which is not helpful at all.

This commit restores FFmpeg's regular output (-loglevel info) when
--debug is specified. We're not using verbose, debug or trace because
those levels are mostly only useful for debugging FFmpeg itself, which
is not our goal.

Due to lack of meaningful API to access the global logging level, this
is a hack based on two assumptions:

1. When --debug is enabled, the root logger level is set to DEBUG;
2. processor.ffmpeg is lazily imported, after command line options are
   parsed.
 2016-12-25 13:58:21 -05:00
Zhiming Wang
b493af9a69
[ffmpeg] fix concat list when output dir is not pwd 
Relative paths in the concat list are considered relative to the parent
directory of the script, not the calling directory. This isn't entirely
obvious from the documentation, but it is easy to infer from the concat
demuxer's concept of "safety", and easy to test (confirmed on FFmpeg
3.2.2). See https://ffmpeg.org/ffmpeg-all.html#concat-1 for details.

This commit fixes the wrong relative paths when --output-dir is
specified and not pwd.

This commit also
- Factors out common concat list writer code;
- Slightly simplifies the code to collect FFmpeg params (on Py35+ we can
  further simplify by unpacking LOGLEVEL with the star operator right in
  the list literal).
 2016-12-24 13:44:22 -05:00
Mort Yao
932c7071af
Merge branch 'bilibibi-embed' of https://github.com/zmwangx/you-get into zmwangx-bilibibi-embed 2016-12-24 15:35:33 +01:00
Mort Yao
f48aad9700
Merge branch 'lizhi-overhaul' of https://github.com/zmwangx/you-get into zmwangx-lizhi-overhaul 2016-12-24 15:32:43 +01:00
Zhang
bc5ff346d0 [BiliBili] revert naming for single part videos 2016-12-23 11:50:51 +08:00
Zhang
db16bcb659 [BiliBili] Better Multi-Part Video Naming 2016-12-22 22:33:37 +08:00
Valdemar Erk
9905620b52 Fix for magisto 2016-12-16 09:36:29 +01:00
Valdemar Erk
e0554b2d7b Made player use the m3u8 file. 2016-12-11 01:49:13 +01:00
Valdemar Erk
0f1d5beb14 Changed the plugin to use download_urls instead of ffmpeg 2016-12-11 01:46:23 +01:00
Valdemar Erk
0f33e471ad minor correction 2016-12-10 12:26:06 +01:00
Valdemar Erk
44e60c3e21 Initial support for yizhibo.com 2016-12-10 12:23:35 +01:00
Zhiming Wang
a6d3c13684
[embed] add support for bilibili's embedded player 
Sample embed: for http://www.bilibili.com/video/av5079467/:

  <embed
    height="415" width="544" quality="high"
    allowfullscreen="true" type="application/x-shockwave-flash"
    src="http://static.hdslb.com/miniloader.swf"
    flashvars="aid=5079467&page=1"
    pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash"
  ></embed>
 2016-12-05 23:45:28 -05:00
Zhiming Wang
606e0a786e
[lizhi] overhaul 
Lizhi extractor has stopped working. In particular, there are two major
changes:

- URL format change: no more #/ in URL paths;
- The /api/audio/{radio_id}/{audio_id} API now returns 404.

This is a rewrite based on the /api/radio_audios API.
 2016-12-04 19:57:02 -05:00
Mort Yao
61d9bf124e
[youtube] download hlsvp via ffmpeg 2016-12-03 17:41:23 +01:00
Mort Yao
474f4d724a
[common] pass valid filename in download_url_ffmpeg 2016-12-03 17:40:29 +01:00
sheerluck
8e150e6989 fix for NameError: name 'output_json' is not defined 2016-11-28 18:01:42 +03:00
Mort Yao
538f1796f2
[universal] workaround for websites that block HEAD requests 2016-11-26 17:09:28 +01:00
Mort Yao
03266c030a
[youtube] fix dash-mpd for live streams (no yt:contentLength field) 2016-11-26 16:35:16 +01:00
Mort Yao
e65c2d23a0
[tudou] fix #1526 2016-11-26 16:26:40 +01:00
Yohohaha
fe2720544a fix syntax error 2016-11-25 20:03:38 +08:00
Yohohaha
c44a7ec1b9 Merge pull request #1 from soimort/develop 
Project Updatding
 2016-11-25 19:16:16 +08:00
Mort Yao
250672f42d
version 0.4.595 2016-11-19 20:47:18 +01:00
Mort Yao
d2206b3fdf
Merge branch 'fix-ffmpeg-error-on-mgtv' of https://github.com/StephenPCG/you-get into StephenPCG-fix-ffmpeg-error-on-mgtv 2016-11-18 22:59:43 +01:00
Zhang Cheng
a7635e96a5 [mgtv] add bsf:a aac_adtstoasc to ffmpeg args, fix #1458. 2016-11-17 11:18:01 +08:00
Mort Yao
fbba2f6034
Merge branch 'develop' of https://github.com/iawia002/you-get into iawia002-develop 2016-11-15 09:10:47 +01:00
L
65713cae2c update yixia_download url match rule 
resolved #1346
 2016-11-14 21:49:13 +08:00
moyo
78ba20266c 1. Change container from FLV to TS 
2. Fix video url matcher
3. Use m3u8 ext-info for fast size calculate
4. Use m3u8 url for video playing
 2016-11-13 17:41:00 +08:00
Mort Yao
51dd7ad8e6
[youtube] use url_encoded_fmt_stream_map from video page, fix #1502 2016-11-10 16:24:26 +01:00
Rokic
d04997ec9b fix #1415 
Songs from netease cloud music playlist will have a prefix indicates
their order in the list.
 2016-11-08 02:09:39 +08:00
Mort Yao
5601e1fe30
[bilibili] fix support for bangumi 2016-11-03 22:03:56 +01:00
Mort Yao
bc590cbd62
[douban] add support: movie.douban.com 2016-11-03 21:32:13 +01:00
Mort Yao
25a2f9248b
Merge branch 'embed-correct-tudou-pattern' of https://github.com/zmwangx/you-get into zmwangx-embed-correct-tudou-pattern 2016-11-03 17:00:25 +01:00
Mort Yao
79bb217c4b
Merge branch 'icourses' of https://github.com/liushuyu/you-get into liushuyu-icourses 2016-11-03 16:58:00 +01:00
Mort Yao
68e8be7af3
Merge branch 'add-dyn-chunked' of https://github.com/liushuyu/you-get into liushuyu-add-dyn-chunked 2016-11-03 16:56:57 +01:00
Zhiming Wang
391ca5643a
[embed] correct tudou pattern 
Hyphen-minus (-) is a valid character in Tudou's video ID. It's even
present in the second pattern of tudou_embed_patterns, just not the
first.
 2016-11-02 20:44:40 -04:00
Mort Yao
e8514d1370
version 0.4.575 2016-11-03 01:44:04 +01:00
Mort Yao
bc8834a7cc
Merge branch 'huomaotv' of https://github.com/gucheen/you-get into gucheen-huomaotv 2016-11-03 00:18:15 +01:00
Mort Yao
2b84c1e5f9
Merge branch 'dailymotion-fix' into develop 2016-11-03 00:17:16 +01:00
Mort Yao
a4f4fb3626
Revert "fix for #1405" (fix #1485) 
This reverts commit 38ba0dbe48.
 2016-10-30 16:16:04 +01:00
Mort Yao
4b55884e86
[dailymotion] use ffmpeg_download_stream, fix #1466 2016-10-30 00:26:25 +02:00
Mort Yao
feffcb656a
[processor.ffmpeg] fix params in ffmpeg_download_stream 2016-10-30 00:24:31 +02:00
Cheng Gu
ac33461c88 fix(huomao): adapt to new url format 2016-10-27 17:44:02 +08:00
liushuyu
2183448c90
icourses: implement fake keep connection alive 2016-10-25 22:16:36 -06:00
liushuyu
ae4e533ec9
common: add dynamic url support for url_save_chunked 2016-10-25 14:26:38 -06:00
liushuyu
5351121186
icouses: Code clean up 2016-10-25 12:52:30 -06:00
liushuyu
4bbafeb9e4
icourse: add supprt 2016-10-24 20:09:58 -06:00
Mort Yao
4561be553c
Merge branch 'fix-baidu-support' of https://github.com/liushuyu/you-get into liushuyu-fix-baidu-support 2016-10-21 17:46:08 +02:00
liushuyu
aef17dcb99
Add Baidu Cloud support 2016-10-20 22:39:47 -06:00
liushuyu
78fa116131
Add POST method to common.py 2016-10-20 22:35:21 -06:00
Cheng Gu
95a8d1e8af [huomaotv] add huomao.com suppport 2016-10-20 14:31:03 +08:00
Mort Yao
669d7b5586
[youtube] unescape HTML entities, fix #1462 2016-10-19 20:47:17 +02:00
Mort Yao
455e5b90d9
Merge branch 'develop' of https://github.com/chideat/you-get into chideat-develop 2016-10-14 20:33:53 +02:00
chinat
21fc4d4a09 translate char | to - in filename for ffmpeg concat 2016-10-10 11:28:45 +08:00
Vicent Tsai
c9ffae970e [AcFun] fix #1429 2016-10-10 00:13:01 +08:00
Bochun Bai
fb97d7d0c3 Tencent Video use best quality 
Prefer 1080p and 720p if available
 2016-10-03 00:18:50 +08:00
zhangchao
8674f43c36 fix bug about renaming videos when downloading with ffmpeg 2016-09-27 23:04:01 +08:00
Mort Yao
7e5abc9371
version 0.4.555 2016-09-23 08:39:25 +02:00
Valdemar Erk
38ba0dbe48 fix for #1405 2016-09-19 13:15:25 +02:00
Mort Yao
0984190f93
[acfun] improve regex for getting video part title 2016-09-14 19:59:55 +02:00
Mort Yao
e1d5581e65
Merge branch 'origin/panda-dot-tv-plflag-fix' of https://github.com/Erk-/you-get into Erk--origin/panda-dot-tv-plflag-fix 2016-09-13 13:22:23 +02:00
zhangchao
7baa1f029e
qq compatible with new urls and modify baomihua getvidourl address 2016-09-13 11:03:49 +02:00
Valdemar Erk
47011101a9 added fix for nonstandard plflags on panda.tv 2016-09-07 10:47:38 +02:00
Mort Yao
24b2b4cb55
[bilibili] do not hide any URLError (better for debugging) 2016-09-07 10:44:05 +02:00
H.G
2baeed762a [universal] fix issue: "flush" is not available in Python under 3.3 2016-09-05 10:50:58 +12:00
Mort Yao
44c09c542f
[funshion] fix (partly) #1304 and close #1378 2016-08-30 12:42:50 +02:00
Mort Yao
5e612e870c
[pptv] fix #447 (per discussion in #1381) 2016-08-30 12:04:12 +02:00
David Zhuang
d66749801f [Bilibili] Change back to extract via interface API with Miniloader s key 2016-08-28 23:39:19 -04:00
Mort Yao
6fc2cc375e
[universal] call embed_download only if content_type is text/html (#1369) 2016-08-26 19:27:40 +02:00
David Zhuang
e60981f91e [Wanmen]Add support 2016-08-24 23:12:06 -04:00
David Zhuang
8ff1a108ea Merge pull request #1363 from cnbeining/bokecc 
[BokeCC] Add support
 2016-08-24 23:03:58 -04:00
David Zhuang
ebd3db9acb [BokeCC] Add support 2016-08-24 23:00:48 -04:00
Mort Yao
a3f3d880f9
[bilibili] quick hack for bangumi URLs again (fix #1362) 2016-08-25 02:04:05 +02:00
Mort Yao
315634332a
[twitter] fix #1357 2016-08-23 14:39:43 +02:00
Mort Yao
16015a2db0
version 0.4.536 2016-08-23 00:54:33 +02:00
Mort Yao
f8bf3e6cf3
[sina] fix #1361, close #1332 2016-08-22 23:58:48 +02:00
Mort Yao
ce759590d3
[ifeng] fix #1358 2016-08-22 11:41:26 +02:00
Mort Yao
550ef5aeb2
[acfun] fix #1353 (get and only get the specified part) 2016-08-21 23:35:33 +02:00
Mort Yao
7cecd0368d
[bilibili] close #1340 2016-08-21 21:44:05 +02:00
Mort Yao
326bae23e1
[qq] fix #1355 2016-08-21 18:54:58 +02:00
Mort Yao
3a8ce8819d
[ffmpeg] remove unuseful ffmpeg_play_stream(), fix #1336 2016-08-14 03:52:02 +02:00
David Zhuang
c6784f2fb8 Merge pull request #1342 from cnbeining/fix-ffmpeg-and-douyu 
Fix ffmpeg wrong folder format and douyu discard output folder
 2016-08-11 03:38:39 -04:00
David Zhuang
bb485a1110 [ffmpeg] Fix wrong format of output dir 2016-08-11 03:30:21 -04:00
David Zhuang
0c50e04666 [DouyuTV] Fix discarding output_dir 2016-08-11 03:29:59 -04:00
Mort Yao
e765f32805
[netease] fix #1341, also do not create new directory when info_only 2016-08-10 13:56:52 +02:00
steven7851
a8015ec92e [Douyutv]fix channel on event 
some channel on event will redirect to event page
exp. http://www.douyu.com/65251 redirect to http://www.douyu.com/cms/zt/RioOlympics.html#a
if channel is on event, use entering url to get room_id, and non-digital room_id will not work
 2016-08-09 02:27:59 +08:00
Mort Yao
021a2f62a3
version 0.4.523 2016-08-05 01:24:12 +02:00
johan
af039eae5f [ifeng] fix video info xml url 2016-08-04 15:32:22 +08:00
David Zhuang
f8939128e6 [QQ]Add QQ Daxue 2016-08-03 21:39:10 -04:00
David Zhuang
d0215aa238 [Bigthink]Add Bigthink 2016-08-01 05:39:38 -04:00
steven7851
2322a16ca8 delete useless line 2016-07-29 21:30:43 +08:00
steven7851
ddbc2caa23 add support for non digit channel 
event page is still not support because the rule is complicated
 2016-07-29 20:50:15 +08:00
steven7851
06b57e2db7 fix CI failure by using 3rd packages 2016-07-29 18:25:40 +08:00
steven7851
6689f45469 [Douyutv]Update api 
Thanks #1299 @cnbeining #1235 @hellofwy
 2016-07-29 13:35:05 +08:00
David Zhuang
0922307896 Merge pull request #1309 from chideat/develop 
[bilibili] video title may have space around
 2016-07-29 01:30:33 -04:00
David Zhuang
9cccec94f3 Merge pull request #1314 from cnbeining/fix-douyu 
[Processor]FFmpeg: check arguments not None
 2016-07-29 01:28:34 -04:00
David Zhuang
468fb6f403 [Processor]FFmpeg: check arguments not None 2016-07-29 01:27:22 -04:00