Commit Graph

1176 Commits

Author SHA1 Message Date
MaxwellGoblin
925415fa2b add support for dilidili.mobi and dilidili.wang 2017-02-25 02:37:45 +08:00
MaxwellGoblin
251a1bff48 ckplayer.py: fix when got data without a ckplayer->info and clean the code 2017-02-25 02:37:45 +08:00
MaxwellGoblin
9b9d80b32d do not print size when the container is m3u8 2017-02-25 02:31:07 +08:00
YK Liu
8799197bef Print audiolang in json output 2017-02-20 15:09:38 +08:00
Mort Yao
1497d713a0
Merge branch 'develop' of https://github.com/alanyang/you-get into alanyang-develop 2017-02-19 21:14:08 +01:00
Zhiming Wang
4d0dac2968
[ffmpeg] call ffmpeg with stdin redirected to the null device
Prevent FFmpeg from consuming stdin and interpreting the character
stream as a stream of interactive commands, specifically:

    ?      show this help
    +      increase verbosity
    -      decrease verbosity
    c      Send command to first matching filter supporting it
    C      Send/Queue command to all matching filters
    D      cycle through available debug modes
    h      dump packets/hex press to cycle through the 3 states
    q      quit
    s      Show QP histogram

This prevents misclicking a key or key sequence (e.g., h) produces a
large amount of debugging output which may confuse the unseasoned
user. It is also useful in a batch environment where an unsuspecting
user may not realize you-get could consume stdin through FFmpeg, e.g.

    while read url; do you-get $url; done <urllist

(Related: BashFAQ/089.)

Note that interactive commands are enabled in debug mode (which also
doesn't suppress FFmpeg's default logging).

---

A note on implementation:

An alternative would be FFmpeg's -nostdin option, which explicitly
disables interaction, but adding such an option to existing code would
be even more destructive than the stdin=DEVNULL approach taken here.

---

This commit also happens to fix a dual-call bug in
ffmpeg_concat_mp4_to_mpg.
2017-02-19 12:08:31 -05:00
Mort Yao
192eb82dcf
Merge branch 'improve-youtube-livestream' of https://github.com/L34p/you-get into L34p-improve-youtube-livestream 2017-02-12 17:04:44 +01:00
Mort Yao
dd0545bf83
Merge branch 'more-debug-messages' of https://github.com/zmwangx/you-get into zmwangx-more-debug-messages 2017-02-12 17:01:44 +01:00
Mort Yao
c1ed0d7e15
[youtube] fix signature extraction (regression in #1662) 2017-02-12 00:40:16 +01:00
Zhiming Wang
1997ea45ce
[common] log URLs in more functions with network requests
This is a follow-up to #999.

This commit adds the

    <function_name>: <url>

debug message, which was previously only emitted by get_content and
post_content, to all high level utility functions with network requests
except url_size, url_save and url_save_chunked (in order not to ruin
progress bars).
2017-02-10 11:47:24 -05:00
l34p
69714046b8 [youtube] improve livestream detection, fix #1673 2017-02-06 18:04:52 +09:00
Mort Yao
858435d503
version 0.4.652 2017-02-02 06:03:23 +01:00
Mort Yao
098b6a9dd8
[youtube] fix signature extraction 2017-02-02 05:50:00 +01:00
Mort Yao
ed99b91d18
[xiami] fix #1650 2017-02-02 05:43:57 +01:00
Mort Yao
62a535a418
version 0.4.648 2017-02-01 23:55:03 +01:00
Mort Yao
8afb998d59
Remove dead sites (2017-02-01)
* JPopsuki TV http://www.jpopsuki.tv/
* 天天动听 http://www.dongting.com/
* THVideo http://thvideo.tv/
* 阡陌视频 http://qianmo.com/
2017-02-01 23:39:46 +01:00
Mort Yao
2f4dc0f9a0
[google] quick fix for Google+ videos 2017-02-01 17:33:57 +01:00
l34p
5139b40b44 [youtube] fix broken link of html5player 2017-02-01 21:07:59 +09:00
Mort Yao
db3a52fbd1
Merge branch 'develop' of https://github.com/haoflynet/you-get into haoflynet-develop 2017-01-31 01:53:23 +01:00
Mort Yao
753879b497
[netease] fix #1642 2017-01-28 03:20:17 +01:00
Mort Yao
7e2d84dbed
Merge branch 'develop' of https://github.com/hjk41/you-get into hjk41-develop 2017-01-27 22:13:18 +01:00
Mort Yao
fff596764a
Merge branch 'fix_zhanqi' of https://github.com/Justsoos/you-get into Justsoos-fix_zhanqi 2017-01-27 21:38:47 +01:00
Justsoos
15ae8feb5b little fix 2017-01-28 03:08:54 +08:00
Justsoos
4108e2112d fix:[zhanqi.tv]recode all 2017-01-26 16:31:56 +08:00
Mort Yao
f299d30161
[common] update fake_headers 2017-01-25 21:21:49 +01:00
Mort Yao
10624ca5b3
[google] add UA in get_html 2017-01-25 21:21:09 +01:00
Chuntao Hong
61225b1552 fix non-ascii url 2017-01-24 12:36:57 +08:00
haoflynet
fc1646d74e fix youku.py bug 2017-01-22 23:35:23 +08:00
AlanYang
a520eb051e fixed mgtv.com 1.17 change api address and stream domain 2017-01-19 11:15:42 +08:00
Mort Yao
015871dfa9
[acfun] correct active p title, fix #1617 2017-01-16 23:49:27 +01:00
Mort Yao
50f5d857dc
Merge branch 'timeout_retry' of https://github.com/JayXon/you-get into JayXon-timeout_retry 2017-01-16 23:31:59 +01:00
Mort Yao
0f131e38d4
[facebook] fix #1615 2017-01-16 23:29:21 +01:00
Mort Yao
0f0da0ccd7
Merge branch 'develop' of https://github.com/Naville/you-get into Naville-develop 2017-01-16 23:20:59 +01:00
JayXon
374e1032db [common] also retry if timeout in url_save, post_content, etc. 2017-01-16 09:56:24 -08:00
Valdemar Erk
0c1553b97d Fixes #1612 2017-01-15 12:43:34 +01:00
Mort Yao
866876e59f
version 0.4.626 2017-01-10 17:46:04 +01:00
Mort Yao
a7cd3e2c6e
[bilibili] bangumi titling with episode_id 2017-01-10 17:45:09 +01:00
Mort Yao
c401c9b9f8
[bilibili] fix #1605 2017-01-10 17:31:57 +01:00
Mort Yao
4b782f92be
[nanagogo] skip erroneous posts 2017-01-10 17:25:37 +01:00
Mort Yao
64dca2182e
[youku] do not override existing proxy handler (fix #1546, close #1548) 2017-01-09 01:14:03 +01:00
lilydjwg
f452eec729 [qq] support for videos embedded in weixin
example url:
http://mp.weixin.qq.com/s?__biz=MzA3OTgxODI4NQ==&mid=2653200488&idx=1&sn=bd6d0279b2430cc208d9da74226871db&chksm=847dbb2ab30a323c4b1735887158daf1e295abe586aff0a646ce4257a48010f80bcfb1379c95&scene=0#rd
2017-01-08 21:36:03 +08:00
Mort Yao
f72b34f3dc
Merge branch 'develop' of https://github.com/liujianshan/you-get into liujianshan-develop 2017-01-06 22:57:45 +01:00
Mort Yao
ecdcf5dcf8
Merge branch 'Yizhibo-support' of https://github.com/Erk-/you-get into Erk--Yizhibo-support 2017-01-06 15:06:02 +01:00
Mort Yao
4c19940fbf
Merge branch 'quanmin-support' of https://github.com/Erk-/you-get into Erk--quanmin-support 2017-01-04 14:44:03 +01:00
Valdemar Erk
fc2c77effa Fixes quanmin, when stream is offline. 2017-01-04 13:56:32 +01:00
Valdemar Erk
60b6834e54 Quanmin support. 2017-01-03 23:58:56 +01:00
Mort Yao
9408cc4b9d
Merge branch 'develop' of https://github.com/zjuchenyuan/you-get into zjuchenyuan-develop 2017-01-02 16:20:08 +01:00
Mort Yao
fee7193b77
Merge branch 'ffmpeg-dynamic-loglevel' of https://github.com/zmwangx/you-get into zmwangx-ffmpeg-dynamic-loglevel 2017-01-02 16:10:44 +01:00
ChenYuan
76399e8561 fix bilibili bangumi
modify the regex to get eposide id
2017-01-01 00:44:56 +08:00
liujianshan
927a1cb91f Fix soku.com vid download error problem 2016-12-29 19:47:53 +08:00
Zhiming Wang
f7b6f6b40f
ffmpeg: set loglevel to info in debug mode
Occasionally, the FFmpeg invocation fails (which could be due to bugs in
you-get; see #1558 for instance), but -loglevel quiet means nothing is
printed other than the exit status (pretty much always 1) in Python's
traceback, which is not helpful at all.

This commit restores FFmpeg's regular output (-loglevel info) when
--debug is specified. We're not using verbose, debug or trace because
those levels are mostly only useful for debugging FFmpeg itself, which
is not our goal.

Due to lack of meaningful API to access the global logging level, this
is a hack based on two assumptions:

1. When --debug is enabled, the root logger level is set to DEBUG;
2. processor.ffmpeg is lazily imported, after command line options are
   parsed.
2016-12-25 13:58:21 -05:00
Zhiming Wang
b493af9a69
[ffmpeg] fix concat list when output dir is not pwd
Relative paths in the concat list are considered relative to the parent
directory of the script, not the calling directory. This isn't entirely
obvious from the documentation, but it is easy to infer from the concat
demuxer's concept of "safety", and easy to test (confirmed on FFmpeg
3.2.2). See https://ffmpeg.org/ffmpeg-all.html#concat-1 for details.

This commit fixes the wrong relative paths when --output-dir is
specified and not pwd.

This commit also
- Factors out common concat list writer code;
- Slightly simplifies the code to collect FFmpeg params (on Py35+ we can
  further simplify by unpacking LOGLEVEL with the star operator right in
  the list literal).
2016-12-24 13:44:22 -05:00
Mort Yao
932c7071af
Merge branch 'bilibibi-embed' of https://github.com/zmwangx/you-get into zmwangx-bilibibi-embed 2016-12-24 15:35:33 +01:00
Mort Yao
f48aad9700
Merge branch 'lizhi-overhaul' of https://github.com/zmwangx/you-get into zmwangx-lizhi-overhaul 2016-12-24 15:32:43 +01:00
Zhang
bc5ff346d0 [BiliBili] revert naming for single part videos 2016-12-23 11:50:51 +08:00
Zhang
db16bcb659 [BiliBili] Better Multi-Part Video Naming 2016-12-22 22:33:37 +08:00
Valdemar Erk
9905620b52 Fix for magisto 2016-12-16 09:36:29 +01:00
Valdemar Erk
e0554b2d7b Made player use the m3u8 file. 2016-12-11 01:49:13 +01:00
Valdemar Erk
0f1d5beb14 Changed the plugin to use download_urls instead of ffmpeg 2016-12-11 01:46:23 +01:00
Valdemar Erk
0f33e471ad minor correction 2016-12-10 12:26:06 +01:00
Valdemar Erk
44e60c3e21 Initial support for yizhibo.com 2016-12-10 12:23:35 +01:00
Zhiming Wang
a6d3c13684
[embed] add support for bilibili's embedded player
Sample embed: for http://www.bilibili.com/video/av5079467/:

  <embed
    height="415" width="544" quality="high"
    allowfullscreen="true" type="application/x-shockwave-flash"
    src="http://static.hdslb.com/miniloader.swf"
    flashvars="aid=5079467&page=1"
    pluginspage="http://www.adobe.com/shockwave/download/download.cgi?P1_Prod_Version=ShockwaveFlash"
  ></embed>
2016-12-05 23:45:28 -05:00
Zhiming Wang
606e0a786e
[lizhi] overhaul
Lizhi extractor has stopped working. In particular, there are two major
changes:

- URL format change: no more #/ in URL paths;
- The /api/audio/{radio_id}/{audio_id} API now returns 404.

This is a rewrite based on the /api/radio_audios API.
2016-12-04 19:57:02 -05:00
Mort Yao
61d9bf124e
[youtube] download hlsvp via ffmpeg 2016-12-03 17:41:23 +01:00
Mort Yao
474f4d724a
[common] pass valid filename in download_url_ffmpeg 2016-12-03 17:40:29 +01:00
sheerluck
8e150e6989 fix for NameError: name 'output_json' is not defined 2016-11-28 18:01:42 +03:00
Mort Yao
538f1796f2
[universal] workaround for websites that block HEAD requests 2016-11-26 17:09:28 +01:00
Mort Yao
03266c030a
[youtube] fix dash-mpd for live streams (no yt:contentLength field) 2016-11-26 16:35:16 +01:00
Mort Yao
e65c2d23a0
[tudou] fix #1526 2016-11-26 16:26:40 +01:00
Yohohaha
fe2720544a fix syntax error 2016-11-25 20:03:38 +08:00
Yohohaha
c44a7ec1b9 Merge pull request #1 from soimort/develop
Project Updatding
2016-11-25 19:16:16 +08:00
Mort Yao
250672f42d
version 0.4.595 2016-11-19 20:47:18 +01:00
Mort Yao
d2206b3fdf
Merge branch 'fix-ffmpeg-error-on-mgtv' of https://github.com/StephenPCG/you-get into StephenPCG-fix-ffmpeg-error-on-mgtv 2016-11-18 22:59:43 +01:00
Zhang Cheng
a7635e96a5 [mgtv] add bsf:a aac_adtstoasc to ffmpeg args, fix #1458. 2016-11-17 11:18:01 +08:00
Mort Yao
fbba2f6034
Merge branch 'develop' of https://github.com/iawia002/you-get into iawia002-develop 2016-11-15 09:10:47 +01:00
L
65713cae2c update yixia_download url match rule
resolved #1346
2016-11-14 21:49:13 +08:00
moyo
78ba20266c 1. Change container from FLV to TS
2. Fix video url matcher
3. Use m3u8 ext-info for fast size calculate
4. Use m3u8 url for video playing
2016-11-13 17:41:00 +08:00
Mort Yao
51dd7ad8e6
[youtube] use url_encoded_fmt_stream_map from video page, fix #1502 2016-11-10 16:24:26 +01:00
Rokic
d04997ec9b fix #1415
Songs from netease cloud music playlist will have a prefix indicates
their order in the list.
2016-11-08 02:09:39 +08:00
Mort Yao
5601e1fe30
[bilibili] fix support for bangumi 2016-11-03 22:03:56 +01:00
Mort Yao
bc590cbd62
[douban] add support: movie.douban.com 2016-11-03 21:32:13 +01:00
Mort Yao
25a2f9248b
Merge branch 'embed-correct-tudou-pattern' of https://github.com/zmwangx/you-get into zmwangx-embed-correct-tudou-pattern 2016-11-03 17:00:25 +01:00
Mort Yao
79bb217c4b
Merge branch 'icourses' of https://github.com/liushuyu/you-get into liushuyu-icourses 2016-11-03 16:58:00 +01:00
Mort Yao
68e8be7af3
Merge branch 'add-dyn-chunked' of https://github.com/liushuyu/you-get into liushuyu-add-dyn-chunked 2016-11-03 16:56:57 +01:00
Zhiming Wang
391ca5643a
[embed] correct tudou pattern
Hyphen-minus (-) is a valid character in Tudou's video ID. It's even
present in the second pattern of tudou_embed_patterns, just not the
first.
2016-11-02 20:44:40 -04:00
Mort Yao
e8514d1370
version 0.4.575 2016-11-03 01:44:04 +01:00
Mort Yao
bc8834a7cc
Merge branch 'huomaotv' of https://github.com/gucheen/you-get into gucheen-huomaotv 2016-11-03 00:18:15 +01:00
Mort Yao
2b84c1e5f9
Merge branch 'dailymotion-fix' into develop 2016-11-03 00:17:16 +01:00
Mort Yao
a4f4fb3626
Revert "fix for #1405" (fix #1485)
This reverts commit 38ba0dbe48.
2016-10-30 16:16:04 +01:00
Mort Yao
4b55884e86
[dailymotion] use ffmpeg_download_stream, fix #1466 2016-10-30 00:26:25 +02:00
Mort Yao
feffcb656a
[processor.ffmpeg] fix params in ffmpeg_download_stream 2016-10-30 00:24:31 +02:00
Cheng Gu
ac33461c88 fix(huomao): adapt to new url format 2016-10-27 17:44:02 +08:00
liushuyu
2183448c90
icourses: implement fake keep connection alive 2016-10-25 22:16:36 -06:00
liushuyu
ae4e533ec9
common: add dynamic url support for url_save_chunked 2016-10-25 14:26:38 -06:00
liushuyu
5351121186
icouses: Code clean up 2016-10-25 12:52:30 -06:00
liushuyu
4bbafeb9e4
icourse: add supprt 2016-10-24 20:09:58 -06:00
Mort Yao
4561be553c
Merge branch 'fix-baidu-support' of https://github.com/liushuyu/you-get into liushuyu-fix-baidu-support 2016-10-21 17:46:08 +02:00
liushuyu
aef17dcb99
Add Baidu Cloud support 2016-10-20 22:39:47 -06:00
liushuyu
78fa116131
Add POST method to common.py 2016-10-20 22:35:21 -06:00
Cheng Gu
95a8d1e8af [huomaotv] add huomao.com suppport 2016-10-20 14:31:03 +08:00