Commit Graph

328 Commits

Author SHA1 Message Date
Mort Yao
9ab4bfbf3e
[common] update UA 2018-07-01 15:50:08 +02:00
Mort Yao
d503237508
[common] dumb 2018-07-01 15:48:22 +02:00
Mort Yao
3e89279598
[common] make get_location accept headers 2018-07-01 15:47:54 +02:00
Mort Yao
37e2a79897
[common] wubba lubba dub dub 2018-07-01 13:48:22 +02:00
Mort Yao
503ff846f7
[common] do not coerce headers into a dict 2018-07-01 13:23:48 +02:00
kiss4u
a10c98c5ab support for zhibo.tv
<http://v.zhibo.tv/>
example: http://v.zhibo.tv/31609372
<http://video.zhibo.tv/>
example: http://video.zhibo.tv/video/details/d103057f-663e-11e8-9d83-525400ccac43.html
2018-06-04 00:43:15 +08:00
Mort Yao
44960677c4
[common] use quoted video_host and video_url as well 2018-04-25 22:30:46 +02:00
Mort Yao
d057a49e5b
[common] url_to_module: quote non-ASCII characters in URL 2018-04-24 14:46:38 +02:00
Mort Yao
87e3bd5722
Merge branch 'develop' of https://github.com/John128217/you-get into John128217-develop 2018-02-22 17:25:04 +01:00
Mort Yao
b4850f5a59
[common] indent! 2018-02-22 17:21:43 +01:00
John128217
c7290c7c2f
A number bug fixed
Now if you can have more than 10 videos that have same names.
2018-02-21 21:55:28 -08:00
John128217
a22dce896c
Added an auto rename option and fixed the force option
I've noticed that if I am downloading two videos with same names from youtube (e.g. https://www.youtube.com/watch?v=606hmlA_nxw and https://www.youtube.com/watch?v=CLrXTnggUeY), only one of them will be saved (usually the bigger one according to the original script "os.path.getsize(output_filepath) >= total_size * 0.9"). However, I want them both while preserving their names from youtube. So I modified the source code. It looks like there are a lot of changes, but I just added an indent and everything changed.
Also, I've noticed that "force" is not working at all. I fixed that issue.
2018-02-21 14:23:21 -08:00
Justsoos
fb2c936893 Add longzhu.com 2018-02-19 22:00:55 +08:00
Mort Yao
53a87c975f
[common] resolve conflict 2018-02-09 15:31:03 +01:00
iawia002
4ce28ac2b5 add douyin support 2017-12-15 17:21:34 +08:00
moorefu
3032ec9679 New site support: https://www.kuaishou.com/ 2017-12-13 11:52:05 +08:00
hellsof
7b996ec755 Fix download_url_ffmpeg extension 2017-12-12 12:43:20 +08:00
perror
6c3bdfd90c New site support: https://www.ixigua.com/ 2017-12-10 13:14:32 +08:00
hellsof
64772ce2e9
Update common.py
File "xxx/site-packages/you_get/common.py", line 750, in update
    sys.stdout.write('\r' + bar)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 23-64: ordinal not in range(128)
2017-11-29 17:11:09 +08:00
Mort Yao
33664c514c
[common] formatting 2017-11-27 21:09:43 +01:00
Mort Yao
250f3f06a1
Merge branch 'add-toutiao-suport' of https://github.com/ultimate010/you-get into ultimate010-add-toutiao-suport 2017-11-27 21:08:15 +01:00
Mort Yao
fae02c25d5
Merge branch 'add_coub_support' of https://github.com/zmux/you-get into zmux-add_coub_support 2017-11-27 18:43:01 +01:00
Sergey Zmushko
b2d97bcaea [coub] add coub.com support
Video and audio files with high quality are downloaded.
We use ffmpeg for audio and video combining into one file
2017-11-27 15:08:09 +03:00
Mort Yao
60e9976eda
[common] resolve conflict 2017-11-17 17:21:43 +01:00
iawia002
b327a5ef96 pep8 update for common.py 2017-11-12 17:31:42 +08:00
ayanamist
6c9c15e69f fix bar display under windows terminal 2017-10-19 09:33:42 +08:00
ayanamist
e88364bf56 fix urlopen_with_retry may return None 2017-10-16 14:31:31 +08:00
Rafael Slonik
9e12df7807 new extractor: giphy.com 2017-09-16 17:01:13 -03:00
Mort Yao
3dfa709a14
Merge branch 'patch-3' of https://github.com/wwqgtxx/you-get into wwqgtxx-patch-3 2017-09-16 11:36:03 +02:00
wwqgtxx
8831d2c44f bug fix for password 2017-09-13 23:42:00 +08:00
lilydjwg
d1f98fa5bc fix load_cookies local name error 2017-09-13 17:28:49 +08:00
Mort Yao
854c78fd6f
[common] remove duplicated keyword argument
- fix #2347
- fix #2348
2017-09-12 12:08:00 +02:00
lilydjwg
657e67e123 fix wrong local name
thanks to @ayanamist
bcd8d74d73 (commitcomment-24242276)
2017-09-12 14:01:34 +08:00
Mort Yao
35103577cf
[common] resolve conflicts 2017-09-11 15:15:43 +02:00
Mort Yao
262b6951c6
Merge branch 'timeout_retry' of https://github.com/JayXon/you-get into JayXon-timeout_retry 2017-09-11 15:04:43 +02:00
MaxwellGoblin
c95146a4e2 [qingting]support qingting; close #1243 2017-09-05 13:41:52 +08:00
JayXon
2c32db485e [common] retry if response.read() timeout 2017-09-03 16:51:32 -07:00
MaxwellGoblin
9248e6f896 update help message 2017-08-30 19:58:42 +08:00
Mort Yao
b719681763
Merge branch 'develop' of https://github.com/flewsea/you-get into flewsea-develop 2017-08-27 04:02:36 +02:00
David Zhuang
46a83efd3d [Fantasy] Add support 2017-08-18 00:49:10 -04:00
MaxwellGoblin
e32e8c56ad [common]fix mutable default parameter in url_save; fix #2278 2017-08-16 16:26:25 +08:00
MaxwellGoblin
699ed7e501 [common]catch HTTPError in urlopen_with_retry 2017-08-13 19:55:19 +08:00
lilydjwg
bcd8d74d73 use argparse instead of getopt
see also https://github.com/soimort/you-get/issues/1181
2017-08-13 00:33:53 +08:00
MaxwellGoblin
d41feb7684 [common]fix #1603 2017-08-11 00:29:31 +08:00
MaxwellGoblin
00d62706ca [common]fix #954 2017-08-11 00:05:15 +08:00
MaxwellGoblin
87fb35769e [icourses]rewrite 2017-08-10 22:17:15 +08:00
MaxwellGoblin
f1a942c0d0 [vimeo]support multi streams; fix #1798 2017-08-09 13:15:08 +08:00
rosynirvana
c820f42af7 Merge pull request #2153 from rosynirvana/zhanqi
[common zhanqi]m3u8 code in common; rewrite zhanqi
2017-08-08 03:56:06 +08:00
MaxwellGoblin
7eb7ead380 [soundcloud]update client id and new api 2017-07-29 19:59:29 +08:00
wwqgtxx
56efb0ba96 add support for send the password from cli 2017-07-16 23:50:53 +08:00
MaxwellGoblin
15c46d3f7d [ffmpeg]drop -re flag when input is not live stream 2017-07-16 08:49:42 +08:00
MaxwellGoblin
1ab8ea015d [common zhanqi]m3u8 code in common; rewrite zhanqi 2017-07-15 21:44:54 +08:00
MaxwellGoblin
dbe272a8af [common]revert #1940 for it breaks sohu 2017-07-09 20:55:00 +08:00
w48325832
ca7d03357e add iwara 2017-06-25 14:20:28 +08:00
MaxwellGoblin
71a1825be5 [acfun]fix youku cloud source 2017-05-24 02:16:32 +08:00
David Zhuang
08fdd22466 [common] add .ac.cn support 2017-05-13 17:15:18 -04:00
MaxwellGoblin
8f828a90ed [common] url_info should not ignore refer when called in url_save 2017-05-07 00:47:06 +08:00
Mort Yao
f64b3494c7
[common] url_save: always specify Range 2017-05-06 15:31:29 +02:00
ultimate010
34d05f1777 add suport for toutiao.com 2017-04-25 16:58:36 +08:00
MaxwellGoblin
fd661668a7 print stack trace only when debug flag is on 2017-04-21 01:01:13 +08:00
MaxwellGoblin
bdffcfacab tuning debugging message 2017-04-21 00:49:00 +08:00
Mort Yao
c118ce7f22
Merge branch 'gnu_getopt' of https://github.com/rosynirvana/you-get into rosynirvana-gnu_getopt
- Close #1731
2017-04-16 21:12:31 +02:00
MaxwellGoblin
0e87a5c06c common.py append ext name when -O flag existed 2017-04-07 11:09:28 +08:00
Mort Yao
f0682403c0
[common] allow specifying timeout for url_save() 2017-04-01 22:16:21 +02:00
Mort Yao
b2dbfd1283
Merge branch 'Erk--Yizhibo-support' into develop 2017-04-01 21:56:22 +02:00
MaxwellGoblin
db6fa04754 remove test code 2017-03-06 11:41:17 +08:00
MaxwellGoblin
0a8f708c31 [common]add -I --input-file flag 2017-03-06 11:34:50 +08:00
MaxwellGoblin
86493087d4 [common.py] switch to gnu_getopt 2017-03-06 10:43:35 +08:00
Mort Yao
96398d8f6c
[common] revert #1644 (per #1728) 2017-03-05 23:58:00 +01:00
Mort Yao
8bddd170f3
[common] fix non-ascii url issues, close #1728 (per #1644) 2017-03-05 10:57:55 +01:00
MaxwellGoblin
fa9c51dfea add support for ximalaya.py 2017-03-01 04:04:36 +08:00
Zhiming Wang
37dbb4a3ce
[common] print user agent when dumping URLs (-u, --url)
Certain sites (known example: tudou.com) deny access to video URLs unless user
agent matches the one used when retrieving URLs from the API, effectively
rendering the URLs useless without the proper user agent. Therefore, exposing
the user agent in -u, --url output could come in handy at times.

This commit does not affect --json output.
2017-02-27 00:51:16 -05:00
Zhiming Wang
1997ea45ce
[common] log URLs in more functions with network requests
This is a follow-up to #999.

This commit adds the

    <function_name>: <url>

debug message, which was previously only emitted by get_content and
post_content, to all high level utility functions with network requests
except url_size, url_save and url_save_chunked (in order not to ruin
progress bars).
2017-02-10 11:47:24 -05:00
Mort Yao
8afb998d59
Remove dead sites (2017-02-01)
* JPopsuki TV http://www.jpopsuki.tv/
* 天天动听 http://www.dongting.com/
* THVideo http://thvideo.tv/
* 阡陌视频 http://qianmo.com/
2017-02-01 23:39:46 +01:00
Mort Yao
7e2d84dbed
Merge branch 'develop' of https://github.com/hjk41/you-get into hjk41-develop 2017-01-27 22:13:18 +01:00
Mort Yao
f299d30161
[common] update fake_headers 2017-01-25 21:21:49 +01:00
Chuntao Hong
61225b1552 fix non-ascii url 2017-01-24 12:36:57 +08:00
JayXon
374e1032db [common] also retry if timeout in url_save, post_content, etc. 2017-01-16 09:56:24 -08:00
Mort Yao
ecdcf5dcf8
Merge branch 'Yizhibo-support' of https://github.com/Erk-/you-get into Erk--Yizhibo-support 2017-01-06 15:06:02 +01:00
Valdemar Erk
60b6834e54 Quanmin support. 2017-01-03 23:58:56 +01:00
Valdemar Erk
44e60c3e21 Initial support for yizhibo.com 2016-12-10 12:23:35 +01:00
Mort Yao
474f4d724a
[common] pass valid filename in download_url_ffmpeg 2016-12-03 17:40:29 +01:00
Mort Yao
538f1796f2
[universal] workaround for websites that block HEAD requests 2016-11-26 17:09:28 +01:00
Yohohaha
fe2720544a fix syntax error 2016-11-25 20:03:38 +08:00
Yohohaha
c44a7ec1b9 Merge pull request #1 from soimort/develop
Project Updatding
2016-11-25 19:16:16 +08:00
Mort Yao
79bb217c4b
Merge branch 'icourses' of https://github.com/liushuyu/you-get into liushuyu-icourses 2016-11-03 16:58:00 +01:00
liushuyu
ae4e533ec9
common: add dynamic url support for url_save_chunked 2016-10-25 14:26:38 -06:00
liushuyu
4bbafeb9e4
icourse: add supprt 2016-10-24 20:09:58 -06:00
Mort Yao
4561be553c
Merge branch 'fix-baidu-support' of https://github.com/liushuyu/you-get into liushuyu-fix-baidu-support 2016-10-21 17:46:08 +02:00
liushuyu
78fa116131
Add POST method to common.py 2016-10-20 22:35:21 -06:00
Cheng Gu
95a8d1e8af [huomaotv] add huomao.com suppport 2016-10-20 14:31:03 +08:00
zhangchao
8674f43c36 fix bug about renaming videos when downloading with ffmpeg 2016-09-27 23:04:01 +08:00
H.G
2baeed762a [universal] fix issue: "flush" is not available in Python under 3.3 2016-09-05 10:50:58 +12:00
David Zhuang
e60981f91e [Wanmen]Add support 2016-08-24 23:12:06 -04:00
Mort Yao
3a8ce8819d
[ffmpeg] remove unuseful ffmpeg_play_stream(), fix #1336 2016-08-14 03:52:02 +02:00
David Zhuang
d0215aa238 [Bigthink]Add Bigthink 2016-08-01 05:39:38 -04:00
Chuntao Hong
fdb1809455 fix socks DNS resolve issue 2016-07-20 15:26:25 +08:00
David Zhuang
5a99b2f42f [Showroom] Add support via HLS M3U 2016-07-01 01:07:32 -04:00
Mort Yao
2fdea30d8d
Merge branch 'ffmpeg-live' of https://github.com/cnbeining/you-get into cnbeining-ffmpeg-live 2016-07-01 06:40:44 +02:00
David Zhuang
62a9e35ed0 [CNTV] Fix CCAV domain, Add pattern, fix #1193 ,#909 , replace #1031 2016-06-30 02:36:07 -04:00