Zhiming Wang
3c8c65f045
[bilibili] use faker when downloading videos
...
Bilibili's CDN now may reject requests with 403 when urllib's default
user agent is used. This appears to be location-based (and started today
for me; others might have experienced this for a while): I tested on a
bunch of U.S.-based nodes and all requests were rejected without a
spoofed user agent, but when I tested on a Mainland China-based node,
the requests went through.
2017-05-25 15:48:13 -04:00
Zhiming Wang
23011a011c
[common.py] keep user-specified headers when faker is True
...
Previously, for multiple functions, when the faker argument is True and
the headers argument is non-empty, the headers argument is silently
ignored. This commit fixes that behavior by merging fake headers with
user-specified headers (but not overriding user-specified keys).
Also, get rid of mutable values as default arguments, which is an
anti-pattern and not safe for changes like the one above. As part of
this effort, when a default value {} is replaced with None, the
corresponding argument is also copied on use, which may be a bit
paranoid in some cases.
2017-05-25 15:30:06 -04:00
Mort Yao
d0a7655727
version 0.4.750
2017-05-21 14:11:10 +02:00
Mort Yao
24099c7efe
Merge branch 'le_sports' of https://github.com/rosynirvana/you-get into rosynirvana-le_sports
...
- Close #1000
- Close #1200
- Close #1469
2017-05-20 21:57:07 +02:00
MaxwellGoblin
f1823eb16a
[sina]try to find vid from url
2017-05-18 03:50:07 +08:00
MaxwellGoblin
fb04f289c2
[le]support sports.le
2017-05-18 03:15:55 +08:00
David Zhuang
b646c851a0
Merge pull request #1975 from cnbeining/ucas
...
[UCAS] Add support, fix #75
2017-05-13 17:42:29 -04:00
David Zhuang
c7a262cf65
[UCAS] use http.client instead of requests
2017-05-13 17:39:07 -04:00
David Zhuang
d0431d8bd6
[UCAS] add support
2017-05-13 17:15:29 -04:00
David Zhuang
08fdd22466
[common] add .ac.cn support
2017-05-13 17:15:18 -04:00
Mort Yao
d3d9e0f5c0
[imgur] use hash when title not present
2017-05-13 15:00:31 +02:00
Mort Yao
303922f9d4
Merge branch 'fix_weibo' of https://github.com/rosynirvana/you-get into rosynirvana-fix_weibo
2017-05-12 12:35:47 +02:00
Mort Yao
0f4f184643
Merge branch 'fixed-some-album-name-endwith-spaces-cause-FileNotFoundError-problum' of https://github.com/bigfuji/you-get into bigfuji-fixed-some-album-name-endwith-spaces-cause-FileNotFoundError-problum
2017-05-12 12:26:18 +02:00
Mort Yao
13daffdd66
Merge branch 'ku6/fix-extension-error' of https://github.com/XiaochenCui/you-get into XiaochenCui-ku6/fix-extension-error
2017-05-12 12:21:01 +02:00
David Zhuang
ded1d221b9
Merge pull request #1956 from rosynirvana/ximalaya
...
[Ximalaya] fix #1955
2017-05-08 22:33:56 -04:00
MaxwellGoblin
3bd8910ffb
[ximalaya] use fake_headers to fetch json
2017-05-09 10:29:05 +08:00
XiaochenCui
65712f8619
[ku6]fix error when parse url's extension
2017-05-07 07:20:00 +08:00
Mort Yao
7d6f68a159
Merge branch 'url_info' of https://github.com/rosynirvana/you-get into rosynirvana-url_info ( close #1942 )
2017-05-06 20:47:19 +02:00
MaxwellGoblin
8f828a90ed
[common] url_info should not ignore refer when called in url_save
2017-05-07 00:47:06 +08:00
Mort Yao
9d395172d9
Merge branch 'qq_redirect' of https://github.com/rosynirvana/you-get into rosynirvana-qq_redirect ( fix #1908 )
2017-05-06 18:11:47 +02:00
Mort Yao
f64b3494c7
[common] url_save: always specify Range
2017-05-06 15:31:29 +02:00
Mort Yao
5777d49f62
[bilibili] add referer
2017-05-06 15:11:50 +02:00
kaka
27b80072c3
strip name of album fixed when download some album which name endwith spaces raise FileNotFoundError problem.
2017-05-06 20:11:21 +08:00
MaxwellGoblin
5cf63526c6
[le.py] update api
2017-05-04 11:34:18 +08:00
MaxwellGoblin
398845fd69
[qq]fix v.qq.com/page redirect
2017-04-26 11:15:04 +08:00
MaxwellGoblin
2425edc5e7
refactoring
2017-04-24 20:37:45 +08:00
Mort Yao
9db82b1131
Merge branch 'patch-4' of https://github.com/steven7851/you-get into steven7851-patch-4
2017-04-23 12:14:55 +02:00
MaxwellGoblin
fd661668a7
print stack trace only when debug flag is on
2017-04-21 01:01:13 +08:00
MaxwellGoblin
bdffcfacab
tuning debugging message
2017-04-21 00:49:00 +08:00
David Zhuang
b314985645
Merge pull request #1708 from rosynirvana/fix_tudou
...
fix tudou.py when there is no title
2017-04-20 11:13:06 -04:00
MaxwellGoblin
ccb1bb9c77
new matching patterns
2017-04-20 17:24:30 +08:00
MaxwellGoblin
45a3beaffe
fix tudou.py when there is no title
2017-04-20 16:47:24 +08:00
Mort Yao
c118ce7f22
Merge branch 'gnu_getopt' of https://github.com/rosynirvana/you-get into rosynirvana-gnu_getopt
...
- Close #1731
2017-04-16 21:12:31 +02:00
Mort Yao
f65fe485cd
version 0.4.715
2017-04-16 12:25:19 +02:00
Adam Cavendish
15a1a20fb9
Cleaner fix for the last commit
2017-04-16 00:12:54 +08:00
Adam Cavendish
b90884cbdf
Fix youku's problem, issue #1856
2017-04-15 23:47:40 +08:00
Mort Yao
71443d04e3
Merge branch 'zmwangx-youku-warn-paywall' into develop
2017-04-09 16:28:59 +02:00
Mort Yao
3a47f92af9
Merge branch 'youku-warn-paywall' of https://github.com/zmwangx/you-get into zmwangx-youku-warn-paywall
2017-04-09 16:28:48 +02:00
Mort Yao
4d5d520cea
Merge branch 'fix_ifeng' of https://github.com/rosynirvana/you-get into rosynirvana-fix_ifeng
2017-04-09 16:24:10 +02:00
MaxwellGoblin
0e87a5c06c
common.py append ext name when -O flag existed
2017-04-07 11:09:28 +08:00
MaxwellGoblin
aaa96f4389
add ifeng new matching patterns
2017-04-05 21:12:39 +08:00
Mort Yao
5525694fe3
[bilibili] workaround for speed limiting issue, fix #1784
2017-04-01 22:16:21 +02:00
Mort Yao
f0682403c0
[common] allow specifying timeout for url_save()
2017-04-01 22:16:21 +02:00
Mort Yao
2d6c828ad4
util/log.py: change mode back to 644
2017-04-01 22:14:13 +02:00
Mort Yao
1e21480cfe
Merge branch 'xterm-color' of https://github.com/zmwangx/you-get into zmwangx-xterm-color
2017-04-01 22:10:00 +02:00
Mort Yao
44f261dc14
Merge branch 'fix_baidu.ku6' of https://github.com/rosynirvana/you-get into rosynirvana-fix_baidu.ku6
2017-04-01 22:04:07 +02:00
Mort Yao
b931203850
Merge branch 'support_kg.qq' of https://github.com/rosynirvana/you-get into rosynirvana-support_kg.qq
2017-04-01 22:01:54 +02:00
Mort Yao
7b6bc9a6b0
Merge branch 'develop' of https://github.com/up1m/you-get into up1m-develop ( close #1789 )
2017-04-01 21:59:44 +02:00
Mort Yao
b2dbfd1283
Merge branch 'Erk--Yizhibo-support' into develop
2017-04-01 21:56:22 +02:00
Mort Yao
cce2ffc7bb
Merge branch 'xiami' of https://github.com/lilydjwg/you-get into lilydjwg-xiami
2017-04-01 21:52:00 +02:00