Sergey M․ [Sat, 16 Jan 2016 21:02:45 +0000 (03:02 +0600)]
[ae] Rename to aenetworks and clarify extractor name and description
Yen Chi Hsuan [Sat, 16 Jan 2016 14:17:31 +0000 (22:17 +0800)]
[compat] Clarify the versions requiring compat_kwargs
It's supported since 2.7.0 alpha 1 and 2.6.5 rc 1. See
https://hg.python.org/cpython/file/v2.7a1/Misc/NEWS#l337
https://hg.python.org/cpython/file/v2.6.5rc1/Misc/NEWS#l28
Yen Chi Hsuan [Sat, 16 Jan 2016 12:56:53 +0000 (20:56 +0800)]
[ae] Fix _TESTS
Yen Chi Hsuan [Sat, 16 Jan 2016 12:46:28 +0000 (20:46 +0800)]
[bbc] Use _search_json_ld
Yen Chi Hsuan [Sat, 16 Jan 2016 12:45:36 +0000 (20:45 +0800)]
[extractor/common] Allow passing more parameters to _search_json_ld
Sergey M [Sat, 16 Jan 2016 04:15:24 +0000 (10:15 +0600)]
[README.md] Add protocol usage example in format selection
Sergey M․ [Sat, 16 Jan 2016 04:10:28 +0000 (10:10 +0600)]
[YoutubeDL] Ensure protocol is always present
Sergey M [Sat, 16 Jan 2016 03:49:54 +0000 (09:49 +0600)]
[README.md] Improve format selection documentation
Sergey M [Sat, 16 Jan 2016 01:31:14 +0000 (07:31 +0600)]
[README.md] Mention new string operators for format selection
Yen Chi Hsuan [Wed, 13 Jan 2016 08:24:48 +0000 (16:24 +0800)]
[YoutubeDL] Introduce CSS3 like string operators
Sergey M [Sat, 16 Jan 2016 01:20:15 +0000 (07:20 +0600)]
Merge pull request #8246 from dstftw/initial-json-ld-metadata-support
Initial JSON-LD metadata extraction support
Sergey M [Sat, 16 Jan 2016 01:20:03 +0000 (07:20 +0600)]
Merge pull request #8245 from dstftw/auto-generate-title-fields
[YoutubeDL] Auto generate title fields corresponding to the *_number fields
Sergey M․ [Sat, 16 Jan 2016 01:10:51 +0000 (07:10 +0600)]
[cultureunplugged] Improve (Closes #8060)
Sergey M․ [Sat, 16 Jan 2016 00:25:25 +0000 (06:25 +0600)]
[zippcast] Improve (Closes #8198)
ckuu [Sun, 10 Jan 2016 11:20:59 +0000 (15:20 +0400)]
'[ZippCast] Add new extractor'
Closes rg3/youtube-dl#6591
Philipp Hagemeister [Fri, 15 Jan 2016 18:43:04 +0000 (19:43 +0100)]
release 2016.01.15
Sergey M․ [Fri, 15 Jan 2016 18:36:49 +0000 (00:36 +0600)]
[ae] Use JSON-LD for TV series metadata
Sergey M․ [Fri, 15 Jan 2016 18:36:02 +0000 (00:36 +0600)]
[extractor/common] Add initial support for JSON-LD metadata extraction into info_dict
Sergey M․ [Fri, 15 Jan 2016 18:09:54 +0000 (00:09 +0600)]
[YoutubeDL] Auto generate title fields corresponding to the *_number fields
Auto generate title fields corresponding to the *_number fields when missing in order to always have clean titles. This is very common for TV series.
remitamine [Fri, 15 Jan 2016 16:45:51 +0000 (17:45 +0100)]
[cwtv] Add new extractor
Sergey M․ [Fri, 15 Jan 2016 16:13:48 +0000 (22:13 +0600)]
[ae] Improve _VALID_URL
Sergey M․ [Fri, 15 Jan 2016 16:12:51 +0000 (22:12 +0600)]
[ae] Add extractor import
Sergey M․ [Fri, 15 Jan 2016 16:10:07 +0000 (22:10 +0600)]
[history] Remove import (Closes #8243)
Sergey M․ [Fri, 15 Jan 2016 15:35:20 +0000 (21:35 +0600)]
[xtube:user] Fix extraction (Closes #8224)
Sergey M․ [Fri, 15 Jan 2016 15:28:36 +0000 (21:28 +0600)]
[xtube] Add shortcut
remitamine [Fri, 15 Jan 2016 15:18:07 +0000 (16:18 +0100)]
[ae] Add support for fyi.tv, aetv.com and mylifetime.com(closes #3599)
remitamine [Fri, 15 Jan 2016 14:16:57 +0000 (15:16 +0100)]
[history] add support for episode pages(fixes #8240)
remitamine [Fri, 15 Jan 2016 14:12:35 +0000 (15:12 +0100)]
[theplatform] extend _VALID_URL regex
remitamine [Fri, 15 Jan 2016 13:54:39 +0000 (14:54 +0100)]
Revert "[history] fix signature and media url extraction(fixes #8240)"
This reverts commit
ffbc0baf72f456b1f4f4ac989e4a7b75b69c7a54.
remitamine [Fri, 15 Jan 2016 11:34:28 +0000 (12:34 +0100)]
[history] fix signature and media url extraction(fixes #8240)
Sergey M [Thu, 14 Jan 2016 17:20:02 +0000 (22:20 +0500)]
Merge pull request #8228 from jaimeMF/disable-file-handler
[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)
Sergey M․ [Thu, 14 Jan 2016 17:15:26 +0000 (23:15 +0600)]
Credit @TomGijselinck for canvas (#7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:12 +0000 (23:15 +0600)]
[canvas] Improve (Closes #7145)
Tom Gijselinck [Mon, 12 Oct 2015 07:07:18 +0000 (09:07 +0200)]
[Canvas] Add new extractor
Sergey M․ [Thu, 14 Jan 2016 16:45:09 +0000 (22:45 +0600)]
[prosiebensat1] Fix some extraction and update tests
Lucas [Wed, 13 Jan 2016 15:11:49 +0000 (16:11 +0100)]
[prosiebensat1] add support for 7tv.de
Sergey M․ [Thu, 14 Jan 2016 16:12:24 +0000 (22:12 +0600)]
[ntvde] Improve regex
Sergey M․ [Thu, 14 Jan 2016 16:11:33 +0000 (22:11 +0600)]
[orf:fm4] Add test
Sergey M․ [Thu, 14 Jan 2016 16:07:42 +0000 (22:07 +0600)]
[orf:fm4] Extend _VALID_URL (Closes #8234)
Sergey M․ [Thu, 14 Jan 2016 16:05:04 +0000 (22:05 +0600)]
[ntvde] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 15:53:24 +0000 (21:53 +0600)]
[unistra] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 15:48:08 +0000 (21:48 +0600)]
[vodlocker] Fix extraction (Closes #8231)
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 15:28:46 +0000 (16:28 +0100)]
[YoutubeDL] use a more correct terminology in the error message for file:// URLs
Philipp Hagemeister [Thu, 14 Jan 2016 14:43:21 +0000 (15:43 +0100)]
release 2016.01.14
Sergey M․ [Thu, 14 Jan 2016 13:57:56 +0000 (19:57 +0600)]
[beeg] Update API URL
Sergey M․ [Thu, 14 Jan 2016 13:57:20 +0000 (19:57 +0600)]
[beeg] Fix extraction (Closes #8225)
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 13:07:54 +0000 (14:07 +0100)]
[YoutubeDL] improve error message for file:/// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 07:14:01 +0000 (08:14 +0100)]
[YoutubeDL] urlopen: use build_opener again
Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.
Jaime Marquínez Ferrándiz [Wed, 13 Jan 2016 23:16:23 +0000 (00:16 +0100)]
[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)
If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:
#EXTM3U
#EXT-X-MEDIA-SEQUENCE:0
#EXTINF:10.0
file:///etc/passwd
#EXT-X-ENDLIST
With this patch 'file:' URLs raise URLError like for unknown protocols.
remitamine [Wed, 13 Jan 2016 12:29:00 +0000 (13:29 +0100)]
[tudou] Add support for Albums and Playlists and extract more metadata
Yen Chi Hsuan [Wed, 13 Jan 2016 09:05:38 +0000 (17:05 +0800)]
[youtube] Fix acodec and vcodec order
In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.
Sergey M․ [Wed, 13 Jan 2016 02:18:37 +0000 (08:18 +0600)]
[pluralsight] Fix new player (Closes #8215)
Sergey M․ [Tue, 12 Jan 2016 18:00:31 +0000 (00:00 +0600)]
[downloader/fragment] Move helper data to context dict
Sergey M․ [Tue, 12 Jan 2016 17:23:39 +0000 (23:23 +0600)]
[dailymotion] Prefer direct links (Closes #8156)
Sergey M․ [Tue, 12 Jan 2016 17:18:38 +0000 (23:18 +0600)]
[downloader/fragment] More smooth calculations
`downloaded_bytes` is now updated on each fragment progress hook invocation
Sergey M․ [Tue, 12 Jan 2016 16:09:38 +0000 (22:09 +0600)]
[downloader/fragment] Remove unused code and fix zero division error
Sergey M․ [Mon, 11 Jan 2016 16:00:17 +0000 (22:00 +0600)]
[iprima] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:58:32 +0000 (21:58 +0600)]
[videott] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:56:19 +0000 (21:56 +0600)]
[videomega] Mark broken
remitamine [Sun, 10 Jan 2016 18:27:22 +0000 (19:27 +0100)]
Revert "fix typos"
This reverts commit
36a0e46c39ea4f211dea9944177976e8f8364736.
remitamine [Sun, 10 Jan 2016 16:55:41 +0000 (17:55 +0100)]
fix typos
Jakub Wilk [Sun, 10 Jan 2016 15:17:47 +0000 (16:17 +0100)]
Fix typos
Closes #8200.
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:32:53 +0000 (14:32 +0100)]
[downloader/fragment] Don't fail if the 'Content-Length' header is missing
In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:26:27 +0000 (14:26 +0100)]
[bigflix] Use correct indentation to make flake8 happy
remitamine [Sun, 10 Jan 2016 06:55:58 +0000 (07:55 +0100)]
[shahid] raise ExtractorError if the video is DRM protected
remitamine [Sun, 10 Jan 2016 06:45:41 +0000 (07:45 +0100)]
[dcn] extract video ids in season entries
Sergey M․ [Sun, 10 Jan 2016 04:49:27 +0000 (10:49 +0600)]
[bigflix] Improve formats extraction
Sergey M․ [Sun, 10 Jan 2016 04:31:36 +0000 (10:31 +0600)]
[bigflix] Extract all formats
Sergey M․ [Sun, 10 Jan 2016 04:03:56 +0000 (10:03 +0600)]
Credit @vickyg3 for bigflix (#8194)
Sergey M [Sun, 10 Jan 2016 04:02:18 +0000 (09:02 +0500)]
Merge pull request #8194 from vickyg3/bigflix_ie
[Bigflix] Add new extractor for bigflix.com
Vignesh Venkat [Sat, 9 Jan 2016 23:31:50 +0000 (15:31 -0800)]
[Bigflix] Add new extractor for bigflix.com
Add an IE to support bigflix.com. It uses some sort of silverlight
plugin whose video url is being populated using base64 encoded
flashvars. So it is quite straightforward to extract.
Sergey M․ [Sat, 9 Jan 2016 19:37:10 +0000 (01:37 +0600)]
[canalc2] Fix extraction (Closes #8191)
Jaime Marquínez Ferrándiz [Sat, 9 Jan 2016 10:16:23 +0000 (11:16 +0100)]
[xhamster] Remove unused import
Philipp Hagemeister [Sat, 9 Jan 2016 00:16:08 +0000 (01:16 +0100)]
release 2016.01.09
Sergey M․ [Fri, 8 Jan 2016 21:07:29 +0000 (03:07 +0600)]
[vimeo] Add test for #8187
Sergey M․ [Fri, 8 Jan 2016 21:06:09 +0000 (03:06 +0600)]
[vimeo] Check source file URL (Closes #8187)
Sergey M․ [Fri, 8 Jan 2016 18:36:43 +0000 (00:36 +0600)]
[xhamster] Update tests
Sergey M․ [Fri, 8 Jan 2016 18:36:19 +0000 (00:36 +0600)]
[xhamster] Fix uploader extraction
Sergey M․ [Fri, 8 Jan 2016 18:31:24 +0000 (00:31 +0600)]
[xhamster] Change title regex precedence
Sergey M․ [Fri, 8 Jan 2016 18:29:10 +0000 (00:29 +0600)]
[xhamster] Fix view count extraction
Sergey M․ [Fri, 8 Jan 2016 18:26:37 +0000 (00:26 +0600)]
[xhamster] Fix duration extraction
Sergey M․ [Fri, 8 Jan 2016 18:21:57 +0000 (00:21 +0600)]
[xhamster] Fix upload date extraction
Sergey M․ [Fri, 8 Jan 2016 18:19:36 +0000 (00:19 +0600)]
[xhamster] Improve title extraction
Sergey M [Fri, 8 Jan 2016 18:04:32 +0000 (23:04 +0500)]
Merge pull request #8182 from atomic83/patch-1
Extract xHamster title fix
atomic83 [Fri, 8 Jan 2016 11:58:05 +0000 (12:58 +0100)]
Extract xHamster title fix
Sergey M․ [Fri, 8 Jan 2016 04:41:24 +0000 (10:41 +0600)]
[vimeo] Automatically pickup full movie when rented (Closes #8171)
Sergey M․ [Thu, 7 Jan 2016 23:11:23 +0000 (05:11 +0600)]
[ivideon] Add support for map bound URLs
Sergey M․ [Thu, 7 Jan 2016 21:19:47 +0000 (03:19 +0600)]
[adultswim] Skip georestricted hls (Closes #8168)
Sergey M․ [Thu, 7 Jan 2016 19:54:31 +0000 (01:54 +0600)]
[soundcloud:likes] Adapt to API changes (Closes #8166)
Sergey M․ [Thu, 7 Jan 2016 18:52:55 +0000 (00:52 +0600)]
[youtube] Support expanding alternative format of links in description (Closes #8164)
Sergey M․ [Thu, 7 Jan 2016 06:24:32 +0000 (12:24 +0600)]
[ivideon] Add extractor
oittaa [Thu, 7 Jan 2016 05:26:14 +0000 (07:26 +0200)]
check video_play_path and use xpath_text
"This check should take place earlier and should be more general if not video_url:. Same should be done for video_play_path. Also these fields better extracted with xpath_text."
Suggestions by @dstftw
Sergey M․ [Wed, 6 Jan 2016 19:57:36 +0000 (01:57 +0600)]
[npr] Fix extractor (Closes #7218)
kaspi [Sun, 18 Oct 2015 03:27:03 +0000 (23:27 -0400)]
[npr] Add extractor
removed md5 from _TEST
moved from xml data to json
test
changed _TEST url to one that will not expire, so tests would not be failing
Sergey M․ [Tue, 5 Jan 2016 18:03:39 +0000 (00:03 +0600)]
[udemy] Fix non free course message
Sergey M․ [Tue, 5 Jan 2016 18:02:21 +0000 (00:02 +0600)]
[udemy] Detect non free courses (Closes #8138)
Sergey M [Mon, 4 Jan 2016 20:17:12 +0000 (02:17 +0600)]
[README.md] Clarify cookies usage
Sergey M․ [Mon, 4 Jan 2016 19:59:45 +0000 (01:59 +0600)]
[vrt] Prefix format ids
Sergey M․ [Mon, 4 Jan 2016 19:58:25 +0000 (01:58 +0600)]
[vrt] Extend _VALUD_URL
Sergey M․ [Mon, 4 Jan 2016 19:41:18 +0000 (01:41 +0600)]
[dramafever] Add test for custom episode title