youtube-dl
8 years ago[history] fix signature and media url extraction(fixes #8240)
remitamine [Fri, 15 Jan 2016 11:34:28 +0000 (12:34 +0100)]
[history] fix signature and media url extraction(fixes #8240)

8 years agoMerge pull request #8228 from jaimeMF/disable-file-handler
Sergey M [Thu, 14 Jan 2016 17:20:02 +0000 (22:20 +0500)]
Merge pull request #8228 from jaimeMF/disable-file-handler

[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

8 years agoCredit @TomGijselinck for canvas (#7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:26 +0000 (23:15 +0600)]
Credit @TomGijselinck for canvas (#7145)

8 years ago[canvas] Improve (Closes #7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:12 +0000 (23:15 +0600)]
[canvas] Improve (Closes #7145)

8 years ago[Canvas] Add new extractor
Tom Gijselinck [Mon, 12 Oct 2015 07:07:18 +0000 (09:07 +0200)]
[Canvas] Add new extractor

8 years ago[prosiebensat1] Fix some extraction and update tests
Sergey M․ [Thu, 14 Jan 2016 16:45:09 +0000 (22:45 +0600)]
[prosiebensat1] Fix some extraction and update tests

8 years ago[prosiebensat1] add support for 7tv.de
Lucas [Wed, 13 Jan 2016 15:11:49 +0000 (16:11 +0100)]
[prosiebensat1] add support for 7tv.de

8 years ago[ntvde] Improve regex
Sergey M․ [Thu, 14 Jan 2016 16:12:24 +0000 (22:12 +0600)]
[ntvde] Improve regex

8 years ago[orf:fm4] Add test
Sergey M․ [Thu, 14 Jan 2016 16:11:33 +0000 (22:11 +0600)]
[orf:fm4] Add test

8 years ago[orf:fm4] Extend _VALID_URL (Closes #8234)
Sergey M․ [Thu, 14 Jan 2016 16:07:42 +0000 (22:07 +0600)]
[orf:fm4] Extend _VALID_URL (Closes #8234)

8 years ago[ntvde] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 16:05:04 +0000 (22:05 +0600)]
[ntvde] Fix extraction

8 years ago[unistra] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 15:53:24 +0000 (21:53 +0600)]
[unistra] Fix extraction

8 years ago[vodlocker] Fix extraction (Closes #8231)
Sergey M․ [Thu, 14 Jan 2016 15:48:08 +0000 (21:48 +0600)]
[vodlocker] Fix extraction (Closes #8231)

8 years ago[YoutubeDL] use a more correct terminology in the error message for file:// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 15:28:46 +0000 (16:28 +0100)]
[YoutubeDL] use a more correct terminology in the error message for file:// URLs

8 years agorelease 2016.01.14
Philipp Hagemeister [Thu, 14 Jan 2016 14:43:21 +0000 (15:43 +0100)]
release 2016.01.14

8 years ago[beeg] Update API URL
Sergey M․ [Thu, 14 Jan 2016 13:57:56 +0000 (19:57 +0600)]
[beeg] Update API URL

8 years ago[beeg] Fix extraction (Closes #8225)
Sergey M․ [Thu, 14 Jan 2016 13:57:20 +0000 (19:57 +0600)]
[beeg] Fix extraction (Closes #8225)

8 years ago[YoutubeDL] improve error message for file:/// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 13:07:54 +0000 (14:07 +0100)]
[YoutubeDL] improve error message for file:/// URLs

8 years ago[YoutubeDL] urlopen: use build_opener again
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 07:14:01 +0000 (08:14 +0100)]
[YoutubeDL] urlopen: use build_opener again

Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.

8 years ago[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)
Jaime Marquínez Ferrándiz [Wed, 13 Jan 2016 23:16:23 +0000 (00:16 +0100)]
[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:

    #EXTM3U
    #EXT-X-MEDIA-SEQUENCE:0
    #EXTINF:10.0
    file:///etc/passwd
    #EXT-X-ENDLIST

With this patch 'file:' URLs raise URLError like for unknown protocols.

8 years ago[tudou] Add support for Albums and Playlists and extract more metadata
remitamine [Wed, 13 Jan 2016 12:29:00 +0000 (13:29 +0100)]
[tudou] Add support for Albums and Playlists and extract more metadata

8 years ago[youtube] Fix acodec and vcodec order
Yen Chi Hsuan [Wed, 13 Jan 2016 09:05:38 +0000 (17:05 +0800)]
[youtube] Fix acodec and vcodec order

In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.

8 years ago[pluralsight] Fix new player (Closes #8215)
Sergey M․ [Wed, 13 Jan 2016 02:18:37 +0000 (08:18 +0600)]
[pluralsight] Fix new player (Closes #8215)

8 years ago[downloader/fragment] Move helper data to context dict
Sergey M․ [Tue, 12 Jan 2016 18:00:31 +0000 (00:00 +0600)]
[downloader/fragment] Move helper data to context dict

8 years ago[dailymotion] Prefer direct links (Closes #8156)
Sergey M․ [Tue, 12 Jan 2016 17:23:39 +0000 (23:23 +0600)]
[dailymotion] Prefer direct links (Closes #8156)

8 years ago[downloader/fragment] More smooth calculations
Sergey M․ [Tue, 12 Jan 2016 17:18:38 +0000 (23:18 +0600)]
[downloader/fragment] More smooth calculations

`downloaded_bytes` is now updated on each fragment progress hook invocation

8 years ago[downloader/fragment] Remove unused code and fix zero division error
Sergey M․ [Tue, 12 Jan 2016 16:09:38 +0000 (22:09 +0600)]
[downloader/fragment] Remove unused code and fix zero division error

8 years ago[iprima] Mark broken
Sergey M․ [Mon, 11 Jan 2016 16:00:17 +0000 (22:00 +0600)]
[iprima] Mark broken

8 years ago[videott] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:58:32 +0000 (21:58 +0600)]
[videott] Mark broken

8 years ago[videomega] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:56:19 +0000 (21:56 +0600)]
[videomega] Mark broken

8 years agoRevert "fix typos"
remitamine [Sun, 10 Jan 2016 18:27:22 +0000 (19:27 +0100)]
Revert "fix typos"

This reverts commit 36a0e46c39ea4f211dea9944177976e8f8364736.

8 years agofix typos
remitamine [Sun, 10 Jan 2016 16:55:41 +0000 (17:55 +0100)]
fix typos

8 years agoFix typos
Jakub Wilk [Sun, 10 Jan 2016 15:17:47 +0000 (16:17 +0100)]
Fix typos

Closes #8200.

8 years ago[downloader/fragment] Don't fail if the 'Content-Length' header is missing
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:32:53 +0000 (14:32 +0100)]
[downloader/fragment] Don't fail if the 'Content-Length' header is missing

In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).

8 years ago[bigflix] Use correct indentation to make flake8 happy
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:26:27 +0000 (14:26 +0100)]
[bigflix] Use correct indentation to make flake8 happy

8 years ago[shahid] raise ExtractorError if the video is DRM protected
remitamine [Sun, 10 Jan 2016 06:55:58 +0000 (07:55 +0100)]
[shahid] raise ExtractorError if the video is DRM protected

8 years ago[dcn] extract video ids in season entries
remitamine [Sun, 10 Jan 2016 06:45:41 +0000 (07:45 +0100)]
[dcn] extract video ids in season entries

8 years ago[bigflix] Improve formats extraction
Sergey M․ [Sun, 10 Jan 2016 04:49:27 +0000 (10:49 +0600)]
[bigflix] Improve formats extraction

8 years ago[bigflix] Extract all formats
Sergey M․ [Sun, 10 Jan 2016 04:31:36 +0000 (10:31 +0600)]
[bigflix] Extract all formats

8 years agoCredit @vickyg3 for bigflix (#8194)
Sergey M․ [Sun, 10 Jan 2016 04:03:56 +0000 (10:03 +0600)]
Credit @vickyg3 for bigflix (#8194)

8 years agoMerge pull request #8194 from vickyg3/bigflix_ie
Sergey M [Sun, 10 Jan 2016 04:02:18 +0000 (09:02 +0500)]
Merge pull request #8194 from vickyg3/bigflix_ie

[Bigflix] Add new extractor for bigflix.com

8 years ago[Bigflix] Add new extractor for bigflix.com
Vignesh Venkat [Sat, 9 Jan 2016 23:31:50 +0000 (15:31 -0800)]
[Bigflix] Add new extractor for bigflix.com

Add an IE to support bigflix.com. It uses some sort of silverlight
plugin whose video url is being populated using base64 encoded
flashvars. So it is quite straightforward to extract.

8 years ago[canalc2] Fix extraction (Closes #8191)
Sergey M․ [Sat, 9 Jan 2016 19:37:10 +0000 (01:37 +0600)]
[canalc2] Fix extraction (Closes #8191)

8 years ago[xhamster] Remove unused import
Jaime Marquínez Ferrándiz [Sat, 9 Jan 2016 10:16:23 +0000 (11:16 +0100)]
[xhamster] Remove unused import

8 years agorelease 2016.01.09
Philipp Hagemeister [Sat, 9 Jan 2016 00:16:08 +0000 (01:16 +0100)]
release 2016.01.09

8 years ago[vimeo] Add test for #8187
Sergey M․ [Fri, 8 Jan 2016 21:07:29 +0000 (03:07 +0600)]
[vimeo] Add test for #8187

8 years ago[vimeo] Check source file URL (Closes #8187)
Sergey M․ [Fri, 8 Jan 2016 21:06:09 +0000 (03:06 +0600)]
[vimeo] Check source file URL (Closes #8187)

8 years ago[xhamster] Update tests
Sergey M․ [Fri, 8 Jan 2016 18:36:43 +0000 (00:36 +0600)]
[xhamster] Update tests

8 years ago[xhamster] Fix uploader extraction
Sergey M․ [Fri, 8 Jan 2016 18:36:19 +0000 (00:36 +0600)]
[xhamster] Fix uploader extraction

8 years ago[xhamster] Change title regex precedence
Sergey M․ [Fri, 8 Jan 2016 18:31:24 +0000 (00:31 +0600)]
[xhamster] Change title regex precedence

8 years ago[xhamster] Fix view count extraction
Sergey M․ [Fri, 8 Jan 2016 18:29:10 +0000 (00:29 +0600)]
[xhamster] Fix view count extraction

8 years ago[xhamster] Fix duration extraction
Sergey M․ [Fri, 8 Jan 2016 18:26:37 +0000 (00:26 +0600)]
[xhamster] Fix duration extraction

8 years ago[xhamster] Fix upload date extraction
Sergey M․ [Fri, 8 Jan 2016 18:21:57 +0000 (00:21 +0600)]
[xhamster] Fix upload date extraction

8 years ago[xhamster] Improve title extraction
Sergey M․ [Fri, 8 Jan 2016 18:19:36 +0000 (00:19 +0600)]
[xhamster] Improve title extraction

8 years agoMerge pull request #8182 from atomic83/patch-1
Sergey M [Fri, 8 Jan 2016 18:04:32 +0000 (23:04 +0500)]
Merge pull request #8182 from atomic83/patch-1

Extract xHamster title fix

8 years agoExtract xHamster title fix
atomic83 [Fri, 8 Jan 2016 11:58:05 +0000 (12:58 +0100)]
Extract xHamster title fix

8 years ago[vimeo] Automatically pickup full movie when rented (Closes #8171)
Sergey M․ [Fri, 8 Jan 2016 04:41:24 +0000 (10:41 +0600)]
[vimeo] Automatically pickup full movie when rented (Closes #8171)

8 years ago[ivideon] Add support for map bound URLs
Sergey M․ [Thu, 7 Jan 2016 23:11:23 +0000 (05:11 +0600)]
[ivideon] Add support for map bound URLs

8 years ago[adultswim] Skip georestricted hls (Closes #8168)
Sergey M․ [Thu, 7 Jan 2016 21:19:47 +0000 (03:19 +0600)]
[adultswim] Skip georestricted hls (Closes #8168)

8 years ago[soundcloud:likes] Adapt to API changes (Closes #8166)
Sergey M․ [Thu, 7 Jan 2016 19:54:31 +0000 (01:54 +0600)]
[soundcloud:likes] Adapt to API changes (Closes #8166)

8 years ago[youtube] Support expanding alternative format of links in description (Closes #8164)
Sergey M․ [Thu, 7 Jan 2016 18:52:55 +0000 (00:52 +0600)]
[youtube] Support expanding alternative format of links in description (Closes #8164)

8 years ago[ivideon] Add extractor
Sergey M․ [Thu, 7 Jan 2016 06:24:32 +0000 (12:24 +0600)]
[ivideon] Add extractor

8 years agocheck video_play_path and use xpath_text
oittaa [Thu, 7 Jan 2016 05:26:14 +0000 (07:26 +0200)]
check video_play_path and use xpath_text

"This check should take place earlier and should be more general if not video_url:. Same should be done for video_play_path. Also these fields better extracted with xpath_text."

Suggestions by @dstftw

8 years ago[npr] Fix extractor (Closes #7218)
Sergey M․ [Wed, 6 Jan 2016 19:57:36 +0000 (01:57 +0600)]
[npr] Fix extractor (Closes #7218)

8 years ago[npr] Add extractor
kaspi [Sun, 18 Oct 2015 03:27:03 +0000 (23:27 -0400)]
[npr] Add extractor

removed md5 from _TEST

moved from xml data to json

test

changed _TEST url to one that will not expire, so tests would not be failing

8 years ago[udemy] Fix non free course message
Sergey M․ [Tue, 5 Jan 2016 18:03:39 +0000 (00:03 +0600)]
[udemy] Fix non free course message

8 years ago[udemy] Detect non free courses (Closes #8138)
Sergey M․ [Tue, 5 Jan 2016 18:02:21 +0000 (00:02 +0600)]
[udemy] Detect non free courses (Closes #8138)

8 years ago[README.md] Clarify cookies usage
Sergey M [Mon, 4 Jan 2016 20:17:12 +0000 (02:17 +0600)]
[README.md] Clarify cookies usage

8 years ago[vrt] Prefix format ids
Sergey M․ [Mon, 4 Jan 2016 19:59:45 +0000 (01:59 +0600)]
[vrt] Prefix format ids

8 years ago[vrt] Extend _VALUD_URL
Sergey M․ [Mon, 4 Jan 2016 19:58:25 +0000 (01:58 +0600)]
[vrt] Extend _VALUD_URL

8 years ago[dramafever] Add test for custom episode title
Sergey M․ [Mon, 4 Jan 2016 19:41:18 +0000 (01:41 +0600)]
[dramafever] Add test for custom episode title

8 years ago[dramafever] Fix episode fallback
Sergey M․ [Mon, 4 Jan 2016 19:36:38 +0000 (01:36 +0600)]
[dramafever] Fix episode fallback

8 years ago[dramafever] Extract episode
Sergey M․ [Mon, 4 Jan 2016 19:28:48 +0000 (01:28 +0600)]
[dramafever] Extract episode

8 years ago[dramafever] Extract episode number
Sergey M․ [Mon, 4 Jan 2016 19:17:33 +0000 (01:17 +0600)]
[dramafever] Extract episode number

8 years ago[dramafever] Improve subtitles extraction (Closes #8136)
Sergey M․ [Mon, 4 Jan 2016 19:11:07 +0000 (01:11 +0600)]
[dramafever] Improve subtitles extraction (Closes #8136)

8 years ago[amp] Add missing subtitles to info dict
Sergey M․ [Mon, 4 Jan 2016 19:05:37 +0000 (01:05 +0600)]
[amp] Add missing subtitles to info dict

8 years ago[downloader/hls] Don't let ffmpeg read from stdin (#8139)
Jaime Marquínez Ferrándiz [Mon, 4 Jan 2016 17:35:31 +0000 (18:35 +0100)]
[downloader/hls] Don't let ffmpeg read from stdin (#8139)

If you run 'while read aurl ; do youtube-dl "${aurl}"; done < path_to_batch_file'  (batch_file contains one url per line that uses the hls downloader) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url

(This is the same problem that was fixed for the ffmpeg postprocessors in cffcbc02de504d84e1c2677bb525c00b03e04f53)

8 years ago[rte:radio] Extract timestamp
Sergey M․ [Sun, 3 Jan 2016 23:04:48 +0000 (05:04 +0600)]
[rte:radio] Extract timestamp

8 years ago[rte:radio] Simplify
Sergey M․ [Sun, 3 Jan 2016 23:01:32 +0000 (05:01 +0600)]
[rte:radio] Simplify

8 years ago[rte] PEP 8
Sergey M․ [Sun, 3 Jan 2016 22:49:13 +0000 (04:49 +0600)]
[rte] PEP 8

8 years agoMerge pull request #8063 from bpfoley/rteradio
Sergey M [Sun, 3 Jan 2016 22:33:22 +0000 (03:33 +0500)]
Merge pull request #8063 from bpfoley/rteradio

[rte:radio] Add support for RTE radio player

8 years agoCredit @bpfoley for rte:radio (#8063)
Sergey M․ [Sun, 3 Jan 2016 22:32:47 +0000 (04:32 +0600)]
Credit @bpfoley for rte:radio (#8063)

8 years ago[extractor/rte.py] Add support for RTE radio player
bpfoley [Wed, 30 Dec 2015 21:50:26 +0000 (21:50 +0000)]
[extractor/rte.py] Add support for RTE radio player

While here, stop RteIE changing filename extensions to .mp4. The files
saved are .flv containers with h264 video.

8 years ago[ivi] Extract season info
Sergey M․ [Sun, 3 Jan 2016 21:54:52 +0000 (03:54 +0600)]
[ivi] Extract season info

8 years ago[ivi:compilation] Fix extraction
Sergey M․ [Sun, 3 Jan 2016 21:49:18 +0000 (03:49 +0600)]
[ivi:compilation] Fix extraction

8 years ago[ivi] Fix extraction and modernize
Sergey M․ [Sun, 3 Jan 2016 21:34:15 +0000 (03:34 +0600)]
[ivi] Fix extraction and modernize

8 years ago[bbccouk] Update tests (Closes #8090)
Sergey M․ [Sun, 3 Jan 2016 20:55:25 +0000 (02:55 +0600)]
[bbccouk] Update tests (Closes #8090)

8 years ago[20min] Improve (Closes #8110)
Sergey M․ [Sun, 3 Jan 2016 20:33:08 +0000 (02:33 +0600)]
[20min] Improve (Closes #8110)

8 years ago[20min.ch] Added support for videoportal
pingtux [Sat, 2 Jan 2016 15:19:05 +0000 (16:19 +0100)]
[20min.ch] Added support for videoportal

8 years ago[20min.ch] Add new extractor (closes #5977)
pingtux [Sat, 2 Jan 2016 00:13:49 +0000 (01:13 +0100)]
[20min.ch] Add new extractor (closes #5977)

8 years ago[utils] Extract known extensions for reuse
Sergey M․ [Sun, 3 Jan 2016 19:08:34 +0000 (01:08 +0600)]
[utils] Extract known extensions for reuse

8 years ago[nowtv] Mark broken
Sergey M [Sun, 3 Jan 2016 05:12:13 +0000 (10:12 +0500)]
[nowtv] Mark broken

8 years agoMerge pull request #8061 from dstftw/introduce-chapter-and-series-fields
Sergey M [Sat, 2 Jan 2016 21:54:22 +0000 (03:54 +0600)]
Merge pull request #8061 from dstftw/introduce-chapter-and-series-fields

Introduce chapter and series fields

8 years ago[dreisat] use extract_from_xml_url from ZDFIE for info extraction(fixes #7680)(fixes...
remitamine [Sat, 2 Jan 2016 20:29:10 +0000 (21:29 +0100)]
[dreisat] use extract_from_xml_url from ZDFIE for info extraction(fixes #7680)(fixes #8104)(closes #8121)

8 years ago[zdf] fix rtmpt format downloading handle errors
remitamine [Sat, 2 Jan 2016 20:24:57 +0000 (21:24 +0100)]
[zdf] fix rtmpt format downloading handle errors

8 years ago[qqmusic] Update tests
Yen Chi Hsuan [Sat, 2 Jan 2016 14:39:09 +0000 (22:39 +0800)]
[qqmusic] Update tests

8 years ago[qqmusic:playlist] Capture errors and update tests
Yen Chi Hsuan [Sat, 2 Jan 2016 14:33:33 +0000 (22:33 +0800)]
[qqmusic:playlist] Capture errors and update tests

8 years agoMerge branch 'remitamine-baidu'
Yen Chi Hsuan [Sat, 2 Jan 2016 13:50:17 +0000 (21:50 +0800)]
Merge branch 'remitamine-baidu'

8 years ago[baidu] Use list comprehension
Yen Chi Hsuan [Sat, 2 Jan 2016 13:46:40 +0000 (21:46 +0800)]
[baidu] Use list comprehension

8 years ago[baidu] Add notes for API calls
Yen Chi Hsuan [Sat, 2 Jan 2016 13:44:49 +0000 (21:44 +0800)]
[baidu] Add notes for API calls