youtube-dl
8 years agoCredit @FounderSG for WeiqiTV and LetvCloud (#7994)
Yen Chi Hsuan [Wed, 20 Jan 2016 05:20:03 +0000 (13:20 +0800)]
Credit @FounderSG for WeiqiTV and LetvCloud (#7994)

[ci skip]

8 years ago[downloader/hls] Ask ffmpeg to quit when interrupting youtube-dl with 'Ctrl+C' (...
Jaime Marquínez Ferrándiz [Sat, 16 Jan 2016 20:51:25 +0000 (21:51 +0100)]
[downloader/hls] Ask ffmpeg to quit when interrupting youtube-dl with 'Ctrl+C' (#8252)

Otherwise the mp4 file can't be played.

8 years agoMerge branch 'ping-patch-8239'
Yen Chi Hsuan [Tue, 19 Jan 2016 20:22:25 +0000 (04:22 +0800)]
Merge branch 'ping-patch-8239'

8 years ago[neteasemusic] Use float_or_none
Yen Chi Hsuan [Tue, 19 Jan 2016 20:21:51 +0000 (04:21 +0800)]
[neteasemusic] Use float_or_none

8 years agoMerge branch 'patch-8239' of https://github.com/ping/youtube-dl into ping-patch-8239
Yen Chi Hsuan [Tue, 19 Jan 2016 20:15:46 +0000 (04:15 +0800)]
Merge branch 'patch-8239' of https://github.com/ping/youtube-dl into ping-patch-8239

8 years agoMerge branch 'FounderSG-Weiqitv'
Yen Chi Hsuan [Tue, 19 Jan 2016 20:06:09 +0000 (04:06 +0800)]
Merge branch 'FounderSG-Weiqitv'

8 years ago[weiqitv] Use single quotes
Yen Chi Hsuan [Tue, 19 Jan 2016 20:04:39 +0000 (04:04 +0800)]
[weiqitv] Use single quotes

8 years ago[weiqitv] Rename the extractor - capitilize 'TV'
Yen Chi Hsuan [Tue, 19 Jan 2016 20:03:57 +0000 (04:03 +0800)]
[weiqitv] Rename the extractor - capitilize 'TV'

8 years ago[weiqitv] Make codes shorter
Yen Chi Hsuan [Tue, 19 Jan 2016 20:02:30 +0000 (04:02 +0800)]
[weiqitv] Make codes shorter

8 years ago[letv] LetvCloud: Detect ext instead of the hardcoded one
Yen Chi Hsuan [Tue, 19 Jan 2016 20:00:37 +0000 (04:00 +0800)]
[letv] LetvCloud: Detect ext instead of the hardcoded one

8 years ago[letv] LetvCloud: make title looks like a title
Yen Chi Hsuan [Tue, 19 Jan 2016 19:53:17 +0000 (03:53 +0800)]
[letv] LetvCloud: make title looks like a title

8 years ago[letv] LetvCloud: simplify and improve _VALID_URL
Yen Chi Hsuan [Tue, 19 Jan 2016 19:39:45 +0000 (03:39 +0800)]
[letv] LetvCloud: simplify and improve _VALID_URL

8 years ago[letv] LetvCloud: check error messages from server
Yen Chi Hsuan [Tue, 19 Jan 2016 19:31:34 +0000 (03:31 +0800)]
[letv] LetvCloud: check error messages from server

8 years ago[letv] LetvCloud: guard against invalid URLs
Yen Chi Hsuan [Tue, 19 Jan 2016 19:25:12 +0000 (03:25 +0800)]
[letv] LetvCloud: guard against invalid URLs

8 years ago[letv] Use single quotes
Yen Chi Hsuan [Tue, 19 Jan 2016 19:18:54 +0000 (03:18 +0800)]
[letv] Use single quotes

8 years ago[letv] Reduce duplicated codes
Yen Chi Hsuan [Tue, 19 Jan 2016 19:17:35 +0000 (03:17 +0800)]
[letv] Reduce duplicated codes

8 years ago[viewster] Tolerate missing synopsis (Closes #8274)
Sergey M․ [Tue, 19 Jan 2016 18:02:46 +0000 (00:02 +0600)]
[viewster] Tolerate missing synopsis (Closes #8274)

8 years ago[lemonde] Add extractor
Sergey M․ [Tue, 19 Jan 2016 16:09:55 +0000 (22:09 +0600)]
[lemonde] Add extractor

8 years ago[ultimedia] Rename to digiteka
Sergey M․ [Tue, 19 Jan 2016 15:51:46 +0000 (21:51 +0600)]
[ultimedia] Rename to digiteka

8 years ago[ultimedia] Extend _VALID_URL to support digiteka
Sergey M․ [Tue, 19 Jan 2016 15:47:06 +0000 (21:47 +0600)]
[ultimedia] Extend _VALID_URL to support digiteka

8 years agoMerge branch 'Weiqitv' of https://github.com/FounderSG/youtube-dl into FounderSG...
Yen Chi Hsuan [Tue, 19 Jan 2016 15:39:32 +0000 (23:39 +0800)]
Merge branch 'Weiqitv' of https://github.com/FounderSG/youtube-dl into FounderSG-Weiqitv

8 years ago[extractor/generic] Extend dailymotion embed regex
Sergey M․ [Tue, 19 Jan 2016 15:20:45 +0000 (21:20 +0600)]
[extractor/generic] Extend dailymotion embed regex

8 years ago[dailymotion] Extend _VALID_URL
Sergey M․ [Tue, 19 Jan 2016 15:20:14 +0000 (21:20 +0600)]
[dailymotion] Extend _VALID_URL

8 years ago[youtube] Skip test
Sergey M․ [Tue, 19 Jan 2016 14:56:04 +0000 (20:56 +0600)]
[youtube] Skip test

8 years ago[youtube] Capture and output unavailable message
Sergey M․ [Tue, 19 Jan 2016 14:54:43 +0000 (20:54 +0600)]
[youtube] Capture and output unavailable message

8 years ago[youtube] Clarify test_Youtube_18
Sergey M․ [Mon, 18 Jan 2016 17:19:38 +0000 (23:19 +0600)]
[youtube] Clarify test_Youtube_18

8 years ago[youtube] Fix URL expansion in video description
Sergey M․ [Mon, 18 Jan 2016 17:17:45 +0000 (23:17 +0600)]
[youtube] Fix URL expansion in video description

Fixes test_Youtube_18

8 years ago[atresplayer] Skip HLS completely (Closes #8261)
Sergey M․ [Sun, 17 Jan 2016 16:14:07 +0000 (22:14 +0600)]
[atresplayer] Skip HLS completely (Closes #8261)

8 years agoMerge pull request #8262 from jwilk/https-everywhere
Yen Chi Hsuan [Sun, 17 Jan 2016 14:10:03 +0000 (22:10 +0800)]
Merge pull request #8262 from jwilk/https-everywhere

[ustream] Use HTTPS for GitHub URL

8 years ago[ustream] Use HTTPS for GitHub URL
Jakub Wilk [Sun, 17 Jan 2016 14:06:00 +0000 (15:06 +0100)]
[ustream] Use HTTPS for GitHub URL

8 years ago[neteasemusic] Fallback to alt hosts if m5.music.126.net doesn't work
ping [Sat, 16 Jan 2016 23:48:46 +0000 (07:48 +0800)]
[neteasemusic] Fallback to alt hosts if m5.music.126.net doesn't work

8 years ago[ae] Rename to aenetworks and clarify extractor name and description
Sergey M․ [Sat, 16 Jan 2016 21:02:45 +0000 (03:02 +0600)]
[ae] Rename to aenetworks and clarify extractor name and description

8 years ago[compat] Clarify the versions requiring compat_kwargs
Yen Chi Hsuan [Sat, 16 Jan 2016 14:17:31 +0000 (22:17 +0800)]
[compat] Clarify the versions requiring compat_kwargs

It's supported since 2.7.0 alpha 1 and 2.6.5 rc 1. See
https://hg.python.org/cpython/file/v2.7a1/Misc/NEWS#l337
https://hg.python.org/cpython/file/v2.6.5rc1/Misc/NEWS#l28

8 years ago[ae] Fix _TESTS
Yen Chi Hsuan [Sat, 16 Jan 2016 12:56:53 +0000 (20:56 +0800)]
[ae] Fix _TESTS

8 years ago[bbc] Use _search_json_ld
Yen Chi Hsuan [Sat, 16 Jan 2016 12:46:28 +0000 (20:46 +0800)]
[bbc] Use _search_json_ld

8 years ago[extractor/common] Allow passing more parameters to _search_json_ld
Yen Chi Hsuan [Sat, 16 Jan 2016 12:45:36 +0000 (20:45 +0800)]
[extractor/common] Allow passing more parameters to _search_json_ld

8 years agoFixes #8239
ping [Sat, 16 Jan 2016 04:17:07 +0000 (12:17 +0800)]
Fixes #8239

8 years ago[README.md] Add protocol usage example in format selection
Sergey M [Sat, 16 Jan 2016 04:15:24 +0000 (10:15 +0600)]
[README.md] Add protocol usage example in format selection

8 years ago[YoutubeDL] Ensure protocol is always present
Sergey M․ [Sat, 16 Jan 2016 04:10:28 +0000 (10:10 +0600)]
[YoutubeDL] Ensure protocol is always present

8 years ago[README.md] Improve format selection documentation
Sergey M [Sat, 16 Jan 2016 03:49:54 +0000 (09:49 +0600)]
[README.md] Improve format selection documentation

8 years ago[README.md] Mention new string operators for format selection
Sergey M [Sat, 16 Jan 2016 01:31:14 +0000 (07:31 +0600)]
[README.md] Mention new string operators for format selection

8 years ago[YoutubeDL] Introduce CSS3 like string operators
Yen Chi Hsuan [Wed, 13 Jan 2016 08:24:48 +0000 (16:24 +0800)]
[YoutubeDL] Introduce CSS3 like string operators

8 years agoMerge pull request #8246 from dstftw/initial-json-ld-metadata-support
Sergey M [Sat, 16 Jan 2016 01:20:15 +0000 (07:20 +0600)]
Merge pull request #8246 from dstftw/initial-json-ld-metadata-support

Initial JSON-LD metadata extraction support

8 years agoMerge pull request #8245 from dstftw/auto-generate-title-fields
Sergey M [Sat, 16 Jan 2016 01:20:03 +0000 (07:20 +0600)]
Merge pull request #8245 from dstftw/auto-generate-title-fields

[YoutubeDL] Auto generate title fields corresponding to the *_number fields

8 years ago[cultureunplugged] Improve (Closes #8060)
Sergey M․ [Sat, 16 Jan 2016 01:10:51 +0000 (07:10 +0600)]
[cultureunplugged] Improve (Closes #8060)

8 years ago[zippcast] Improve (Closes #8198)
Sergey M․ [Sat, 16 Jan 2016 00:25:25 +0000 (06:25 +0600)]
[zippcast] Improve (Closes #8198)

8 years ago'[ZippCast] Add new extractor'
ckuu [Sun, 10 Jan 2016 11:20:59 +0000 (15:20 +0400)]
'[ZippCast] Add new extractor'
Closes rg3/youtube-dl#6591

8 years agorelease 2016.01.15
Philipp Hagemeister [Fri, 15 Jan 2016 18:43:04 +0000 (19:43 +0100)]
release 2016.01.15

8 years ago[ae] Use JSON-LD for TV series metadata
Sergey M․ [Fri, 15 Jan 2016 18:36:49 +0000 (00:36 +0600)]
[ae] Use JSON-LD for TV series metadata

8 years ago[extractor/common] Add initial support for JSON-LD metadata extraction into info_dict
Sergey M․ [Fri, 15 Jan 2016 18:36:02 +0000 (00:36 +0600)]
[extractor/common] Add initial support for JSON-LD metadata extraction into info_dict

8 years ago[YoutubeDL] Auto generate title fields corresponding to the *_number fields
Sergey M․ [Fri, 15 Jan 2016 18:09:54 +0000 (00:09 +0600)]
[YoutubeDL] Auto generate title fields corresponding to the *_number fields

Auto generate title fields corresponding to the *_number fields when missing in order to always have clean titles. This is very common for TV series.

8 years ago[cwtv] Add new extractor
remitamine [Fri, 15 Jan 2016 16:45:51 +0000 (17:45 +0100)]
[cwtv] Add new extractor

8 years ago[ae] Improve _VALID_URL
Sergey M․ [Fri, 15 Jan 2016 16:13:48 +0000 (22:13 +0600)]
[ae] Improve _VALID_URL

8 years ago[ae] Add extractor import
Sergey M․ [Fri, 15 Jan 2016 16:12:51 +0000 (22:12 +0600)]
[ae] Add extractor import

8 years ago[history] Remove import (Closes #8243)
Sergey M․ [Fri, 15 Jan 2016 16:10:07 +0000 (22:10 +0600)]
[history] Remove import (Closes #8243)

8 years ago[xtube:user] Fix extraction (Closes #8224)
Sergey M․ [Fri, 15 Jan 2016 15:35:20 +0000 (21:35 +0600)]
[xtube:user] Fix extraction (Closes #8224)

8 years ago[xtube] Add shortcut
Sergey M․ [Fri, 15 Jan 2016 15:28:36 +0000 (21:28 +0600)]
[xtube] Add shortcut

8 years ago[ae] Add support for fyi.tv, aetv.com and mylifetime.com(closes #3599)
remitamine [Fri, 15 Jan 2016 15:18:07 +0000 (16:18 +0100)]
[ae] Add support for fyi.tv, aetv.com and mylifetime.com(closes #3599)

8 years ago[history] add support for episode pages(fixes #8240)
remitamine [Fri, 15 Jan 2016 14:16:57 +0000 (15:16 +0100)]
[history] add support for episode pages(fixes #8240)

8 years ago[theplatform] extend _VALID_URL regex
remitamine [Fri, 15 Jan 2016 14:12:35 +0000 (15:12 +0100)]
[theplatform] extend _VALID_URL regex

8 years agoRevert "[history] fix signature and media url extraction(fixes #8240)"
remitamine [Fri, 15 Jan 2016 13:54:39 +0000 (14:54 +0100)]
Revert "[history] fix signature and media url extraction(fixes #8240)"

This reverts commit ffbc0baf72f456b1f4f4ac989e4a7b75b69c7a54.

8 years ago[history] fix signature and media url extraction(fixes #8240)
remitamine [Fri, 15 Jan 2016 11:34:28 +0000 (12:34 +0100)]
[history] fix signature and media url extraction(fixes #8240)

8 years agoMerge pull request #8228 from jaimeMF/disable-file-handler
Sergey M [Thu, 14 Jan 2016 17:20:02 +0000 (22:20 +0500)]
Merge pull request #8228 from jaimeMF/disable-file-handler

[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

8 years agoCredit @TomGijselinck for canvas (#7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:26 +0000 (23:15 +0600)]
Credit @TomGijselinck for canvas (#7145)

8 years ago[canvas] Improve (Closes #7145)
Sergey M․ [Thu, 14 Jan 2016 17:15:12 +0000 (23:15 +0600)]
[canvas] Improve (Closes #7145)

8 years ago[Canvas] Add new extractor
Tom Gijselinck [Mon, 12 Oct 2015 07:07:18 +0000 (09:07 +0200)]
[Canvas] Add new extractor

8 years ago[prosiebensat1] Fix some extraction and update tests
Sergey M․ [Thu, 14 Jan 2016 16:45:09 +0000 (22:45 +0600)]
[prosiebensat1] Fix some extraction and update tests

8 years ago[prosiebensat1] add support for 7tv.de
Lucas [Wed, 13 Jan 2016 15:11:49 +0000 (16:11 +0100)]
[prosiebensat1] add support for 7tv.de

8 years ago[ntvde] Improve regex
Sergey M․ [Thu, 14 Jan 2016 16:12:24 +0000 (22:12 +0600)]
[ntvde] Improve regex

8 years ago[orf:fm4] Add test
Sergey M․ [Thu, 14 Jan 2016 16:11:33 +0000 (22:11 +0600)]
[orf:fm4] Add test

8 years ago[orf:fm4] Extend _VALID_URL (Closes #8234)
Sergey M․ [Thu, 14 Jan 2016 16:07:42 +0000 (22:07 +0600)]
[orf:fm4] Extend _VALID_URL (Closes #8234)

8 years ago[ntvde] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 16:05:04 +0000 (22:05 +0600)]
[ntvde] Fix extraction

8 years ago[unistra] Fix extraction
Sergey M․ [Thu, 14 Jan 2016 15:53:24 +0000 (21:53 +0600)]
[unistra] Fix extraction

8 years ago[vodlocker] Fix extraction (Closes #8231)
Sergey M․ [Thu, 14 Jan 2016 15:48:08 +0000 (21:48 +0600)]
[vodlocker] Fix extraction (Closes #8231)

8 years ago[YoutubeDL] use a more correct terminology in the error message for file:// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 15:28:46 +0000 (16:28 +0100)]
[YoutubeDL] use a more correct terminology in the error message for file:// URLs

8 years agorelease 2016.01.14
Philipp Hagemeister [Thu, 14 Jan 2016 14:43:21 +0000 (15:43 +0100)]
release 2016.01.14

8 years ago[beeg] Update API URL
Sergey M․ [Thu, 14 Jan 2016 13:57:56 +0000 (19:57 +0600)]
[beeg] Update API URL

8 years ago[beeg] Fix extraction (Closes #8225)
Sergey M․ [Thu, 14 Jan 2016 13:57:20 +0000 (19:57 +0600)]
[beeg] Fix extraction (Closes #8225)

8 years ago[YoutubeDL] improve error message for file:/// URLs
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 13:07:54 +0000 (14:07 +0100)]
[YoutubeDL] improve error message for file:/// URLs

8 years ago[YoutubeDL] urlopen: use build_opener again
Jaime Marquínez Ferrándiz [Thu, 14 Jan 2016 07:14:01 +0000 (08:14 +0100)]
[YoutubeDL] urlopen: use build_opener again

Otherwise we would need to manually add handlers like HTTPRedirectHandler, instead we add a customized FileHandler instance that raises an error.

8 years ago[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)
Jaime Marquínez Ferrándiz [Wed, 13 Jan 2016 23:16:23 +0000 (00:16 +0100)]
[YoutubeDL] urlopen: disable the 'file:' protocol (#8227)

If someone is running youtube-dl on a server to deliver files, the user could input 'file:///some/important/file' and youtube-dl would save that file as a video giving access to sensitive information to the user.
'file:' urls can be filtered, but the user can use an URL to a crafted m3u8 manifest like:

    #EXTM3U
    #EXT-X-MEDIA-SEQUENCE:0
    #EXTINF:10.0
    file:///etc/passwd
    #EXT-X-ENDLIST

With this patch 'file:' URLs raise URLError like for unknown protocols.

8 years ago[tudou] Add support for Albums and Playlists and extract more metadata
remitamine [Wed, 13 Jan 2016 12:29:00 +0000 (13:29 +0100)]
[tudou] Add support for Albums and Playlists and extract more metadata

8 years ago[youtube] Fix acodec and vcodec order
Yen Chi Hsuan [Wed, 13 Jan 2016 09:05:38 +0000 (17:05 +0800)]
[youtube] Fix acodec and vcodec order

In RFC6381, there's no rule stating that the first part of codecs should
be video and the second part should be audio, while it seems the case
for data reported by YouTube.

8 years ago[pluralsight] Fix new player (Closes #8215)
Sergey M․ [Wed, 13 Jan 2016 02:18:37 +0000 (08:18 +0600)]
[pluralsight] Fix new player (Closes #8215)

8 years ago[downloader/fragment] Move helper data to context dict
Sergey M․ [Tue, 12 Jan 2016 18:00:31 +0000 (00:00 +0600)]
[downloader/fragment] Move helper data to context dict

8 years ago[dailymotion] Prefer direct links (Closes #8156)
Sergey M․ [Tue, 12 Jan 2016 17:23:39 +0000 (23:23 +0600)]
[dailymotion] Prefer direct links (Closes #8156)

8 years ago[downloader/fragment] More smooth calculations
Sergey M․ [Tue, 12 Jan 2016 17:18:38 +0000 (23:18 +0600)]
[downloader/fragment] More smooth calculations

`downloaded_bytes` is now updated on each fragment progress hook invocation

8 years ago[downloader/fragment] Remove unused code and fix zero division error
Sergey M․ [Tue, 12 Jan 2016 16:09:38 +0000 (22:09 +0600)]
[downloader/fragment] Remove unused code and fix zero division error

8 years ago[iprima] Mark broken
Sergey M․ [Mon, 11 Jan 2016 16:00:17 +0000 (22:00 +0600)]
[iprima] Mark broken

8 years ago[videott] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:58:32 +0000 (21:58 +0600)]
[videott] Mark broken

8 years ago[videomega] Mark broken
Sergey M․ [Mon, 11 Jan 2016 15:56:19 +0000 (21:56 +0600)]
[videomega] Mark broken

8 years agoRevert "fix typos"
remitamine [Sun, 10 Jan 2016 18:27:22 +0000 (19:27 +0100)]
Revert "fix typos"

This reverts commit 36a0e46c39ea4f211dea9944177976e8f8364736.

8 years agofix typos
remitamine [Sun, 10 Jan 2016 16:55:41 +0000 (17:55 +0100)]
fix typos

8 years agoFix typos
Jakub Wilk [Sun, 10 Jan 2016 15:17:47 +0000 (16:17 +0100)]
Fix typos

Closes #8200.

8 years ago[downloader/fragment] Don't fail if the 'Content-Length' header is missing
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:32:53 +0000 (14:32 +0100)]
[downloader/fragment] Don't fail if the 'Content-Length' header is missing

In some dailymotion videos (like http://www.dailymotion.com/video/x3k0dtv from #8156) the segments URLs don't have the 'Content-Length' header and HttpFD sets the 'totat_bytes' field to None, so we also use '0' in that case (since we do different math operations with it).

8 years ago[bigflix] Use correct indentation to make flake8 happy
Jaime Marquínez Ferrándiz [Sun, 10 Jan 2016 13:26:27 +0000 (14:26 +0100)]
[bigflix] Use correct indentation to make flake8 happy

8 years ago[shahid] raise ExtractorError if the video is DRM protected
remitamine [Sun, 10 Jan 2016 06:55:58 +0000 (07:55 +0100)]
[shahid] raise ExtractorError if the video is DRM protected

8 years ago[dcn] extract video ids in season entries
remitamine [Sun, 10 Jan 2016 06:45:41 +0000 (07:45 +0100)]
[dcn] extract video ids in season entries

8 years ago[bigflix] Improve formats extraction
Sergey M․ [Sun, 10 Jan 2016 04:49:27 +0000 (10:49 +0600)]
[bigflix] Improve formats extraction

8 years ago[bigflix] Extract all formats
Sergey M․ [Sun, 10 Jan 2016 04:31:36 +0000 (10:31 +0600)]
[bigflix] Extract all formats