Sergey M․ [Sat, 26 Mar 2016 13:33:57 +0000 (19:33 +0600)]
[utils] Extract sanitize_url routine
Sergey M․ [Sat, 26 Mar 2016 13:15:32 +0000 (19:15 +0600)]
[mailru] Extend _VALID_URL (Closes #8990)
Yen Chi Hsuan [Sat, 26 Mar 2016 10:34:51 +0000 (18:34 +0800)]
[twitter] Fix extraction (closes #8966)
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
Yen Chi Hsuan [Sat, 26 Mar 2016 10:30:43 +0000 (18:30 +0800)]
[generic] Add a test case for brightcove embed
Closes #8862
Yen Chi Hsuan [Sat, 26 Mar 2016 10:21:07 +0000 (18:21 +0800)]
[brightcove] Extract more formats (#8862)
Yen Chi Hsuan [Fri, 25 Mar 2016 08:17:54 +0000 (16:17 +0800)]
[brightcove] Support alternative BrightcoveExperience layout
The full URL lays in the `data` attribute of <object> (#8862)
Philipp Hagemeister [Sat, 26 Mar 2016 07:58:03 +0000 (08:58 +0100)]
release 2016.03.26
Sergey M․ [Fri, 25 Mar 2016 20:38:33 +0000 (02:38 +0600)]
[test_compat] Add tests for compat_urllib_parse_urlencode
Sergey M․ [Fri, 25 Mar 2016 20:19:24 +0000 (02:19 +0600)]
Use urlencode_postdata across the codebase
Sergey M․ [Fri, 25 Mar 2016 19:46:57 +0000 (01:46 +0600)]
[compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode
Closes #8974
Sergey M․ [Fri, 25 Mar 2016 14:14:34 +0000 (20:14 +0600)]
[thescene] Fix extraction and improve style (Closes #8978)
Sergey M․ [Fri, 25 Mar 2016 13:51:28 +0000 (19:51 +0600)]
[once] Relax _VALID_URL (Closes #8976)
Philipp Hagemeister [Fri, 25 Mar 2016 08:27:18 +0000 (09:27 +0100)]
release 2016.03.25
Yen Chi Hsuan [Fri, 25 Mar 2016 07:45:40 +0000 (15:45 +0800)]
[iqiyi] Update enc_key
Yen Chi Hsuan [Fri, 25 Mar 2016 07:43:29 +0000 (15:43 +0800)]
[douyutv] Extend _VALID_URL
Sergey M․ [Thu, 24 Mar 2016 21:56:27 +0000 (03:56 +0600)]
Credit @Kagami for mnet (#8958)
Sergey M․ [Thu, 24 Mar 2016 21:26:29 +0000 (03:26 +0600)]
[mnet] Improve (Closes #8958)
Kagami Hiiragi [Thu, 24 Mar 2016 10:55:02 +0000 (13:55 +0300)]
[mnet] Add new extractor
Sergey M․ [Thu, 24 Mar 2016 20:28:39 +0000 (02:28 +0600)]
[udemy] Add support for new URL schema
Sergey M․ [Thu, 24 Mar 2016 20:27:13 +0000 (02:27 +0600)]
[udemy] Extract formats from outputs
Sergey M․ [Thu, 24 Mar 2016 20:26:46 +0000 (02:26 +0600)]
[udemy] Improve course enrolling
Sergey M․ [Thu, 24 Mar 2016 19:39:25 +0000 (01:39 +0600)]
[extractor/__init__] Add youtube:live and sort youtube extractors alphabetically
Sergey M․ [Thu, 24 Mar 2016 19:18:14 +0000 (01:18 +0600)]
[youtube:live] Add extractor (Closes #8959)
Sergey M․ [Thu, 24 Mar 2016 17:28:24 +0000 (23:28 +0600)]
[nytimes] Tolerate missing metadata (Closes #8952)
Sergey M․ [Thu, 24 Mar 2016 16:54:26 +0000 (22:54 +0600)]
[iprima] Fix extraction (Closes #8953)
Sergey M․ [Thu, 24 Mar 2016 16:23:31 +0000 (22:23 +0600)]
[mtv] Fix description extraction (Closes #8962)
Yen Chi Hsuan [Thu, 24 Mar 2016 10:06:15 +0000 (18:06 +0800)]
[utils] Clarify Python versions affected by buggy struct module
Yen Chi Hsuan [Thu, 24 Mar 2016 08:32:53 +0000 (16:32 +0800)]
[tumblr] Add a test with Instagram embed
Closes #8817
Yen Chi Hsuan [Thu, 24 Mar 2016 08:32:27 +0000 (16:32 +0800)]
[generic] Extract Instagram embeds (#8817)
Yen Chi Hsuan [Thu, 24 Mar 2016 08:30:01 +0000 (16:30 +0800)]
[instagram] Unescape description (#8817)
Yen Chi Hsuan [Thu, 24 Mar 2016 08:29:33 +0000 (16:29 +0800)]
[instagram] Extract embed videos (#8817)
Yen Chi Hsuan [Wed, 23 Mar 2016 15:55:52 +0000 (23:55 +0800)]
[tumblr] Support Vine embeds (#8817)
Yen Chi Hsuan [Wed, 23 Mar 2016 15:55:08 +0000 (23:55 +0800)]
[generic] Support Vine embeds (#8817)
Yen Chi Hsuan [Wed, 23 Mar 2016 15:23:26 +0000 (23:23 +0800)]
[test/test_utils] Update for escape_url change (again)
Yen Chi Hsuan [Wed, 23 Mar 2016 15:20:28 +0000 (23:20 +0800)]
[test/test_utils] Update for escape_url change
Sergey M [Wed, 23 Mar 2016 15:12:32 +0000 (20:12 +0500)]
Merge pull request #8898 from dstftw/fragment-retries
Add --fragment-retries option (Fixes #8466)
Sergey M․ [Wed, 23 Mar 2016 14:45:39 +0000 (20:45 +0600)]
[tunein] Fix stream data extraction (Closes #8899, closes #8924)
Yen Chi Hsuan [Wed, 23 Mar 2016 14:24:52 +0000 (22:24 +0800)]
[utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError
Fixes #8890
Jaime Marquínez Ferrándiz [Tue, 22 Mar 2016 21:17:59 +0000 (22:17 +0100)]
Add extractor for thescene.com (closes #8929)
Sergey M․ [Tue, 22 Mar 2016 17:48:05 +0000 (23:48 +0600)]
[once] Prevent ads from embedding into m3u8 playlists (Closes #8893)
Sergey M․ [Tue, 22 Mar 2016 16:32:59 +0000 (22:32 +0600)]
[laola1tv] Add support for livestreams (Closes #8934)
Sergey M․ [Tue, 22 Mar 2016 15:12:29 +0000 (21:12 +0600)]
[ceskatelevize] Make m3u8 formats extraction non fatal (Closes #8933)
Sergey M․ [Mon, 21 Mar 2016 17:37:39 +0000 (23:37 +0600)]
[animeondemand] Skip dash for now
Sergey M․ [Mon, 21 Mar 2016 17:35:50 +0000 (23:35 +0600)]
[animeondemand] Extract teaser when no full episode available (#8923)
Sergey M․ [Mon, 21 Mar 2016 17:31:40 +0000 (23:31 +0600)]
[animeondemand] Respect startvideo (Closes #8923)
Sergey M․ [Mon, 21 Mar 2016 16:24:42 +0000 (22:24 +0600)]
[motherless] Detect friends only videos
Sergey M․ [Mon, 21 Mar 2016 16:07:34 +0000 (22:07 +0600)]
[xhamster:embed] Extract vars (Closes #8912)
Sergey M․ [Mon, 21 Mar 2016 15:46:49 +0000 (21:46 +0600)]
[rutv] Improve flash version pattern (Closes #8911)
Sergey M․ [Mon, 21 Mar 2016 15:36:32 +0000 (21:36 +0600)]
Add support for https for all extractors as preventive and future-proof measure
Sergey M․ [Mon, 21 Mar 2016 15:22:37 +0000 (21:22 +0600)]
Add missing r prefix for _VALID_URLs
Sergey M․ [Mon, 21 Mar 2016 15:17:29 +0000 (21:17 +0600)]
[mailru] Add support for https (Closes #8920)
Sergey M․ [Sun, 20 Mar 2016 16:01:45 +0000 (22:01 +0600)]
[YoutubeDL] Improve _format_note
Sergey M․ [Sun, 20 Mar 2016 15:51:22 +0000 (21:51 +0600)]
[animeondemand] Extract all formats (Closes #8906)
Sergey M․ [Sun, 20 Mar 2016 14:39:00 +0000 (20:39 +0600)]
[animeondemand] Detect geo restriction
Yen Chi Hsuan [Sun, 20 Mar 2016 12:17:56 +0000 (20:17 +0800)]
[kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms
Yen Chi Hsuan [Sun, 20 Mar 2016 11:11:02 +0000 (19:11 +0800)]
Credit @vitstradal for the key algorithm in OpenloadIE (#8489)
[ci skip]
Yen Chi Hsuan [Sun, 20 Mar 2016 10:14:02 +0000 (18:14 +0800)]
[vlive] Fix creator extraction (closes #8814)
Jaime Marquínez Ferrándiz [Sun, 20 Mar 2016 09:55:14 +0000 (10:55 +0100)]
README: document that BSD make is also supported (#8902)
Yen Chi Hsuan [Sun, 20 Mar 2016 08:49:44 +0000 (16:49 +0800)]
[openload] Misc improvements
* Add thumbnail
* Detect errors (#6469)
* Match more (#6469, #8489)
Yen Chi Hsuan [Sun, 20 Mar 2016 07:54:58 +0000 (15:54 +0800)]
[openload] Add new extractor (closes #8489)
Yen Chi Hsuan [Sun, 20 Mar 2016 07:45:31 +0000 (15:45 +0800)]
[tudou] Use InAdvancePagedList (closes #8884)
Sergey M․ [Sun, 20 Mar 2016 07:00:46 +0000 (13:00 +0600)]
[francetv] Improve formats extraction
Sergey M․ [Sun, 20 Mar 2016 06:44:04 +0000 (12:44 +0600)]
[francetvinfo] Add support for france3-regions and strip title (Closes #7673)
Sergey M [Sun, 20 Mar 2016 06:08:57 +0000 (11:08 +0500)]
Merge pull request #8902 from jaimeMF/bmake
Makefile: make it compatible with bmake
Sergey M․ [Sun, 20 Mar 2016 04:26:58 +0000 (10:26 +0600)]
[discovery] Relax _VALID_URL (Closes #8903)
Sergey M․ [Sat, 19 Mar 2016 22:12:34 +0000 (04:12 +0600)]
[postprocessort/ffmpeg] Allow embedding webvtt into webm (Closes #8874)
Jaime Marquínez Ferrándiz [Sat, 19 Mar 2016 20:51:13 +0000 (21:51 +0100)]
Makefile: make it compatible with bmake
It's the portable version of BSD make: http://crufty.net/help/sjg/bmake.html
The syntax for conditionals is different in GNU make and BSD make, so we use the shell
Jaime Marquínez Ferrándiz [Sat, 19 Mar 2016 20:50:16 +0000 (21:50 +0100)]
tox.ini: Exclude test_iqiyi_sdk_interpreter.py
Sergey M․ [Sat, 19 Mar 2016 20:35:48 +0000 (02:35 +0600)]
[91porn] Use common messages' wording
Sergey M․ [Sat, 19 Mar 2016 20:34:02 +0000 (02:34 +0600)]
[91porn] Unquote final URL (Closes #8881)
Sergey M․ [Sat, 19 Mar 2016 19:36:20 +0000 (01:36 +0600)]
Credit @jjatria for biobiochiletv (#7314)
Sergey M․ [Sat, 19 Mar 2016 19:31:55 +0000 (01:31 +0600)]
[biobiochiletv] Fix extraction, extract m3u8 formats and overall improve (Closes #7314)
jjatria [Wed, 28 Oct 2015 18:31:52 +0000 (18:31 +0000)]
[biobiotv] Add extractor
Sergey M․ [Sat, 19 Mar 2016 17:18:04 +0000 (23:18 +0600)]
Credit @kasper93 for cda (#8805)
Sergey M․ [Sat, 19 Mar 2016 17:17:14 +0000 (23:17 +0600)]
[cda] Improve and simplify (Closes #8805)
Kacper Michajłow [Wed, 9 Mar 2016 19:55:27 +0000 (20:55 +0100)]
[cda] Add new extractor for cda.pl
Fixes #8760
Sergey M․ [Sat, 19 Mar 2016 16:30:48 +0000 (22:30 +0600)]
[safari:api] Separate extractor (Closes #8871)
Sergey M․ [Sat, 19 Mar 2016 14:54:21 +0000 (20:54 +0600)]
[downloader/fragment] Document fragment_retries
Sergey M․ [Sat, 19 Mar 2016 14:51:30 +0000 (20:51 +0600)]
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
Sergey M․ [Sat, 19 Mar 2016 14:42:23 +0000 (20:42 +0600)]
[downloader/dash] Add fragment retry capability
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
Sergey M․ [Sat, 19 Mar 2016 14:41:24 +0000 (20:41 +0600)]
[downloader/fragment] Add report_retry_fragment
Sergey M․ [Sat, 19 Mar 2016 14:40:36 +0000 (20:40 +0600)]
[options] Add --fragment-retries option
Jaime Marquínez Ferrándiz [Sat, 19 Mar 2016 10:42:35 +0000 (11:42 +0100)]
[utils] lookup_unit_table: Match word boundary instead of end of string
Sergey M․ [Fri, 18 Mar 2016 23:43:43 +0000 (05:43 +0600)]
[extractor/generic] Fix missing byte literal prefix
remitamine [Fri, 18 Mar 2016 20:17:45 +0000 (21:17 +0100)]
[hbo] Add new extractor
Jaime Marquínez Ferrándiz [Fri, 18 Mar 2016 18:18:55 +0000 (19:18 +0100)]
utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
Sergey M․ [Fri, 18 Mar 2016 18:04:26 +0000 (00:04 +0600)]
[test_YoutubeDL] Add test for format_id format selection
John Peel [Fri, 18 Mar 2016 07:33:03 +0000 (00:33 -0700)]
Added format_id to the filers on -f.
Sergey M․ [Fri, 18 Mar 2016 17:42:15 +0000 (23:42 +0600)]
[commonprotocols] Add generic support for rtmp URLs (Closes #8488)
Sergey M․ [Fri, 18 Mar 2016 16:49:11 +0000 (22:49 +0600)]
[extractor/generic] Add a test for m3u playlist served without proper Content-Type
Sergey M․ [Fri, 18 Mar 2016 16:45:28 +0000 (22:45 +0600)]
[extractor/generic] Detect m3u playlists served without proper Content-Type
Sergey M․ [Fri, 18 Mar 2016 16:43:07 +0000 (22:43 +0600)]
[extractor/generic] Fix direct link semantics
Sergey M․ [Fri, 18 Mar 2016 16:41:16 +0000 (22:41 +0600)]
[extractor/generic] Simplify upload_date extraction
Sergey M․ [Fri, 18 Mar 2016 15:54:33 +0000 (21:54 +0600)]
[extractor/generic] Add another test for generic m3u8
Sergey M․ [Fri, 18 Mar 2016 15:50:44 +0000 (21:50 +0600)]
[extractor/generic] Force Content-Type to lowecase
Sergey M․ [Fri, 18 Mar 2016 15:50:10 +0000 (21:50 +0600)]
[extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
Sergey M․ [Fri, 18 Mar 2016 15:08:25 +0000 (21:08 +0600)]
[theplatform] Improve geo restriction detection
remitamine [Fri, 18 Mar 2016 10:50:04 +0000 (11:50 +0100)]
[once] check http formats availability
Philipp Hagemeister [Fri, 18 Mar 2016 10:43:48 +0000 (11:43 +0100)]
release 2016.03.18
remitamine [Fri, 18 Mar 2016 08:43:28 +0000 (09:43 +0100)]
[theplatform] remove unnecessary import