youtube-dl
7 years agoMerge pull request #12854 from Tithen-Firion/appletrailer-test-fix
Yen Chi Hsuan [Sat, 29 Apr 2017 11:24:38 +0000 (19:24 +0800)]
Merge pull request #12854 from Tithen-Firion/appletrailer-test-fix

[appletrailers] update test cases

7 years agoMerge pull request #12906 from Tithen-Firion/clean-html-fix
Yen Chi Hsuan [Sat, 29 Apr 2017 07:58:45 +0000 (15:58 +0800)]
Merge pull request #12906 from Tithen-Firion/clean-html-fix

[utils] Fix inconsistent output of clean_html

7 years ago[xtube] Fix extraction with non-standard JSON 'sources'
Yen Chi Hsuan [Sat, 29 Apr 2017 07:55:08 +0000 (15:55 +0800)]
[xtube] Fix extraction with non-standard JSON 'sources'

Closes #12734

Thanks @paulguy for the fix!

7 years ago[downloader/external] Properly handle live stream downloading cancellation (closes...
Sergey M․ [Fri, 28 Apr 2017 21:33:35 +0000 (04:33 +0700)]
[downloader/external] Properly handle live stream downloading cancellation (closes #8932)

7 years ago[tvplayer] Fix extraction (closes #12908)
Sergey M․ [Fri, 28 Apr 2017 20:39:39 +0000 (03:39 +0700)]
[tvplayer] Fix extraction (closes #12908)

7 years ago[test_utils] Add one more clean_html test
Tithen-Firion [Fri, 28 Apr 2017 16:05:14 +0000 (18:05 +0200)]
[test_utils] Add one more clean_html test

7 years ago[utils] Fix inconsistent output of clean_html
Tithen-Firion [Fri, 28 Apr 2017 15:34:27 +0000 (17:34 +0200)]
[utils] Fix inconsistent output of clean_html

`\s` in Python 2.x doesn't match unicode whitespace characters by
default

7 years agorelease 2017.04.28
Sergey M․ [Fri, 28 Apr 2017 11:30:03 +0000 (18:30 +0700)]
release 2017.04.28

7 years ago[ChangeLog] Actualize
Sergey M․ [Fri, 28 Apr 2017 11:27:29 +0000 (18:27 +0700)]
[ChangeLog] Actualize

7 years ago[aenetworks] fix extraction for shows with single season
Remita Amine [Fri, 28 Apr 2017 11:04:56 +0000 (12:04 +0100)]
[aenetworks] fix extraction for shows with single season

7 years ago[go] add support for Disney, DisneyJunior and DisneyXD show pages
Remita Amine [Fri, 28 Apr 2017 08:48:22 +0000 (09:48 +0100)]
[go] add support for Disney, DisneyJunior and DisneyXD show pages

7 years ago[adobepass] use geo verification headers for all requests
Remita Amine [Fri, 28 Apr 2017 08:47:30 +0000 (09:47 +0100)]
[adobepass] use geo verification headers for all requests

7 years ago[youtube] Recognize another HTML5 player URL (#12885)
Yen Chi Hsuan [Fri, 28 Apr 2017 08:25:04 +0000 (16:25 +0800)]
[youtube] Recognize another HTML5 player URL (#12885)

7 years ago[youtube] Recognize new locale-based player URLs (fixes #12885)
Yen Chi Hsuan [Fri, 28 Apr 2017 07:47:26 +0000 (15:47 +0800)]
[youtube] Recognize new locale-based player URLs (fixes #12885)

7 years ago[cbslocal] Update test
Tithen-Firion [Thu, 27 Apr 2017 21:26:59 +0000 (23:26 +0200)]
[cbslocal] Update test

7 years ago[collegerama] Update tests
Tithen-Firion [Thu, 27 Apr 2017 21:00:49 +0000 (23:00 +0200)]
[collegerama] Update tests

7 years ago[afreecatv] Fix title extraction
Tithen-Firion [Thu, 27 Apr 2017 21:00:15 +0000 (23:00 +0200)]
[afreecatv] Fix title extraction

7 years ago[archiveorg] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:48:32 +0000 (22:48 +0200)]
[archiveorg] Update test

7 years ago[appleconnect] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:47:25 +0000 (22:47 +0200)]
[appleconnect] Update test

7 years ago[audioboom] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:36:28 +0000 (22:36 +0200)]
[audioboom] Update test

7 years ago[atresplayer] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:32:25 +0000 (22:32 +0200)]
[atresplayer] Update test

7 years ago[bleacherreport] Update tests
Tithen-Firion [Thu, 27 Apr 2017 20:28:27 +0000 (22:28 +0200)]
[bleacherreport] Update tests

7 years ago[downloader/fragment] Remove assert for resume_len when no fragments downloaded
Sergey M․ [Thu, 27 Apr 2017 20:24:59 +0000 (03:24 +0700)]
[downloader/fragment] Remove assert for resume_len when no fragments downloaded
This may be incorrect due some header (e.g. flv header in f4m downloader)

7 years ago[beeg] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:14:11 +0000 (22:14 +0200)]
[beeg] Update test

7 years ago[bandcamp] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:13:12 +0000 (22:13 +0200)]
[bandcamp] Update test

7 years ago[canalc2] Update test
Tithen-Firion [Thu, 27 Apr 2017 20:07:42 +0000 (22:07 +0200)]
[canalc2] Update test

7 years ago[test_InfoExtractor] Fix test_parse_m3u8_formats
Sergey M․ [Thu, 27 Apr 2017 20:01:43 +0000 (03:01 +0700)]
[test_InfoExtractor] Fix test_parse_m3u8_formats

7 years ago[extractor/common] Add manifest_url for explicit group rendition formats
Sergey M․ [Thu, 27 Apr 2017 20:00:14 +0000 (03:00 +0700)]
[extractor/common] Add manifest_url for explicit group rendition formats

7 years ago[br] Update test
Tithen-Firion [Thu, 27 Apr 2017 19:53:11 +0000 (21:53 +0200)]
[br] Update test

7 years ago[clipfish] Update test
Tithen-Firion [Thu, 27 Apr 2017 19:51:30 +0000 (21:51 +0200)]
[clipfish] Update test

7 years ago[test_download] Fix order when testing file's md5
Tithen-Firion [Thu, 27 Apr 2017 09:04:21 +0000 (11:04 +0200)]
[test_download] Fix order when testing file's md5

7 years agoDon't list master m3u8 playlists in format list (closes #12832)
Sergey M․ [Tue, 25 Apr 2017 15:07:10 +0000 (22:07 +0700)]
Don't list master m3u8 playlists in format list (closes #12832)

7 years ago[appletrailers] update test cases
Tithen-Firion [Thu, 27 Apr 2017 08:04:21 +0000 (10:04 +0200)]
[appletrailers] update test cases

7 years ago[streamable] Add support for new embedded URL schema
Lucas M [Wed, 26 Apr 2017 16:39:53 +0000 (12:39 -0400)]
[streamable] Add support for new embedded URL schema

7 years ago[arte:+7] Relax _VALID_URL (closes #12837)
Sergey M․ [Tue, 25 Apr 2017 18:55:29 +0000 (01:55 +0700)]
[arte:+7] Relax _VALID_URL (closes #12837)

7 years agorelease 2017.04.26
Sergey M․ [Tue, 25 Apr 2017 17:06:12 +0000 (00:06 +0700)]
release 2017.04.26

7 years ago[ChangeLog] Actualize
Sergey M․ [Tue, 25 Apr 2017 17:03:13 +0000 (00:03 +0700)]
[ChangeLog] Actualize

7 years ago[extractor/common] Improve jwplayer regex
Sergey M․ [Tue, 25 Apr 2017 16:46:05 +0000 (23:46 +0700)]
[extractor/common] Improve jwplayer regex

7 years ago[downloader/fragment] Clarify current_fragment's index and mark as experimental
Sergey M․ [Tue, 25 Apr 2017 16:33:35 +0000 (23:33 +0700)]
[downloader/fragment] Clarify current_fragment's index and mark as experimental

7 years agoAdd missing test m3u8 file
Sergey M․ [Tue, 25 Apr 2017 15:25:40 +0000 (22:25 +0700)]
Add missing test m3u8 file

7 years agoIgnore and clean *.ytdl files
Yen Chi Hsuan [Tue, 25 Apr 2017 14:42:55 +0000 (22:42 +0800)]
Ignore and clean *.ytdl files

7 years ago[iqiyi] Fix extraction of Yule videos
Yen Chi Hsuan [Tue, 25 Apr 2017 14:23:57 +0000 (22:23 +0800)]
[iqiyi] Fix extraction of Yule videos

7 years ago[downloader/fragment] Improve .ytdl format and start documenting
Sergey M․ [Mon, 24 Apr 2017 16:50:20 +0000 (23:50 +0700)]
[downloader/fragment] Improve .ytdl format and start documenting

7 years ago[downloader/fragment] Don't process ytdl file when it's not needed yet
Sergey M․ [Mon, 24 Apr 2017 16:05:56 +0000 (23:05 +0700)]
[downloader/fragment] Don't process ytdl file when it's not needed yet

7 years agoIntroduce --keep-fragments
Sergey M․ [Sun, 23 Apr 2017 20:09:08 +0000 (03:09 +0700)]
Introduce --keep-fragments

7 years ago[downloader/fragment] Use temp file for current fragment
Sergey M․ [Sun, 23 Apr 2017 19:54:17 +0000 (02:54 +0700)]
[downloader/fragment] Use temp file for current fragment

7 years ago[YoutubeDL] Fix output template for missing timestamp (closes #12796)
Sergey M․ [Sun, 23 Apr 2017 17:50:39 +0000 (00:50 +0700)]
[YoutubeDL] Fix output template for missing timestamp (closes #12796)

7 years ago[extractor/common] Rephrase comment
Sergey M․ [Sun, 23 Apr 2017 04:51:53 +0000 (11:51 +0700)]
[extractor/common] Rephrase comment

7 years ago[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag
Sergey M․ [Sun, 23 Apr 2017 04:49:57 +0000 (11:49 +0700)]
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag

7 years ago[vidio] Improve and sort formats
Sergey M․ [Sun, 23 Apr 2017 04:48:51 +0000 (11:48 +0700)]
[vidio] Improve and sort formats

7 years ago[extractor/common] Use float for scaled tbr
Sergey M․ [Sun, 23 Apr 2017 04:33:19 +0000 (11:33 +0700)]
[extractor/common] Use float for scaled tbr

7 years ago[brightcove] match only video elements with data-video-id attribute
Remita Amine [Sat, 22 Apr 2017 21:26:20 +0000 (22:26 +0100)]
[brightcove] match only video elements with data-video-id attribute

7 years ago[downloader/fragment] remove unused code
Remita Amine [Sat, 22 Apr 2017 17:19:47 +0000 (18:19 +0100)]
[downloader/fragment] remove unused code

7 years ago[downloader/fragment] use the documented names for fragment progress_hooks fields
Remita Amine [Sat, 22 Apr 2017 15:42:24 +0000 (16:42 +0100)]
[downloader/fragment] use the documented names for fragment progress_hooks fields

7 years ago[iqiyi] Fix playlist detection (#12504)
Yen Chi Hsuan [Sat, 22 Apr 2017 14:11:37 +0000 (22:11 +0800)]
[iqiyi] Fix playlist detection (#12504)

7 years ago[socks] Report errors elegantly when credentails are required but missing
Yen Chi Hsuan [Sat, 22 Apr 2017 13:44:01 +0000 (21:44 +0800)]
[socks] Report errors elegantly when credentails are required but missing

In some non-standard implementations, the server may respond AUTH_USER_PASS
even if's not listed in available authentication methods. (it should
respond AUTH_NO_ACCEPTABLE per standards)

7 years ago[azubu] Remove extractor as the site is gone (closes #12813)
Yen Chi Hsuan [Sat, 22 Apr 2017 13:20:25 +0000 (21:20 +0800)]
[azubu] Remove extractor as the site is gone (closes #12813)

7 years ago[porn91] Fix extraction (closes #12814)
Yen Chi Hsuan [Sat, 22 Apr 2017 13:16:36 +0000 (21:16 +0800)]
[porn91] Fix extraction (closes #12814)

7 years ago[extractor/common] Improve m3u8 extraction (closes #12211)
Sergey M․ [Sat, 22 Apr 2017 00:01:00 +0000 (07:01 +0700)]
[extractor/common] Improve m3u8 extraction (closes #12211)
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507, #11995, #12211 and twitch vod

7 years ago[vidzi] Fix extraction (closes #12793)
Sergey M․ [Fri, 21 Apr 2017 16:37:06 +0000 (23:37 +0700)]
[vidzi] Fix extraction (closes #12793)

7 years ago[amp] extract error message(closes #12795)
Remita Amine [Thu, 20 Apr 2017 04:16:41 +0000 (05:16 +0100)]
[amp] extract error message(closes #12795)

7 years ago[downloader/fragment] use a general file to store fragment download context
Remita Amine [Wed, 19 Apr 2017 17:34:25 +0000 (18:34 +0100)]
[downloader/fragment] use a general file to store fragment download context

7 years ago[brightcove] PEP 8
Sergey M․ [Wed, 19 Apr 2017 14:47:03 +0000 (21:47 +0700)]
[brightcove] PEP 8

7 years ago[utils] add support for ttml styles
Remita Amine [Thu, 23 Feb 2017 17:46:20 +0000 (18:46 +0100)]
[utils] add support for ttml styles

7 years ago[fragment,hls,f4m,dash,ism] improve fragment downloading
Remita Amine [Tue, 28 Jun 2016 17:07:50 +0000 (18:07 +0100)]
[fragment,hls,f4m,dash,ism] improve fragment downloading

- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments

and for hls downloader:
- no need to download keys for segments that already downloaded

7 years ago[odnoklassniki] update tests
Remita Amine [Tue, 18 Apr 2017 23:16:31 +0000 (00:16 +0100)]
[odnoklassniki] update tests

7 years ago[xfileshare] Add support for gorillavid.com and daclips.com (closes #12776)
Sergey M․ [Tue, 18 Apr 2017 16:54:36 +0000 (23:54 +0700)]
[xfileshare] Add support for gorillavid.com and daclips.com (closes #12776)

7 years ago[instagram] Fix extraction (closes #12777)
Sergey M․ [Tue, 18 Apr 2017 15:40:26 +0000 (22:40 +0700)]
[instagram] Fix extraction (closes #12777)

7 years ago[extractor/common] Add support multiple getters in try_get
Sergey M․ [Tue, 18 Apr 2017 15:39:58 +0000 (22:39 +0700)]
[extractor/common] Add support multiple getters in try_get

7 years ago[extractor/common] Add support for video of WebPage context in _json_ld (closes ...
Sergey M․ [Tue, 18 Apr 2017 15:21:38 +0000 (22:21 +0700)]
[extractor/common] Add support for video of WebPage context in _json_ld (closes #12778)

7 years ago[brightcove] Support URLs with bcpid instead of playerID
Yen Chi Hsuan [Tue, 18 Apr 2017 15:03:03 +0000 (23:03 +0800)]
[brightcove] Support URLs with bcpid instead of playerID

Fixes #12482

7 years ago[brightcove] Fix _extract_url (closes #12782)
Sergey M․ [Tue, 18 Apr 2017 14:46:25 +0000 (21:46 +0700)]
[brightcove] Fix _extract_url (closes #12782)

7 years ago[common] Relax JWPlayer regex and remove duplicate urls(#12768)
Remita Amine [Mon, 17 Apr 2017 07:48:24 +0000 (08:48 +0100)]
[common] Relax JWPlayer regex and remove duplicate urls(#12768)

7 years ago[odnoklassniki] extract m3u8 formats
Remita Amine [Sun, 16 Apr 2017 20:24:34 +0000 (21:24 +0100)]
[odnoklassniki] extract m3u8 formats

7 years agorelease 2017.04.17
Sergey M․ [Sun, 16 Apr 2017 17:46:32 +0000 (00:46 +0700)]
release 2017.04.17

7 years ago[ChangeLog] Actualize
Sergey M․ [Sun, 16 Apr 2017 17:43:56 +0000 (00:43 +0700)]
[ChangeLog] Actualize

7 years ago[extractor/generic] Add test for #12761
Sergey M․ [Sun, 16 Apr 2017 17:36:59 +0000 (00:36 +0700)]
[extractor/generic] Add test for #12761

7 years ago[limelight] Add support for channels and channels lists embedded using LimelightEmbed...
Sergey M․ [Sun, 16 Apr 2017 17:33:47 +0000 (00:33 +0700)]
[limelight] Add support for channels and channels lists embedded using LimelightEmbeddedPlayerFlash (#12761)

7 years ago[limelight] Improve embeds extraction (closes #12761)
Sergey M․ [Sun, 16 Apr 2017 17:23:16 +0000 (00:23 +0700)]
[limelight] Improve embeds extraction (closes #12761)
* Move extraction code to extractor
* Add extraction for LimelightEmbeddedPlayerFlash embeds
* Extract multiple video

7 years ago[itv] Extract series metadata
Sergey M․ [Sun, 16 Apr 2017 16:19:20 +0000 (23:19 +0700)]
[itv] Extract series metadata

7 years ago[itv] Fix rtmp formats (#12759)
Sergey M․ [Sun, 16 Apr 2017 16:15:24 +0000 (23:15 +0700)]
[itv] Fix rtmp formats (#12759)

7 years ago[itv] Use native hls
Sergey M․ [Sun, 16 Apr 2017 14:52:45 +0000 (21:52 +0700)]
[itv] Use native hls

7 years ago[itv] Lower preference for rtmp formats (closes #12759)
Sergey M․ [Sun, 16 Apr 2017 14:52:07 +0000 (21:52 +0700)]
[itv] Lower preference for rtmp formats (closes #12759)

7 years agoCredit @triple-j for extracting more metadata from go90.com(#12721)
Remita Amine [Sat, 15 Apr 2017 22:19:23 +0000 (23:19 +0100)]
Credit @triple-j for extracting more metadata from go90.com(#12721)

7 years agoMerge pull request #12752 from triple-j/go90_improvements_pull_request
remitamine [Sat, 15 Apr 2017 21:48:13 +0000 (23:48 +0200)]
Merge pull request #12752 from triple-j/go90_improvements_pull_request

[go90] Improve extraction

7 years ago[go90] Improve extraction
Jeremie J. Jarosh [Sat, 15 Apr 2017 15:12:08 +0000 (10:12 -0500)]
[go90] Improve extraction

- add metadata for 'series', 'episode', 'season', 'season_id',
  'season_number', and 'episode_number'
- integrate series title into the title
- extract subtitles  (fallback to `vtt` if the subtitle file type
  detection fails as that is the most likely extension)

7 years agorelease 2017.04.16
Sergey M․ [Sat, 15 Apr 2017 18:49:02 +0000 (01:49 +0700)]
release 2017.04.16

7 years ago[ChangeLog] Actualize
Sergey M․ [Sat, 15 Apr 2017 18:47:58 +0000 (01:47 +0700)]
[ChangeLog] Actualize

7 years ago[YoutubeDL] Apply expand_path after output template substitution
Sergey M․ [Sat, 15 Apr 2017 18:39:07 +0000 (01:39 +0700)]
[YoutubeDL] Apply expand_path after output template substitution
os.path.expandvars translates '%%' into '%' making output template invalid.
Before: '%%(ext)s' -(expand path)-> '%(ext)s' -(outtmpl subst.)-> 'mp4'
After: '%%(ext)s' -(outtmpl subst.)-> '%(ext)s' -(expand path)-> '%(ext)s'

7 years ago[test_YoutubeDL] Add test for #11163
Sergey M․ [Sat, 15 Apr 2017 18:14:05 +0000 (01:14 +0700)]
[test_YoutubeDL] Add test for #11163

7 years ago[YoutubeDL] Propagate overridden metadata to IE results of type url (closes #11163)
Sergey M․ [Sat, 15 Apr 2017 17:56:53 +0000 (00:56 +0700)]
[YoutubeDL] Propagate overridden metadata to IE results of type url (closes #11163)

7 years ago[extractor/generic] Extract RSS entries as url_transparent (#11163)
Sergey M․ [Sat, 15 Apr 2017 17:52:15 +0000 (00:52 +0700)]
[extractor/generic] Extract RSS entries as url_transparent (#11163)

7 years ago[streamango] Improve extraction (closes #12643)
Sergey M․ [Sat, 15 Apr 2017 14:50:15 +0000 (21:50 +0700)]
[streamango] Improve extraction (closes #12643)

7 years ago[streamango] Add extractor
Marvin Ewald [Tue, 4 Apr 2017 17:18:23 +0000 (19:18 +0200)]
[streamango] Add extractor

7 years ago[wsj] Improve and modernize (closes #12558)
Sergey M․ [Sat, 15 Apr 2017 13:51:47 +0000 (20:51 +0700)]
[wsj] Improve and modernize (closes #12558)

7 years ago[wsj:article] Add extractor
John Hawkinson [Sat, 25 Mar 2017 23:47:48 +0000 (19:47 -0400)]
[wsj:article] Add extractor

7 years ago[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes...
Sergey M․ [Sat, 15 Apr 2017 13:30:51 +0000 (20:30 +0700)]
[brightcove] Validate ambiguous embeds' URLs (closes #9163, closes #12005, closes #12178, closes #12480)

7 years ago[brightcove] Relax video tag embeds extraction
John Hawkinson [Sun, 12 Feb 2017 13:26:36 +0000 (08:26 -0500)]
[brightcove] Relax video tag embeds extraction

BrightcoveNewIE.extract_urls(): Handle player data when it is all in
attributes of the <video> tag, and also the id is
data-brightcove-video-id not data-video-id.

Add test to generic extractor, note HEAD gives 404, no checksum computed(?).

7 years ago[udemy] Add support for react rendition (closes #12744)
Sergey M․ [Fri, 14 Apr 2017 20:26:19 +0000 (03:26 +0700)]
[udemy] Add support for react rendition (closes #12744)

7 years ago[curiositystream] PEP 8
Sergey M․ [Fri, 14 Apr 2017 19:33:26 +0000 (02:33 +0700)]
[curiositystream] PEP 8