youtube-dl
9 years ago[tagesschau] set description=None for empty descriptions
Roland Hieber [Sun, 19 Jul 2015 03:09:29 +0000 (05:09 +0200)]
[tagesschau] set description=None for empty descriptions

9 years ago[tagesschau] add support for Bericht aus Berlin videos
Roland Hieber [Sun, 19 Jul 2015 02:27:58 +0000 (04:27 +0200)]
[tagesschau] add support for Bericht aus Berlin videos

9 years ago[tagesschau] add support for more video types
Roland Hieber [Sun, 19 Jul 2015 01:34:22 +0000 (03:34 +0200)]
[tagesschau] add support for more video types

I found that currently only tagesschau videos are played. There are some
more shows hosted on tagesschau.de (see [0] for example) which are
easily playable by adjusting the regex. So this patch adds support for:
* tagesthemen
* tagesschau vor 20 Jahren
* tagesschau (mit Gebärdensprache)
* nachtmagazin

Note that some videos don't provide a description, so in order for the
tests to succeed, an ExtractorError needs to get caught.

[0]: http://www.tagesschau.de/multimedia/video/videoarchiv2~_date-20150714.html

9 years agoMerge branch 'sceext2-fix-iqiyi-2015-07-17'
Yen Chi Hsuan [Sat, 18 Jul 2015 19:57:36 +0000 (03:57 +0800)]
Merge branch 'sceext2-fix-iqiyi-2015-07-17'

9 years ago[iqiyi] Comment out some MD5 sums
Yen Chi Hsuan [Sat, 18 Jul 2015 19:54:59 +0000 (03:54 +0800)]
[iqiyi] Comment out some MD5 sums

The value is different on Travis CI server

9 years ago[iqiyi] Remove unused imports
Yen Chi Hsuan [Sat, 18 Jul 2015 18:28:43 +0000 (02:28 +0800)]
[iqiyi] Remove unused imports

9 years agoMerge branch 'fix-iqiyi-2015-07-17' of https://github.com/sceext2/youtube_dl into...
Yen Chi Hsuan [Sat, 18 Jul 2015 18:27:59 +0000 (02:27 +0800)]
Merge branch 'fix-iqiyi-2015-07-17' of https://github.com/sceext2/youtube_dl into sceext2-fix-iqiyi-2015-07-17

9 years ago[rtlnl] Avoid episodes completely (Closes #6275)
Sergey M․ [Sat, 18 Jul 2015 18:27:23 +0000 (00:27 +0600)]
[rtlnl] Avoid episodes completely (Closes #6275)

9 years ago[extractor/generic] Add support for francetv embeds
Sergey M․ [Sat, 18 Jul 2015 16:56:00 +0000 (22:56 +0600)]
[extractor/generic] Add support for francetv embeds

9 years ago[francetv] Fix duration extraction
Sergey M․ [Sat, 18 Jul 2015 16:43:42 +0000 (22:43 +0600)]
[francetv] Fix duration extraction

9 years ago[francetv] Add support for embeds and clean up _VALID_URL
Sergey M․ [Sat, 18 Jul 2015 16:41:34 +0000 (22:41 +0600)]
[francetv] Add support for embeds and clean up _VALID_URL

9 years ago[vk] Add age restricted video test for reference
Sergey M․ [Sat, 18 Jul 2015 13:25:06 +0000 (19:25 +0600)]
[vk] Add age restricted video test for reference

9 years ago[vk] Capture error message
Sergey M․ [Sat, 18 Jul 2015 13:15:20 +0000 (19:15 +0600)]
[vk] Capture error message

9 years ago[bliptv] Remove unused import
Sergey M․ [Sat, 18 Jul 2015 13:13:10 +0000 (19:13 +0600)]
[bliptv] Remove unused import

9 years ago[compat] Fix _asciire
Sergey M․ [Sat, 18 Jul 2015 12:32:52 +0000 (18:32 +0600)]
[compat] Fix _asciire

9 years ago[vk:uservideos] Revert orderedSet
Sergey M․ [Sat, 18 Jul 2015 12:05:08 +0000 (18:05 +0600)]
[vk:uservideos] Revert orderedSet

9 years ago[bilibili] Show georestriction error
Sergey M․ [Sat, 18 Jul 2015 11:36:46 +0000 (17:36 +0600)]
[bilibili] Show georestriction error

9 years ago[vk] Clarify extractor names
Sergey M․ [Sat, 18 Jul 2015 11:23:33 +0000 (17:23 +0600)]
[vk] Clarify extractor names

9 years ago[vk:uservideos] Improve extraction
Sergey M․ [Sat, 18 Jul 2015 11:22:25 +0000 (17:22 +0600)]
[vk:uservideos] Improve extraction

9 years ago[extractor/common] Style
Sergey M․ [Sat, 18 Jul 2015 10:35:28 +0000 (16:35 +0600)]
[extractor/common] Style

9 years agorelease 2015.07.18
Philipp Hagemeister [Sat, 18 Jul 2015 09:59:45 +0000 (11:59 +0200)]
release 2015.07.18

9 years ago[iqiyi] fix iqiyi (2015-07-17), update the md5 salt (enc_key) to iqiyi latest (2015...
sceext [Sat, 18 Jul 2015 04:29:35 +0000 (12:29 +0800)]
[iqiyi] fix iqiyi (2015-07-17), update the md5 salt (enc_key) to iqiyi latest (2015-07-17) flash player.

9 years ago[nationalgeographics] Fix extraction (Closes #6262)
Sergey M․ [Sat, 18 Jul 2015 00:33:50 +0000 (06:33 +0600)]
[nationalgeographics] Fix extraction (Closes #6262)

9 years ago[twitch:stream] Clarify channel_id reassignment rationale (#6263)
Sergey M․ [Sat, 18 Jul 2015 00:27:45 +0000 (06:27 +0600)]
[twitch:stream] Clarify channel_id reassignment rationale (#6263)

9 years ago[twitch:stream] Fix channel_id in different case (Closes #6263)
Sergey M․ [Sat, 18 Jul 2015 00:18:03 +0000 (06:18 +0600)]
[twitch:stream] Fix channel_id in different case (Closes #6263)

9 years ago[videomega] Add shortcut to _VALID_URL
Sergey M․ [Fri, 17 Jul 2015 22:27:09 +0000 (04:27 +0600)]
[videomega] Add shortcut to _VALID_URL

9 years ago[videomega] Add tests
Sergey M․ [Fri, 17 Jul 2015 22:25:30 +0000 (04:25 +0600)]
[videomega] Add tests

9 years ago[videomega] Revert iframe URL
Sergey M․ [Fri, 17 Jul 2015 22:25:10 +0000 (04:25 +0600)]
[videomega] Revert iframe URL

9 years ago[videomega] Extend _VALID_URL and improve extraction (Closes #6260)
Sergey M․ [Fri, 17 Jul 2015 22:13:45 +0000 (04:13 +0600)]
[videomega] Extend _VALID_URL and improve extraction (Closes #6260)

9 years agoMerge branch 'seamusphelan-sbs_website_changes'
Sergey M․ [Fri, 17 Jul 2015 20:43:44 +0000 (02:43 +0600)]
Merge branch 'seamusphelan-sbs_website_changes'

9 years ago[sbs] Simplify
Sergey M․ [Fri, 17 Jul 2015 20:43:18 +0000 (02:43 +0600)]
[sbs] Simplify

9 years agoMerge branch 'sbs_website_changes' of https://github.com/seamusphelan/youtube-dl...
Sergey M․ [Fri, 17 Jul 2015 20:13:55 +0000 (02:13 +0600)]
Merge branch 'sbs_website_changes' of https://github.com/seamusphelan/youtube-dl into seamusphelan-sbs_website_changes

9 years ago[bliptv] Add test with missing duration
Sergey M․ [Fri, 17 Jul 2015 19:45:54 +0000 (01:45 +0600)]
[bliptv] Add test with missing duration

9 years ago[bliptv] Use xpath for extraction and fix test
Sergey M․ [Fri, 17 Jul 2015 19:45:36 +0000 (01:45 +0600)]
[bliptv] Use xpath for extraction and fix test

9 years ago[compat] Fix missing _asciire on python 2.6
Sergey M․ [Fri, 17 Jul 2015 18:24:39 +0000 (00:24 +0600)]
[compat] Fix missing _asciire on python 2.6

9 years ago[veehd] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 18:04:25 +0000 (00:04 +0600)]
[veehd] Use compat_urllib_parse_unquote

9 years ago[openfilm] Fix compat_urllib_parse_unquote_plus import
Sergey M․ [Fri, 17 Jul 2015 17:56:27 +0000 (23:56 +0600)]
[openfilm] Fix compat_urllib_parse_unquote_plus import

9 years ago[ehow] Simplify
Sergey M․ [Fri, 17 Jul 2015 17:54:38 +0000 (23:54 +0600)]
[ehow] Simplify

9 years ago[youtube] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:51:57 +0000 (23:51 +0600)]
[youtube] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus

9 years ago[ynet] Use compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:50:52 +0000 (23:50 +0600)]
[ynet] Use compat_urllib_parse_unquote_plus

9 years ago[xvideos] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:50:25 +0000 (23:50 +0600)]
[xvideos] Use compat_urllib_parse_unquote

9 years ago[xtube] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:50:02 +0000 (23:50 +0600)]
[xtube] Use compat_urllib_parse_unquote

9 years ago[xnxx] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:49:38 +0000 (23:49 +0600)]
[xnxx] Use compat_urllib_parse_unquote

9 years ago[xbef] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:49:14 +0000 (23:49 +0600)]
[xbef] Use compat_urllib_parse_unquote

9 years ago[spankwire] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:47:51 +0000 (23:47 +0600)]
[spankwire] Use compat_urllib_parse_unquote

9 years ago[pornhub] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:47:23 +0000 (23:47 +0600)]
[pornhub] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus

9 years ago[playvid] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:46:33 +0000 (23:46 +0600)]
[playvid] Use compat_urllib_parse_unquote and compat_urllib_parse_unquote_plus

9 years ago[photobucket] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:45:55 +0000 (23:45 +0600)]
[photobucket] Use compat_urllib_parse_unquote

9 years ago[openfilm] Use compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:45:26 +0000 (23:45 +0600)]
[openfilm] Use compat_urllib_parse_unquote_plus

9 years ago[odnoklassniki] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:45:00 +0000 (23:45 +0600)]
[odnoklassniki] Use compat_urllib_parse_unquote

9 years ago[myvideo] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:44:38 +0000 (23:44 +0600)]
[myvideo] Use compat_urllib_parse_unquote

9 years ago[mofosex] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:43:36 +0000 (23:43 +0600)]
[mofosex] Use compat_urllib_parse_unquote

9 years ago[mixcloud] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:42:43 +0000 (23:42 +0600)]
[mixcloud] Use compat_urllib_parse_unquote

9 years ago[mitele] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:42:11 +0000 (23:42 +0600)]
[mitele] Use compat_urllib_parse_unquote

9 years ago[metacafe] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:41:47 +0000 (23:41 +0600)]
[metacafe] Use compat_urllib_parse_unquote

9 years ago[malemotion] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:41:14 +0000 (23:41 +0600)]
[malemotion] Use compat_urllib_parse_unquote

9 years ago[karaoketv] Use compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:40:35 +0000 (23:40 +0600)]
[karaoketv] Use compat_urllib_parse_unquote_plus

9 years ago[infoq] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:39:54 +0000 (23:39 +0600)]
[infoq] Use compat_urllib_parse_unquote

9 years ago[extractor/generic] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:39:32 +0000 (23:39 +0600)]
[extractor/generic] Use compat_urllib_parse_unquote

9 years ago[gamespot] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:38:30 +0000 (23:38 +0600)]
[gamespot] Use compat_urllib_parse_unquote

9 years ago[facebook] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:37:56 +0000 (23:37 +0600)]
[facebook] Use compat_urllib_parse_unquote

9 years ago[ehow] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:37:23 +0000 (23:37 +0600)]
[ehow] Use compat_urllib_parse_unquote

9 years ago[crunchyroll] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:36:58 +0000 (23:36 +0600)]
[crunchyroll] Use compat_urllib_parse_unquote

9 years ago[ceskatelevize] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:36:11 +0000 (23:36 +0600)]
[ceskatelevize] Use compat_urllib_parse_unquote

9 years ago[bet] Use compat_urllib_parse_unquote
Sergey M․ [Fri, 17 Jul 2015 17:35:14 +0000 (23:35 +0600)]
[bet] Use compat_urllib_parse_unquote

9 years ago[compat] Mention unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:32:43 +0000 (23:32 +0600)]
[compat] Mention unquote_plus

9 years ago[test_compat] Add tests for compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:31:23 +0000 (23:31 +0600)]
[test_compat] Add tests for compat_urllib_parse_unquote_plus

9 years ago[compat] Add compat_urllib_parse_unquote_plus
Sergey M․ [Fri, 17 Jul 2015 17:28:34 +0000 (23:28 +0600)]
[compat] Add compat_urllib_parse_unquote_plus

9 years ago[test_compat] Remove redundant test
Sergey M․ [Fri, 17 Jul 2015 17:09:56 +0000 (23:09 +0600)]
[test_compat] Remove redundant test

9 years agoMerge branch 'atomicdryad-pr-crashfix_compat_urllib_unquote'
Sergey M․ [Fri, 17 Jul 2015 16:59:17 +0000 (22:59 +0600)]
Merge branch 'atomicdryad-pr-crashfix_compat_urllib_unquote'

9 years ago[test_compat] Make tests more idiomatic
Sergey M․ [Fri, 17 Jul 2015 16:58:39 +0000 (22:58 +0600)]
[test_compat] Make tests more idiomatic

9 years ago[compat] Simplify and use latest cpython 3 code
Sergey M․ [Fri, 17 Jul 2015 16:58:13 +0000 (22:58 +0600)]
[compat] Simplify and use latest cpython 3 code

9 years agoMerge pull request #6259 from remitamine/howstuffworks
Sergey M. [Fri, 17 Jul 2015 16:08:40 +0000 (22:08 +0600)]
Merge pull request #6259 from remitamine/howstuffworks

[howstuffwoks] fix _VALID_URL regex

9 years agomatch only the test url
remitamine [Fri, 17 Jul 2015 16:07:55 +0000 (17:07 +0100)]
match only the test url

9 years agodo not capture a group
remitamine [Fri, 17 Jul 2015 15:45:53 +0000 (16:45 +0100)]
do not capture a group

9 years agoAdd test for urls without a number
remitamine [Fri, 17 Jul 2015 15:43:27 +0000 (16:43 +0100)]
Add test for urls without a number

9 years ago[howstuffwoks] fix _VALID_URL regex
remitamine [Fri, 17 Jul 2015 15:18:33 +0000 (16:18 +0100)]
[howstuffwoks] fix _VALID_URL regex

9 years agoMerge branch 'pr-crashfix_compat_urllib_unquote' of https://github.com/atomicdryad...
Sergey M․ [Fri, 17 Jul 2015 15:15:55 +0000 (21:15 +0600)]
Merge branch 'pr-crashfix_compat_urllib_unquote' of https://github.com/atomicdryad/youtube-dl into atomicdryad-pr-crashfix_compat_urllib_unquote

9 years agoAdd tests for compat_urllib_parse_unquote
fnord [Fri, 17 Jul 2015 14:46:08 +0000 (09:46 -0500)]
Add tests for compat_urllib_parse_unquote

9 years agoDon't forget trailing '%'
fnord [Fri, 17 Jul 2015 14:45:49 +0000 (09:45 -0500)]
Don't forget trailing '%'

9 years agofix TestCompat test_all_present
fnord [Fri, 17 Jul 2015 12:24:07 +0000 (07:24 -0500)]
fix TestCompat test_all_present

9 years agoremove kebab
fnord [Fri, 17 Jul 2015 06:50:43 +0000 (01:50 -0500)]
remove kebab

9 years agoremove debugprint
fnord [Fri, 17 Jul 2015 06:49:55 +0000 (01:49 -0500)]
remove debugprint

9 years agoreplace old compat_urllib_parse_unquote with backport from python3's function
fnord [Fri, 17 Jul 2015 06:31:29 +0000 (01:31 -0500)]
replace old compat_urllib_parse_unquote with backport from python3's function

  * required unquote_to_bytes function ported as well
    (uses .decode('hex') instead of dynamically populated _hextobyte global)
  * required implicit conversion to bytes and/or unicode in places due to
    differing type assumptions in p3

9 years ago[extractor/common] Add 'transform_source' parameter to _extract_f4m_formats()
Yen Chi Hsuan [Fri, 17 Jul 2015 04:02:49 +0000 (12:02 +0800)]
[extractor/common] Add 'transform_source' parameter to _extract_f4m_formats()

9 years ago[npo] Compound title
Sergey M․ [Thu, 16 Jul 2015 19:28:52 +0000 (01:28 +0600)]
[npo] Compound title

9 years ago[npo] Remove unused imports
Sergey M․ [Thu, 16 Jul 2015 18:54:05 +0000 (00:54 +0600)]
[npo] Remove unused imports

9 years ago[vpro] Improve playlist extraction
Sergey M․ [Thu, 16 Jul 2015 18:53:12 +0000 (00:53 +0600)]
[vpro] Improve playlist extraction

9 years ago[npo] Allow missing description
Sergey M․ [Thu, 16 Jul 2015 18:40:04 +0000 (00:40 +0600)]
[npo] Allow missing description

9 years ago[npo] Prefer aflevering_titel over titel
Sergey M․ [Thu, 16 Jul 2015 18:39:22 +0000 (00:39 +0600)]
[npo] Prefer aflevering_titel over titel

9 years ago[vpro] Fix extraction and add support for vpro playlists
Sergey M․ [Thu, 16 Jul 2015 18:34:24 +0000 (00:34 +0600)]
[vpro] Fix extraction and add support for vpro playlists

9 years ago[wnl] Add extractor for omroepwnl playlists
Sergey M․ [Thu, 16 Jul 2015 18:14:38 +0000 (00:14 +0600)]
[wnl] Add extractor for omroepwnl playlists

9 years ago[npo] Update test
Sergey M․ [Thu, 16 Jul 2015 17:56:57 +0000 (23:56 +0600)]
[npo] Update test

9 years ago[npo] Add support for omroepwnl fragments
Sergey M․ [Thu, 16 Jul 2015 17:54:43 +0000 (23:54 +0600)]
[npo] Add support for omroepwnl fragments

9 years ago[npo] Extend _VALID_URL to support ntr.nl (Closes #6248)
Sergey M․ [Thu, 16 Jul 2015 17:21:04 +0000 (23:21 +0600)]
[npo] Extend _VALID_URL to support ntr.nl (Closes #6248)

9 years agoGeneric: use compat_urllib_parse_unquote to prevent utf8 mangling
fnord [Wed, 15 Jul 2015 20:30:47 +0000 (15:30 -0500)]
Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
of the entire page in python 2.

-requires- fixed compat_urllib_parse_unquote

example - the following will save with a mangled playlist title,
 instead of the kanji for 'tsunami'. This affects all utf8encoded
 urls as well

youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
  https://gist.githubusercontent.com/atomicdryad/fcb97465e6060fc519e1/raw/61c14c1e3a4985471dcf56c281d24d7e781a4e0e/tsunami.html

9 years agocompat_urllib_parse_unquote: crash fix: only decode valid hex
fnord [Wed, 15 Jul 2015 20:13:56 +0000 (15:13 -0500)]
compat_urllib_parse_unquote: crash fix: only decode valid hex

on python 2 the following has a { "crash_rate": "100%" } of the time
as it tries to parse '" ' as hex.

9 years agoMerge pull request #6242 from dstftw/f4m-improvements
Sergey M. [Wed, 15 Jul 2015 20:23:26 +0000 (02:23 +0600)]
Merge pull request #6242 from dstftw/f4m-improvements

[f4m] Improvements

9 years ago[prosiebensat1] Clarify test purpose
Sergey M․ [Wed, 15 Jul 2015 20:23:07 +0000 (02:23 +0600)]
[prosiebensat1] Clarify test purpose

9 years ago[extractor/common] Keep going in some media_url is missing
Sergey M․ [Wed, 15 Jul 2015 19:25:33 +0000 (01:25 +0600)]
[extractor/common] Keep going in some media_url is missing