Commit graph

13671 commits

Author SHA1 Message Date
Sergey M․ b0ead0e09a
[jwplatform] Add support for multiple embeds (closes #15192) 2018-01-07 21:49:23 +07:00
Sergey M․ 0a5b1295b7
[motherless:group] Relax entry extraction and add a fallback scenario 2018-01-07 00:31:53 +07:00
Sergey M․ a133eb7764
[motherless:group] Capture leading slash of video path 2018-01-07 00:02:41 +07:00
Sergey M․ f12628f934
[mitele] Fix extraction (closes #15186) 2018-01-06 23:58:00 +07:00
Martin Weinelt 45283afdec [motherless] Add support for groups 2018-01-06 23:33:40 +07:00
Sergey M․ b7c74c0403
[lynda] Relax _VALID_URL (closes #15185) 2018-01-06 23:12:30 +07:00
Parmjit Virk 0b0870f9d0 [soundcloud] Fallback to avatar picture for thumbnail (closes #12878) 2018-01-05 08:25:42 +07:00
JianxinLi da35331c6c [youku] Fix list extraction.(close #15135) (#15137)
* [youku] Fix list extraction.(close #15135)

Change-Id: I2e9c920143f4f16012252625943a8f18b8ff40eb

* [youku] Remove KeyError try-except

Change-Id: Ic46327905cbef1356b7b12d5eb3db5d9746ca338
2018-01-04 22:25:28 +08:00
Yen Chi Hsuan de329f64ab [openload] Fix extraction (closes #15166) 2018-01-04 13:26:08 +08:00
Sergey M․ 75ba0efb52
[lynda] Skip invalid subtitles (closes #15159) 2018-01-03 16:41:28 +07:00
Luc Ritchie f0c6c2bce2 [twitch] Pass video id to url_result when extracting playlist 2018-01-03 16:22:55 +07:00
Jaime Marquínez Ferrándiz 9650c3e91d [rtve.es:alacarta] Fix extraction of some new URLs 2018-01-02 21:12:39 +01:00
Mattias Wadman b5e531f31a [acast] Fix extraction 2018-01-02 23:32:17 +07:00
Philipp Hagemeister d7cd9a9e84
[utils] Fix youtube-dl under PyPy3 on Windows 2018-01-01 22:48:27 +07:00
Sergey M․ b300cda476
[YoutubeDL] Output python implementation in debug header 2018-01-01 21:52:24 +07:00
sprhawk 6648fd8ad6 changed to use .get to get field from json object 2018-01-01 18:33:14 +08:00
Sergey M․ 04cf1a191a
release 2017.12.31 2017-12-31 04:30:49 +07:00
Ondřej Caletka 126f225bcf
[extractor/common] Add container meta field for formats extracted in _parse_mpd_formats 2017-12-31 04:04:09 +07:00
Windom 4f5cf31977 [slutload] Add support for mobile URLs 2017-12-31 01:41:07 +07:00
Sergey M․ 77341dae14
[abc:iview] Improve extraction and bypass geo restriction (closes #14782) 2017-12-31 01:27:28 +07:00
d2au 2e65e7db9e
[abc:iview] Fix extraction (closes #14711)
ABC dropped unmetering, so change to metered hls urls which
require auth.
2017-12-31 01:27:22 +07:00
Sergey M․ 538d4f8681
[downloader/hls] Use HTTP headers for key request 2017-12-31 01:15:35 +07:00
Yen Chi Hsuan 620ee8712e [openload] Fix extraction (closes #15118) 2017-12-30 15:03:13 +08:00
Sergey M․ 2ca7ed41fe
[mediasite] Improve extraction and code style, add support for DASH (closes #11185, closes #14343, refs #5428) 2017-12-30 08:04:43 +07:00
felix 8056c8542d
[mediasite] Add extractor, subsume sandia and collegerama extractors 2017-12-30 07:23:41 +07:00
felix 2501d41ef4
[common] use AACL as the default fourcc when AudioTag is 255 2017-12-30 07:22:07 +07:00
Remita Amine d97cb84b31 [ufctv] Add new extractor(closes #14520) 2017-12-30 00:30:41 +01:00
50csent 2c8e11b4af
[pluralsight] Fix missing first line of subtitles (closes #11118) 2017-12-30 05:56:47 +07:00
Sergey M․ d2c5b5a951
[openload] Fallback on f-page extraction (closes #14665, closes #14879) 2017-12-30 05:53:56 +07:00
Sergey M․ 580f3c79d5
[vimeo] Improve password protected videos extraction (closes #15114) 2017-12-30 03:54:14 +07:00
sprhawk 48058d82dc replace unused _download_webpage_handle with _download_webpage 2017-12-30 01:14:21 +08:00
sprhawk 6a41a12d29 replace split with strip_jsonp 2017-12-30 01:11:30 +08:00
sprhawk 5c97ec5ff5 replace urlencode.encode with urlencode_postdata 2017-12-30 01:08:56 +08:00
Sergey M․ 9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id (closes #15111) 2017-12-29 23:14:56 +07:00
Remita Amine 84f085d4bd [aws] fix canonical/signed headers generation in python 2(closes #15102) 2017-12-29 00:13:40 +01:00
Sergey M․ a491fd0c6f
release 2017.12.28 2017-12-28 23:12:56 +07:00
Sergey M․ 640788f6f4
[internazionale] Improve extraction (closes #14973) 2017-12-27 23:27:48 +07:00
Leonardo Taccari 1ae0f0a21d
[internazionale] Add extractor 2017-12-27 23:27:43 +07:00
Ondřej Caletka 616bb95b28 [playtvak] Relax video regex and make description optional 2017-12-27 22:57:26 +07:00
Remita Amine be069839b4 [filmweb] improve extraction 2017-12-26 19:41:08 +01:00
sprhawk c33de004e1 Merge branch 'master' of github.com:rg3/youtube-dl into weibo 2017-12-26 22:27:26 +08:00
sprhawk 42a1012c77 fix according to "https://github.com/rg3/youtube-dl/pull/15079#discussion_r158688607" 2017-12-26 22:26:01 +08:00
Déstin Reed a14001a5a1 [Filmweb] Add extractor 2017-12-26 15:19:37 +01:00
Remita Amine db145ee54a [espn] Add new extractor for http://fivethirtyeight.com(closes #6864) 2017-12-26 14:20:21 +01:00
Remita Amine 45d20488f1 [umg:de] Add new extractor(closes #11582)(closes #11584) 2017-12-26 12:32:04 +01:00
sprhawk 2593651224 fix compat_urllib_request for python2.7 2017-12-26 16:46:01 +08:00
sprhawk 951043724f re-format code to pass flake8 2017-12-26 16:38:51 +08:00
sprhawk d2be5bb5af change to use compat urllib 2017-12-26 16:28:47 +08:00
sprhawk 447a5a710d added weibo mobile site support 2017-12-26 16:24:56 +08:00
Remita Amine 0f897e0929 [espn] add support for espnfc and extract more formats(closes #8053) 2017-12-25 23:29:09 +01:00
JianxinLi d3ca283235 [youku] Add test case.
Some playlist has no data-id value.

Change-Id: I97455f2907f08bda03b538cdc13ec827e2f8ce26
2017-12-25 22:02:47 +08:00
JianxinLi d99a1000c7 [youku] Fix list extraction.(close #15065)
Change-Id: I578fdc5b69509bdcd8d3191e3917afe47c234ff6
2017-12-25 22:02:47 +08:00
Yen Chi Hsuan a75419586b [openload] Remove a confusing exception
If phantomjs is not installed, there's an error besides the missing
phantomjs exception:

Exception ignored in: <bound method PhantomJSwrapper.__del__ of <youtube_dl.extractor.openload.PhantomJSwrapper object at 0x7f8ad5e78278>>
Traceback (most recent call last):
  File "/home/yen/Projects/youtube-dl/youtube_dl/extractor/openload.py", line 142, in __del__
    os.remove(self._TMP_FILES[name].name)
AttributeError: 'PhantomJSwrapper' object has no attribute '_TMP_FILES'
2017-12-24 20:47:42 +08:00
Sergey M․ 273c23d960
[openload] Add support for oload.stream (closes #15070) 2017-12-24 13:53:27 +07:00
JianxinLi 0e25a1a278 [youku] Update ccode
Change-Id: Id397e814e81ff560506d68563b7409eebbe5943d
2017-12-23 23:34:42 +08:00
Sergey M․ 307a7588b0
release 2017.12.23 2017-12-23 21:24:18 +07:00
Sergey M․ c2f2f8b120
[kaltura] Fix typo 2017-12-23 21:22:41 +07:00
Sergey M․ 69d69da98a
[kaltura] Add another embed pattern for entry_id
For cases when player configuration map is setup via indexing operator, e.g. kalturaPlayerConfiguration_1_lre6rg3i_10[entry_id] = 1_lre6rg3i (see https://www.heise.de/video/artikel/odcast-c-t-uplink-20-1-Apple-CarPlay-vs-Android-Auto-Galileo-3D-Sound-erklaert-3919694.html)
2017-12-23 21:17:53 +07:00
Sergey M․ 5c5e60cff8
[voot] Fix video identification 2017-12-23 21:17:53 +07:00
Sergey M․ 2132edaa03
[extractor/common] Move X-Forwarded-For setup code into _request_webpage 2017-12-23 21:17:53 +07:00
Remita Amine 4b7dd1705a [7plus] Add new extractor(closes #15043) 2017-12-23 13:22:20 +01:00
Sergey M․ d2d766bc6d
[animeondemand] Fix typo 2017-12-20 23:18:14 +07:00
Sergey M․ 17c3aced5d
[animeondemand] Relax login error regex 2017-12-19 22:53:04 +07:00
Remita Amine 78466fcab5 [shahid] add support for show pages(closes #7401) 2017-12-19 02:00:38 +01:00
Sergey M․ 3961c6cb9d
[YoutubeDL] Add support for playlist_uploader and playlist_uploader_id in output template (closes #11427, #15018) 2017-12-19 03:53:44 +07:00
Sergey M․ 07aeced68e
[youtube] Extract uploader, uploader_id and uploader_url for playlists (#11427, #15018) 2017-12-19 03:51:28 +07:00
Sergey M․ c10c93238e
[extractor/common] Introduce uploader, uploader_id and uploader_url meta fields for playlists (#11427, #15018) 2017-12-19 03:51:03 +07:00
Sergey M․ 4a109f81bc
[afreecatv] Improve format extraction (closes #15019) 2017-12-19 00:38:39 +07:00
Sergey M․ 99081da90c
[downloader/fragment] Encode filename of fragment being removed (closes #15020) 2017-12-18 03:31:53 +07:00
Remita Amine 7e81010987 [cspan] add support for audio only pages and catch page errors(closes #14995) 2017-12-17 19:15:59 +01:00
Sergey M․ 549bb416f5
[mailru] Fix issues and improve (closes #14904) 2017-12-17 18:38:27 +07:00
Hongjie Dong 25475dfab3
[mailru] Add support for embed URLs 2017-12-17 18:37:03 +07:00
Remita Amine 3dfa9ec213 [crunchyroll] Future-proof XML element checks(closes #15013) 2017-12-17 09:15:44 +01:00
Sergey M․ 06dbcd7be4
[cbslocal] Fix timestamp extraction (closes #14999, closes #15000) 2017-12-16 21:57:30 +07:00
Sergey M․ b555ae9bf1
[utils] Add another date format pattern (#14999) 2017-12-16 21:56:16 +07:00
Remita Amine c402e7f3a0 [discoverygo] correct ttml subtitle extension 2017-12-16 12:55:44 +01:00
Sergey M․ 498a8a4ca5
[vk] Make view count optional (closes #14979) 2017-12-15 22:53:56 +07:00
Remita Amine d05ba4b89e [disney] skip Apple FairPlay formats(#14982) 2017-12-15 09:28:07 +01:00
Remita Amine 23f511f5c7 [voot] sort formats 2017-12-15 09:05:59 +01:00
Remita Amine 1c4804ef9b [voot] fix format extraction(closes #14758) 2017-12-14 23:05:43 +01:00
Sergey M․ 8ff2b16435
release 2017.12.14 2017-12-14 05:19:21 +07:00
Sergey M․ 3fae11ac00
[itv] Improve extraction, extract more subtitles and duration (closes #14944) 2017-12-14 04:49:07 +07:00
Sergey M․ 7974e289a1
[postprocessor/xattr] Clarify NO_SPACE message (#14970) 2017-12-14 01:05:02 +07:00
Remita Amine 6bf9c28b0a [byutv] add support for geo restricted videos 2017-12-13 17:51:56 +01:00
Sergey M․ bec49996c6
[downloader/http] Return actual download result (closes #14971) 2017-12-13 23:49:05 +07:00
Sergey M․ c8be7d5f74
[byutv] Fix extraction (closes #14966, closes #14967) 2017-12-13 23:14:30 +07:00
Remita Amine 15960255fe [tbs] fix typo 2017-12-12 18:16:45 +01:00
Remita Amine 6b2d8c9182 [bbc.co.uk] fix extraction for 320k m3u8 streams
broken since 197224b7a4
2017-12-12 18:04:05 +01:00
Remita Amine e6b8803d59 [toutv] add support special video urls(closes #14179) 2017-12-12 11:11:44 +01:00
Remita Amine cb0c2310fb [discovery] fix free videos extraction(#14157)(#14954) 2017-12-12 10:33:03 +01:00
Remita Amine 23b6e23002 [tvnow] fix extraction(closes #7831) 2017-12-11 21:36:12 +01:00
Remita Amine 127e98d31d [nickelodeon:br] correct extractor name 2017-12-11 17:21:31 +01:00
Remita Amine e4f201bc1b [extractors] add import for NickBrIE 2017-12-11 17:19:16 +01:00
Remita Amine 08d77a95c9 [nickelodeon:br] add support for Nickelodeon(Brazil) websites(closes #14893) 2017-12-11 17:18:05 +01:00
Remita Amine 5868079e99 [nick.com] improve extraction(fixes #14876) 2017-12-11 14:37:03 +01:00
Remita Amine b6f78d76c1 [tbs] fix extraction(fixes #13658) 2017-12-11 13:39:25 +01:00
sprhawk 0c69958844 add other properties; remove print verbose 2017-12-11 16:02:14 +08:00
sprhawk 3281af3464 a working version 2017-12-11 15:56:54 +08:00
sprhawk 29ac31afaf simply get the correct webpage, but not parsed to extract information 2017-12-11 12:26:19 +08:00
Sergey M․ 1fa0dce2c0
release 2017.12.10 2017-12-10 23:18:53 +07:00
Sergey M․ c38970ca10
[culturebox] Improve video id extraction (closes #14947) 2017-12-10 22:46:21 +07:00
Remita Amine 51f2863357 [twitter] improve extraction(closes #14197) 2017-12-10 14:11:09 +01:00
Sergey M․ 913b61eeee
[udemy] Extract more HLS formats 2017-12-09 20:02:54 +07:00
Sergey M․ 6f1ec339a0
[udemy] Improve course id extraction (closes #14938) 2017-12-09 20:02:49 +07:00
Sergey M․ a3de5e6c0e
[stretchinternet] Fix issues and improve (closes #14576) 2017-12-09 17:59:08 +07:00
Andrew Bottom f4cc03d60b
[stretchinternet] Add extractor 2017-12-09 17:58:49 +07:00
Sergey M․ 2a57b62b80
[ellentube] Fix issues, improve and simplify (closes #14570) 2017-12-09 02:16:54 +07:00
Alex Seiler e2707a832c
[ellentube] Fix extraction (closes #14407) 2017-12-09 02:16:48 +07:00
Sergey M․ 1115271ac6
[raiplay:playlist] Fix issues and improve (closes #14563) 2017-12-09 00:48:04 +07:00
Timendum d21d0ba6c1
[raiplay:playlist] Add extractor 2017-12-09 00:47:40 +07:00
Remita Amine 1bd4fc96e6 [sonyliv] extract higher quality formats and bypass geo restriction(closes #14922) 2017-12-07 08:46:30 +01:00
Remita Amine 684ae10236 [fox] add support for adobe pass auth and extract subtitles(close #14489)(closes #14205) 2017-12-06 22:56:14 +01:00
Remita Amine 3c4fbfeca2 [dailymotion] remove dailymotion cloud extractor(closes #6794)
https://web.archive.org/web/20160312110217/https://www.dmcloud.net/
2017-12-06 10:56:48 +01:00
Windom b271e33526 [xhamster] Add support for mobile URLs and fix thumbnail extraction 2017-12-06 00:08:31 +07:00
Sergey M․ d3f8b76b69
[extractor/generic] Fix typo (closes #14902)
Don't pass video_id as mpd_id
2017-12-05 23:11:15 +07:00
Sergey M․ 91328f26b0
[ard] Skip invalid stream URLs (closes #14906) 2017-12-05 23:01:57 +07:00
Sergey M․ 61d18c8a4b
[porncom] Fix metadata extraction (closes #14911) 2017-12-05 22:42:02 +07:00
Sergey M․ c94427dd60
[pluralsight] Detect agreement request (#14913) 2017-12-05 22:34:56 +07:00
Remita Amine d4f05d4731 [utils] add sami mimetype to mimetype2ext 2017-12-03 00:04:43 +01:00
Remita Amine d7df308981 [toutv] fix login(closes 14614) 2017-12-02 20:22:40 +01:00
Sergey M․ 0d56eddc59
release 2017.12.02 2017-12-02 21:34:34 +07:00
Sergey M․ 78593e294c
Add references for #14844 2017-12-02 21:22:43 +07:00
Sergey M․ 593f2f7989
[downloader/fragment] Commit part file after each fragment
In order to obtain correct resume_len on next iteration
2017-12-02 21:21:11 +07:00
Sergey M․ 603fc4e0ea
[extractor/common] Add durations for DASH fragments with bare SegmentURLs 2017-12-02 21:21:01 +07:00
Petr Novak 41bf647e89
[extractor/common] Add support for DASH manifests with SegmentLists with bare SegmentURLs 2017-12-02 21:16:36 +07:00
Sergey M․ fea92aa65d
[xhamster] Fix extraction (closes #14884) 2017-12-02 19:04:59 +07:00
zcanfly 0981585bef [youku] Update ccode (closes #14872) 2017-12-02 18:16:22 +07:00
Remita Amine f5ac68d88f [mnet] fix format extraction(fixes #14883) 2017-11-30 23:45:33 +01:00
Remita Amine 1663b32946 [xiami] add Referer header to api request 2017-11-29 20:36:55 +01:00
Remita Amine 5ea765fb72 [mtv] correct scc extention in extracted subtitles(closes #13730) 2017-11-29 17:50:38 +01:00
Remita Amine fb61b57d0f [vvvvid] fix extraction for kenc videos(fixes #13406) 2017-11-29 16:09:45 +01:00
Remita Amine 07cf18b9c5 [br] add support for BR Mediathek videos(fixes #14560)(fixes #14788) 2017-11-29 14:21:38 +01:00
Remita Amine 5f699251e9 [daisuki] add support for motto.daisuki.com(fixes #14681) 2017-11-28 10:57:22 +01:00
Remita Amine a3474aa59e [Odnoklassniki] fix api metadata request(fixes #14862) 2017-11-28 09:04:51 +01:00
Remita Amine 115afb77ec [itv] update hls formats extraction 2017-11-27 21:59:27 +01:00
Remita Amine 53f024e7c5 [pbs] add another media id regex 2017-11-27 16:55:27 +01:00
Remita Amine ffe6979ef9 [utils] add hvc1 codec code to parse_codecs 2017-11-27 16:55:27 +01:00
Sergey M․ 5ddeb7702a
release 2017.11.26 2017-11-26 21:49:22 +07:00
Sergey M․ 7512aa986f
Fix some only matching tests (closes #14855) 2017-11-26 20:53:10 +07:00
Remita Amine 93f3f10cdc [fczenit] fix extraction 2017-11-25 19:28:26 +01:00
Remita Amine 87dac57cf6 [firstpost] remove extractor 2017-11-25 18:50:15 +01:00
Remita Amine b485d5d6bf [nexx] make http format ids more consistent 2017-11-25 18:36:31 +01:00
Remita Amine a238a868ba [freespeech] fix extraction 2017-11-25 18:25:00 +01:00
Remita Amine c0f647a179 [nexx] extract more formats 2017-11-25 18:13:26 +01:00
Sergey M․ 6ff27b8d5a
[openload] Don't use bare except when removing temp files 2017-11-26 00:05:28 +07:00
jahudka 9ef909f2b2 [openload] Add support for openload.link 2017-11-26 00:04:13 +07:00
Sergey M․ 8cfbcfab9a
[tnaflix] Extract common parts of tnaflix and empflix 2017-11-25 23:42:20 +07:00
Sergey M․ b7785cf156
[empflix] Relax _VALID_URL 2017-11-25 23:42:20 +07:00
Sergey M․ 9105523818
[empflix] Fix extractrion 2017-11-25 23:42:20 +07:00
Sergey M․ dbb25af657
[tnaflix] Don't modify download URLs (closes #14811) 2017-11-25 23:42:20 +07:00