226 Commits

Author	SHA1	Message	Date
pukkandan	95c01b6c16	[youtube:tab] Show alerts only from the final webpage	2021-05-18 18:09:04 +05:30
pukkandan	a06916d98e	[extractor] Add write_debug and get_param	2021-05-17 18:59:51 +05:30
coletdjnz	9297939ec3	[Youtube] Extract more formats for music.youtube URLs (#311) ... Based on: https://github.com/ytdl-org/youtube-dl/pull/28778, https://github.com/ytdl-org/youtube-dl/pull/26160 Co-authored-by: craftingmod, colethedj, pukkandan	2021-05-15 20:08:47 +05:30
pukkandan	774d79cc4c	[youtube] Add language names ... Co-authored by: nixxo, tpikonen Based on: https://github.com/ytdl-org/youtube-dl/pull/26112 Closes: #310	2021-05-15 19:27:53 +05:30
pukkandan	2412044c90	Add field name for subtitles ... Co-authored by: pukkandan, tpikonen Based on: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:52 +05:30
pukkandan	120916dac2	[youtube] multiple subtitles in same language ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/21164 Related: #310, https://github.com/ytdl-org/youtube-dl/pull/26112	2021-05-15 19:27:48 +05:30
pukkandan	0fb983f62d	[youtube] Extract audio language	2021-05-14 13:15:48 +05:30
pukkandan	0760b0a7e2	Standardize write_debug	2021-05-14 13:15:29 +05:30
pukkandan	d908aa636a	[cleanup] Fix typos	2021-05-11 23:34:40 +05:30
pukkandan	3d89341b47	[common] bugfix for when compat_opts is not given	2021-05-11 23:29:26 +05:30
pukkandan	d8ec40b39f	[rmcdecouverte] Generalize _VALID_URL ... Closes #291	2021-05-11 18:57:55 +05:30
pukkandan	fac988053f	Release 2021.05.11 ... * and some documentation improvements	2021-05-11 13:35:05 +05:30
pukkandan	61241abbb0	[generic] Respect the encoding in manifest	2021-05-11 13:32:03 +05:30
pukkandan	53ed7066ab	Option --compat-options to revert some of yt-dlp's changes ... * Deprecates `--list-formats-as-table`, `--list-formats-old`	2021-05-11 13:30:48 +05:30
pukkandan	2f567473c6	[Plugins] Prioritize plugins over standard extractors ... and prevent plugins from overwriting the standard extractor classes Closes #304	2021-05-09 04:22:27 +05:30
pukkandan	41d1cca328	Update to ytdl-commit-a726009 ... [blinkx] Remove extractor a726009987	2021-05-06 21:31:20 +05:30
pukkandan	12e73423f1	[plutotv] Fix format extraction for some urls ... * And fallback to the first urls if ad-free urls can't be found Closes #299	2021-05-06 20:28:57 +05:30
pukkandan	7700b37f39	[plutotv] Extract subtitles from manifests	2021-05-06 20:28:56 +05:30
Ashish	c28cfda81f	[SonyLiv] Fix title and series extraction (#301) ... Authored by: Ashish0804	2021-05-06 20:27:43 +05:30
pukkandan	3158150cb7	[utils] Add network_exceptions	2021-05-04 22:36:18 +05:30
pukkandan	06425e9621	[blinkx] Minor fix ... Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941	2021-05-04 22:27:44 +05:30
pukkandan	1815d1028b	[zee5] Fix py2 compatibility	2021-05-03 22:49:03 +05:30
The Hatsune Daishi	0fa9a1e236	[whowatch] Add extractor #292 ... closes #223 Authored by: nao20010128nao Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py	2021-05-02 19:43:37 +05:30
pukkandan	80185155a1	[ukcolumn] Add Extractor ... Closes #287	2021-05-02 13:57:50 +05:30
pukkandan	c755f1901f	[CBS] Improve _VALID_URL to support movies ... Closes #290 Tested by: BeeMuffins	2021-05-01 21:32:14 +05:30
pukkandan	68b91dc905	[youtube] Add oembed to reserved names	2021-05-01 21:24:31 +05:30
pukkandan	88f06afc0c	[rmcdecouverte] Improve _VALID_URL ... Closes #291	2021-05-01 21:24:31 +05:30
CXwudi	40078a55e2	[niconico] Fix bug in thumbnail extraction #289 ... Bug from: 6b1d8c1e30 Authored by: CXwudi	2021-05-01 19:35:47 +05:30
pukkandan	07e4a40a9a	[crackle] Improve extraction (See desc) ... Closes #282 * Refactor authorization as an extension to `_download_json` * Better error messages and warnings * Respect `--ignore-no-formats-error` * Extract subtitles from manifests * Try with crackle's geo-location service if all hard-coded countries fail	2021-04-29 05:20:16 +05:30
pukkandan	e28f1c0ae8	[cleanup] Fix linter and some typos ... * Also remove inconsistent use of `"` in setup.py	2021-04-28 19:59:40 +05:30
pukkandan	ef39f8600a	[curiositystream] Fix collections ... Closes #277 * A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account	2021-04-28 19:29:33 +05:30
pukkandan	2291dbce2a	[niconico] Fix HLS formats ... Closes #171 * The structure of the API JSON was changed * Smile Video seems to be no longer available. So remove the warning * Move ping to downloader * Change heartbeat interval to 40sec * Remove unnecessary API headers Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan Tested by: tsukumijima	2021-04-28 19:18:29 +05:30
pukkandan	895b0931e5	[youtube:tab] Detect playlists inside community posts	2021-04-28 19:18:06 +05:30
pukkandan	1ad047d0f7	[nebula] Move to nebula.app ... Closes #272 Tested by: Lamieur	2021-04-28 19:18:06 +05:30
pukkandan	be6202f12b	Subtitle extraction from streaming media manifests #247 ... Authored by fstirlitz Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144 Closes: #73 Fixes: https://github.com/ytdl-org/youtube-dl/issues/6106 https://github.com/ytdl-org/youtube-dl/issues/14977 https://github.com/ytdl-org/youtube-dl/issues/21438 https://github.com/ytdl-org/youtube-dl/issues/23609 https://github.com/ytdl-org/youtube-dl/issues/28132 Might also fix (untested): https://github.com/ytdl-org/youtube-dl/issues/15424 https://github.com/ytdl-org/youtube-dl/issues/18267 https://github.com/ytdl-org/youtube-dl/issues/23899 https://github.com/ytdl-org/youtube-dl/issues/24375 https://github.com/ytdl-org/youtube-dl/issues/24595 https://github.com/ytdl-org/youtube-dl/issues/27899 Related: https://github.com/ytdl-org/youtube-dl/issues/22379 https://github.com/ytdl-org/youtube-dl/pull/24517 https://github.com/ytdl-org/youtube-dl/pull/24886 https://github.com/ytdl-org/youtube-dl/pull/27215 Notes: * The functions `extractor.common._extract_..._formats` are still kept for compatibility * Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles` * Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats * AES support is untested * The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`. Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit> * Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg` * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac> * But validity of the those extracted from ISM are untested	2021-04-28 19:02:43 +05:30
Felix S	e8f834cd8d	[threeqsdn] Extract subtitles from streaming manifests	2021-04-28 17:24:50 +05:30
Felix S	e0e624ca7f	[canvas] Extract subtitles from streaming manifests	2021-04-28 17:24:19 +05:30
Felix S	ec4f374c05	[wat] Extract subtitles from streaming manifests	2021-04-28 17:24:08 +05:30
Felix S	c811e8d8bd	[atresplayer] Extract subtitles from streaming manifests	2021-04-28 17:23:56 +05:30
Felix S	b2cd5da460	[francetv] Extract subtitles from the HLS manifest	2021-04-28 17:23:47 +05:30
Felix S	2de3b21e05	[uplynk] Extract subtitles from HLS manifests	2021-04-28 17:23:37 +05:30
Felix S	4bed436371	[twitter] Extract subtitles from HLS manifests	2021-04-28 17:23:27 +05:30
Felix S	efe9dba595	[srgssr] Extract subtitles from HLS manifests	2021-04-28 17:23:16 +05:30
Felix S	47f4203dd3	[nytimes] Extract subtitles from HLS manifests	2021-04-28 17:23:05 +05:30
Felix S	015c10aeec	[roosterteeth] Use common code for subtitle extraction	2021-04-28 17:22:56 +05:30
Felix S	a00d781b73	[elonet] Use common code for subtitle extraction	2021-04-28 17:22:45 +05:30
Felix S	0c541b563f	[tv4] Extract subtitles from streaming manifests	2021-04-28 17:22:36 +05:30
Felix S	64a5cf7929	[byutv] Extract subtitles from streaming manifests	2021-04-28 17:22:27 +05:30
Felix S	7a450a3b1c	[generic] Extract subtitles from direct SSTR manifest links	2021-04-28 17:22:18 +05:30
Felix S	7de27caf16	[generic] Extract subtitles from direct DASH manifest links	2021-04-28 17:22:07 +05:30
Felix S	c26326c1be	[generic] Extract subtitles from direct HLS manifest links	2021-04-28 17:21:55 +05:30
Felix S	66a1b8643a	[downloader/ism] Support muxing TTML subtitles	2021-04-28 17:21:45 +05:30
Felix S	4a2f19abbd	[downloader/hls] Assemble single-file WebVTT subtitles from HLS segments	2021-04-28 17:21:14 +05:30
Felix S	f6a1d69a87	[extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks	2021-04-28 17:20:29 +05:30
Felix S	fd76a14259	[extractor/common, downloader/ism] Extract SSTR subtitle tracks ... _parse_ism_formats was extended into _parse_ism_formats_and_subtitles; all direct users were updated, though _extract_ism_formats was left as a compatibility wrapper. The SSTR downloader was also modified in order to prepare for muxing subtitle streams, although no support for any subtitle codecs was added in this commit.	2021-04-28 17:20:20 +05:30
Felix S	171e59edd4	[extractor/common] Extract DASH subtitle tracks ... _extract_mpd_formats and _parse_mpd_formats were extended into _…_formats_and_subtitles; wrappers with old names are provided for compatibility.	2021-04-28 17:20:11 +05:30
Felix S	a0c3b2d5cf	[extractor/common] Extract HLS subtitle tracks ... _extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles and extended to handle subtitle tracks instead of skipping them; a wrapper with the old name is provided for compatibility. _parse_m3u8_formats is likewise renamed and extended, but without adding the compatibility wrapper; the test suite is adjusted to test the enhanced method instead.	2021-04-28 17:19:57 +05:30
Felix S	19bb39202d	[extractor/common] Generalise _merge_subtitles ... This allows modifying a subtitles dictionary in-place.	2021-04-28 17:19:46 +05:30
Hadi0609	db9a564b6a	[zee5] Fix extraction for some URLs (#279) ... Closes: #278	2021-04-28 14:51:54 +05:30
Felix S	c72967d5de	[mediasite] Generalize URL pattern (#275) ... Authored by: fstirlitz	2021-04-26 17:23:20 +05:30
pukkandan	b982cbdd0e	[limelight] Obey allow_unplayable_formats	2021-04-26 10:56:55 +05:30
pukkandan	6a04a74e8b	[FormatSort] Fix for when some formats have quality and others don't	2021-04-26 10:56:54 +05:30
CXwudi	6b1d8c1e30	[niconico] Fix title and thumbnail extraction (#273) ... Authored by: CXwudi	2021-04-26 08:23:57 +05:30
Ashish	87c3d06271	[Mxplayer] Add MxplayerShowIE (#270) ... Authored by: Ashish0804	2021-04-26 08:12:51 +05:30
pukkandan	cf9d6cfb0c	[tubi] Raise "no video formats" error when video url is empty ... Related: #266	2021-04-24 17:52:33 +05:30
pukkandan	bbed5763f1	[francetvinfo] Improve video id extraction ... Closes #261	2021-04-23 00:01:09 +05:30
pukkandan	1bdae7d312	Update to ytdl-commit-7e8b3f9 ... [youtube] Remove unused code 7e8b3f9439	2021-04-22 16:54:07 +05:30
Felix S	a471f21da6	[mildom] Remove proxy (#260) ... Closes #251 Makes 2cff495997, ab406a1c0e, #252 obsolete Authored by: fstirlitz	2021-04-22 16:52:22 +05:30
pukkandan	6efb071135	[BilibiliChannel] Fix pagination ... Closes #222 ccca21d7f5 Coauthored by: nao20010128nao, pukkandan	2021-04-22 04:19:33 +05:30
pukkandan	3b4775e021	[go] Fix _VALID_URL ... Closes #255	2021-04-21 15:43:53 +05:30
pukkandan	ab406a1c0e	[mildom] Warn user of proxy	2021-04-21 15:43:22 +05:30
pukkandan	8c54a3051d	[youtube] Bugfix in _extract_ytcfg	2021-04-21 10:37:24 +05:30
pukkandan	3097d9e512	[mildom:user:vod] Download only necessary amount of pages	2021-04-19 11:41:49 +05:30
pukkandan	c1df120eda	[mildom:vod] Remove proxy ... * Proxy is needed only for live videos	2021-04-19 11:41:40 +05:30
pukkandan	2cff495997	[mildom] Change proxy ... Related: #251 Closes #252	2021-04-19 11:41:33 +05:30
pukkandan	d0491a1ebe	[twitcasting] Fix extractor ... * `Origin: https://twitcasting.tv` must be sent when requesting the webpage. Otherwise the extracted `m3u8` will always give a `502` * Fix regex for when `data-movie-playlist` is a dict containing the needed list * media initialization is fully supported; so change downloader to native Closes #220	2021-04-18 17:57:46 +05:30
nixxo	b9d68c199b	[rai] Add support for http formats (#208) ... Authored by: nixxo	2021-04-17 22:42:28 +05:30
pukkandan	201c145953	Update to ytdl-commit-9f6c03 ... [cbsnews] Fix extraction for python <3.6 9f6c03a006	2021-04-17 08:40:31 +05:30
pukkandan	5d34200268	[youtube:tab] Reload with unavailable videos for all playlists ... If the unavailable video is in a later page, the warning and button are not shown in the initial webpage So we force all playlists' initial page to reload with the correct params	2021-04-17 08:40:30 +05:30
pukkandan	b7da73eb19	Add option --ignore-no-formats-error ... * Ignores the "no video format" and similar errors * Experimental - Some extractors may still throw these errors	2021-04-17 08:40:30 +05:30
pukkandan	6a39ee13f7	Fix inconsistent use of report_warning	2021-04-17 04:16:41 +05:30
coletdjnz	358de58c4d	[youtube:tab] Show unavailable videos in playlists (#242) ... Closes #231 Authored by: colethedj	2021-04-17 04:09:08 +05:30
pukkandan	a7191c6f57	Fix some linter and typos	2021-04-16 05:31:47 +05:30
lkho	baa5873942	[viu:ott] Fix extractor (see desc) ... * add language_flag_id query param * add support for premium account (untested since I dont have a premium account) * support entire series Code from: https://github.com/blackjack4494/youtube-dlc/pull/211 https://github.com/ytdl-org/youtube-dl/pull/15182 https://github.com/ytdl-org/youtube-dl/pull/26775 Fixes: https://github.com/yt-dlp/yt-dlp/issues/219 https://github.com/ytdl-org/youtube-dl/issues/27946 https://github.com/ytdl-org/youtube-dl/issues/27863 https://github.com/ytdl-org/youtube-dl/issues/27812 https://github.com/ytdl-org/youtube-dl/issues/27464 https://github.com/ytdl-org/youtube-dl/issues/26788 https://github.com/blackjack4494/yt-dlc/issues/136 Possibly also fixes (untested): https://github.com/ytdl-org/youtube-dl/issues/16992 https://github.com/ytdl-org/youtube-dl/issues/26701 Co-authored by: lkho, pukkandan	2021-04-16 05:19:46 +05:30
coletdjnz	79360d99d3	[youtube] Standardize API calls for tabs, mixes and search (#245) ... Authored by: colethedj	2021-04-15 16:52:59 +05:30
pukkandan	46fff7105e	[youtube] Ignore invalid stretch ratio ... Closes #244	2021-04-14 15:22:17 +05:30
Ashish	b5be6dd504	[TubiTv] Add TubiTvShowIE (#243) ... Authored by: Ashish0804	2021-04-14 12:22:28 +05:30
coletdjnz	8ea3f7b909	[youtube] Improve channel syncid extraction to support ytcfg (#241) ... Authored by: colethedj	2021-04-14 10:37:03 +05:30
pukkandan	b31fdeedfd	[documentation] Improvements	2021-04-12 02:36:06 +05:30
coletdjnz	f4f751af40	[youtube] Parse API parameters from initial webpage (#230) ... * Obtain innertube_context, api_key and x-goog-visitor-id from webpage * Generalize the header & Innertube_context extraction across YouTube extractors Related: 1b0a13f33c Authored by: colethedj	2021-04-12 01:53:04 +05:30
pukkandan	1988fab7e3	[youtube] Fix thumbnail URL ... Closes: https://github.com/yt-dlp/yt-dlp/issues/233 https://github.com/ytdl-org/youtube-dl/issues/28023	2021-04-11 06:06:13 +05:30
pukkandan	f7ad71607d	Update to ytdl-commit-4fb25ff ... [maoritv] Add new extractor 4fb25ff5a3 Except: [vimeo] improve extraction 3ae9c0f410 [youtube:tab] Pass innertube context... 1b0a13f33c	2021-04-10 22:19:54 +05:30
pukkandan	f37468c41f	Fix default of dynamic_mpd	2021-04-10 20:57:53 +05:30
pukkandan	3ffc7c89b0	[youtube] Fix _extract_alerts ... * Sometimes one warning is split between multiple runs * Also simplified code	2021-04-10 20:57:27 +05:30
Henrik Heimbuerger	f1823403b0	[nebula] Add extractor (watchnebula.com) (#122) ... Authored by: hheimbuerger	2021-04-09 16:57:38 +05:30
LE	384fb069ec	[NFHSNetwork] Add extractor (#217) ... Authored by: llacb47	2021-04-09 15:33:10 +05:30
bopol	a4ddaf231e	[nitter] Fix extraction of reply tweets (#218) ... And update instance list Closes #215 Authored by: B0pol	2021-04-08 22:33:36 +05:30
pukkandan	7e60c06925	[bilibili] Fix uploader ... Related: https://github.com/yt-dlp/yt-dlp/issues/222	2021-04-08 13:22:04 +05:30
coletdjnz	d92f5d5a90	[youtube] Extract comments' approximate timestamp (#221) ... Authored by: colethedj	2021-04-07 17:09:06 +05:30
bopol	c24ce07a84	[nitter] Fix thumbnails (#216) ... Authored by: B0pol	2021-04-05 16:53:33 +05:30