[twitch] Error getting data in GQL response #25861

Open
opened 2026-02-21 14:01:21 -05:00 by deekerman · 1 comment
Owner

Originally created by @DesweR on GitHub (Feb 24, 2023).

Checklist

  • I'm reporting a broken site support issue
  • I've verified that I'm running youtube-dl version 2022.11.13 / last commit: 1a4fbe8
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar bug reports including closed ones
  • I've read bugs section in FAQ

Verbose log

youtube-dl.exe -v -F https://www.twitch.tv/videos/1744660246

[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['-v', '-F', 'https://www.twitch.tv/videos/1744660246']
[debug] Encodings: locale cp1251, fs mbcs, out cp1251, pref cp1251
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.4.4 (CPython) - Windows-XP-5.1.2600-SP3
[debug] exe versions: none
[debug] Proxy map: {}

[twitch:vod] 1744660246: Downloading stream metadata GraphQL

ERROR: An extractor error has occurred. (caused by KeyError('data',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 535, in extract
    ie_result = self._real_extract(url)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 332, in _real_extract
    info = self._download_info(vod_id)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 263, in _download_info
    'Downloading stream metadata GraphQL')[0]['data']
KeyError: 'data'
Traceback (most recent call last):
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 535, in extract
    ie_result = self._real_extract(url)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 332, in _real_extract
    info = self._download_info(vod_id)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 263, in _download_info
    'Downloading stream metadata GraphQL')[0]['data']
KeyError: 'data'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\YoutubeDL.py", line 816, in wrapper
    return func(self, *args, **kwargs)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\YoutubeDL.py", line 837, in __extract_info
    ie_result = ie.extract(url)
  File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 548, in extract
    raise ExtractorError('An extractor error has occurred.', cause=e)
youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('data',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.

Description

The error description is here.
The solution is here.

twitch.py

from ..utils import (
    ...
    traverse_obj,
    ...
)

    def _download_info(self, item_id):
        data = self._download_gql(
            item_id, [{
                'operationName': 'VideoMetadata',
                'variables': {
                    'channelLogin': '',
                    'videoID': item_id,
                },
            }],
            'Downloading stream metadata GraphQL')
        video = traverse_obj(data, (Ellipsis, 'data', 'video'), get_all=False)
        if video is None:
            raise ExtractorError(
                'Video %s does not exist' % item_id, expected=True)
        return self._extract_info_gql(video, item_id)
Originally created by @DesweR on GitHub (Feb 24, 2023). <!-- ###################################################################### WARNING! IGNORING THE FOLLOWING TEMPLATE WILL RESULT IN ISSUE CLOSED AS INCOMPLETE ###################################################################### --> ## Checklist <!-- Carefully read and work through this check list in order to prevent the most common mistakes and misuse of youtube-dl: - First of, make sure you are using the latest version of youtube-dl. Run `youtube-dl --version` and ensure your version is 2021.12.17. If it's not, see https://yt-dl.org/update on how to update. Issues with outdated version will be REJECTED. - Make sure that all provided video/audio/playlist URLs (if any) are alive and playable in a browser. - Make sure that all URLs and arguments with special characters are properly quoted or escaped as explained in http://yt-dl.org/escape. - Search the bugtracker for similar issues: http://yt-dl.org/search-issues. DO NOT post duplicates. - Read bugs section in FAQ: http://yt-dl.org/reporting - Finally, put x into all relevant boxes (like this [x]) --> - [x] I'm reporting a broken site support issue - [x] I've verified that I'm running youtube-dl version **2022.11.13 / last commit: 1a4fbe8** - [x] I've checked that all provided URLs are alive and playable in a browser - [x] I've checked that all URLs and arguments with special characters are properly quoted or escaped - [x] I've searched the bugtracker for similar bug reports including closed ones - [x] I've read bugs section in FAQ ## Verbose log <!-- Provide the complete verbose output of youtube-dl that clearly demonstrates the problem. Add the `-v` flag to your command line you run youtube-dl with (`youtube-dl -v <your command line>`), copy the WHOLE output and insert it below. It should look similar to this: [debug] System config: [] [debug] User config: [] [debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj'] [debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251 [debug] youtube-dl version 2021.12.17 [debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2 [debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4 [debug] Proxy map: {} <more lines> --> ``` youtube-dl.exe -v -F https://www.twitch.tv/videos/1744660246 [debug] System config: [] [debug] User config: [] [debug] Custom config: [] [debug] Command-line args: ['-v', '-F', 'https://www.twitch.tv/videos/1744660246'] [debug] Encodings: locale cp1251, fs mbcs, out cp1251, pref cp1251 [debug] youtube-dl version 2021.12.17 [debug] Python version 3.4.4 (CPython) - Windows-XP-5.1.2600-SP3 [debug] exe versions: none [debug] Proxy map: {} [twitch:vod] 1744660246: Downloading stream metadata GraphQL ERROR: An extractor error has occurred. (caused by KeyError('data',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. Traceback (most recent call last): File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 535, in extract ie_result = self._real_extract(url) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 332, in _real_extract info = self._download_info(vod_id) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 263, in _download_info 'Downloading stream metadata GraphQL')[0]['data'] KeyError: 'data' Traceback (most recent call last): File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 535, in extract ie_result = self._real_extract(url) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 332, in _real_extract info = self._download_info(vod_id) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\twitch.py", line 263, in _download_info 'Downloading stream metadata GraphQL')[0]['data'] KeyError: 'data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\YoutubeDL.py", line 816, in wrapper return func(self, *args, **kwargs) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\YoutubeDL.py", line 837, in __extract_info ie_result = ie.extract(url) File "D:\Python27\Scripts\youtube-dl-master\dist\sse\youtube-dl.exe\youtube_dl\extractor\common.py", line 548, in extract raise ExtractorError('An extractor error has occurred.', cause=e) youtube_dl.utils.ExtractorError: An extractor error has occurred. (caused by KeyError('data',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. ``` ## Description <!-- Provide an explanation of your issue in an arbitrary form. Please make sure the description is worded well enough to be understood, see https://github.com/ytdl-org/youtube-dl#is-the-description-of-the-issue-itself-sufficient. Provide any additional information, suggested solution and as much context and examples as possible. If work on your issue requires account credentials please provide them or explain how one can obtain them. --> The error description is [here](https://github.com/yt-dlp/yt-dlp/issues/6308). The solution is [here](https://github.com/yt-dlp/yt-dlp/pull/6318). ``` twitch.py from ..utils import ( ... traverse_obj, ... ) def _download_info(self, item_id): data = self._download_gql( item_id, [{ 'operationName': 'VideoMetadata', 'variables': { 'channelLogin': '', 'videoID': item_id, }, }], 'Downloading stream metadata GraphQL') video = traverse_obj(data, (Ellipsis, 'data', 'video'), get_all=False) if video is None: raise ExtractorError( 'Video %s does not exist' % item_id, expected=True) return self._extract_info_gql(video, item_id) ```
Author
Owner

@dirkf commented on GitHub (Feb 24, 2023):

Or this for patching a yt-dl like the release that doesn't have traverse_obj():

-        video = traverse_obj(data, (Ellipsis, 'data', 'video'), get_all=False)
+        video = next(filter(None, (try_get(y, lambda x: x['data']['video'], dict) for y in data or [])), None)
@dirkf commented on GitHub (Feb 24, 2023): Or this for patching a yt-dl like the release that doesn't have `traverse_obj()`: ```diff - video = traverse_obj(data, (Ellipsis, 'data', 'video'), get_all=False) + video = next(filter(None, (try_get(y, lambda x: x['data']['video'], dict) for y in data or [])), None) ```
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/youtube-dl-ytdl-org#25861
No description provided.