Colbert Report fails again #2052

Closed
opened 2026-02-20 22:21:18 -05:00 by deekerman · 9 comments
Owner

Originally created by @wyatt8740 on GitHub (Mar 16, 2014).

$ youtube-dl http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage
ERROR: unable to find Flash URL in webpage http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

I am using the latest version from git.

Originally created by @wyatt8740 on GitHub (Mar 16, 2014). $ youtube-dl http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama [ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage ERROR: unable to find Flash URL in webpage http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update. I am using the latest version from git.
Author
Owner

@phihag commented on GitHub (Mar 16, 2014):

Works fine for me. Can you upload the files you get when passing in --write-pages and the full output when passing in -v somewhere?

@phihag commented on GitHub (Mar 16, 2014): Works fine for me. Can you upload the files you get when passing in `--write-pages` and the full output when passing in `-v` [somewhere](https://gist.github.com/)?
Author
Owner

@wyatt8740 commented on GitHub (Mar 16, 2014):

Funny. That bit is working for me now, too. But it hangs after printing '[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746'.

$ youtube-dl -v --write-pages http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', '--write-pages', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama']
[debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8'
[debug] youtube-dl version 2014.03.12
[debug] Python version 2.7.3 - Linux-3.5.0-45-generic-i686-with-LinuxMint-14-nadia
[debug] Proxy map: {}
[ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-www.colbertnation.com_full-episodes_thu-march-13-2014-simon-schama.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading show index
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http
-shadow.comedycentral.com_feeds_video_player_mrss_uri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433747.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433743
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http
-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433743.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433744
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http
-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433744.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433745
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http
-www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433745.dump
[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746
[ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http
-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433746.dump

@wyatt8740 commented on GitHub (Mar 16, 2014): Funny. That bit is working for me now, too. But it hangs after printing '[ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746'. $ youtube-dl -v --write-pages http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama [debug] System config: [] [debug] User config: [] [debug] Command-line args: ['-v', '--write-pages', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama'] [debug] Encodings: locale 'UTF-8', fs 'UTF-8', out 'UTF-8', pref: 'UTF-8' [debug] youtube-dl version 2014.03.12 [debug] Python version 2.7.3 - Linux-3.5.0-45-generic-i686-with-LinuxMint-14-nadia [debug] Proxy map: {} [ComedyCentralShows] thu-march-13-2014-simon-schama: Extracting information [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading webpage [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_www.colbertnation.com_full-episodes_thu-march-13-2014-simon-schama.dump [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading show index [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_shadow.comedycentral.com_feeds_video_player_mrss_uri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433747.dump [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433743 [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433743.dump [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433744 [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433744.dump [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433745 [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433745.dump [ComedyCentralShows] thu-march-13-2014-simon-schama: Downloading configuration for 433746 [ComedyCentralShows] Saving request to thu-march-13-2014-simon-schama_http_-_www.comedycentral.com_global_feeds_entertainment_media_mediaGenEntertainment.jhtmluri=mgid%3Acms%3Aepisode%3Acolbertnation.com%3A433746.dump
Author
Owner

@wyatt8740 commented on GitHub (Mar 16, 2014):

If it ever finishes I will upload the dumps.

@wyatt8740 commented on GitHub (Mar 16, 2014): If it ever finishes I will upload the dumps.
Author
Owner

@HalosGhost commented on GitHub (Mar 17, 2014):

This issue (hanging after downloading configurations) appears also for the DailyShow extractor (see #2573).

@HalosGhost commented on GitHub (Mar 17, 2014): This issue (hanging after downloading configurations) appears also for the DailyShow extractor (see #2573).
Author
Owner

@friedretinas commented on GitHub (Mar 20, 2014):

@wyatt8740 Worked fine for me, but I specified that the 3.31 version of the Python interpreter (whereas you are Python version 2.7.3) when launching youtube-dl script.

Make sure you also have "pthyon3" package installed and try again. Assuming youtube-dl is installed in /usr/bin , the following will invoke it using Python 3 interpreter (instead of the default 2.7.3. version that is apparently the DEFAULT version on your system).

python3 /usr/bin/youtube-dl -v http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama

@friedretinas commented on GitHub (Mar 20, 2014): @wyatt8740 Worked fine for me, but I specified that the 3.31 version of the Python interpreter (whereas you are Python version 2.7.3) when launching youtube-dl script. Make sure you also have "pthyon3" package installed and try again. Assuming youtube-dl is installed in /usr/bin , the following will invoke it using Python 3 interpreter (instead of the default 2.7.3. version that is apparently the DEFAULT version on your system). python3 /usr/bin/youtube-dl -v http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
Author
Owner

@phihag commented on GitHub (Mar 30, 2014):

With the recent updates, this should work fine now. If it doesn't, please comment and we'll reopen this issue.

@phihag commented on GitHub (Mar 30, 2014): With the recent updates, this should work fine now. If it doesn't, please comment and we'll reopen this issue.
Author
Owner

@bartpolot commented on GitHub (Aug 3, 2014):

Seems to be broken as of v2014.07.30:

$ youtube-dl --verbose http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['--verbose', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.07.30
[debug] Python version 3.4.1 - Linux-3.15.5-2-ARCH-x86_64-with-arch
[debug] Proxy map: {}
[generic] thu-march-13-2014-simon-schama: Requesting header
[redirect] Following redirect to http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama
[ComedyCentralShows] march-13--2014---simon-schama: Downloading webpage
ERROR: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Traceback (most recent call last):
File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 516, in extract_info
ie_result = ie.extract(url)
File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/common.py", line 170, in extract
return self._real_extract(url)
File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/comedycentral.py", line 143, in _real_extract
raise ExtractorError('unable to find Flash URL in webpage ' + url)
youtube_dl.utils.ExtractorError: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.

@bartpolot commented on GitHub (Aug 3, 2014): Seems to be broken as of v2014.07.30: $ youtube-dl --verbose http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama [debug] System config: [] [debug] User config: [] [debug] Command-line args: ['--verbose', 'http://www.colbertnation.com/full-episodes/thu-march-13-2014-simon-schama'] [debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8 [debug] youtube-dl version 2014.07.30 [debug] Python version 3.4.1 - Linux-3.15.5-2-ARCH-x86_64-with-arch [debug] Proxy map: {} [generic] thu-march-13-2014-simon-schama: Requesting header [redirect] Following redirect to http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama [ComedyCentralShows] march-13--2014---simon-schama: Downloading webpage ERROR: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update. Traceback (most recent call last): File "/usr/lib/python3.4/site-packages/youtube_dl/YoutubeDL.py", line 516, in extract_info ie_result = ie.extract(url) File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/common.py", line 170, in extract return self._real_extract(url) File "/usr/lib/python3.4/site-packages/youtube_dl/extractor/comedycentral.py", line 143, in _real_extract raise ExtractorError('unable to find Flash URL in webpage ' + url) youtube_dl.utils.ExtractorError: unable to find Flash URL in webpage http://thecolbertreport.cc.com/episodes/8mwoah/march-13--2014---simon-schama; please report this issue on https://yt-dl.org/bug . Be sure to call youtube-dl with the --verbose flag and include its complete output. Make sure you are using the latest version; type youtube-dl -U to update.
Author
Owner

@friedretinas commented on GitHub (Aug 4, 2014):

Used to work, but I just tried the same I got the same errors as bartpolot did. I then tried with a related URL but that yielded a different set of errors as shown.

$ youtube-dl -v http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078
[debug] System config: []
[debug] User config: []
[debug] Command-line args: ['-v', 'http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2014.08.02.1
[debug] Python version 3.3.1 - Linux-3.8.0-35-generic-x86_64-with-Peppermint-4-raring
[debug] Proxy map: {}
[ComedyCentralShows] colbert-report-10078: Downloading webpage
[ComedyCentralShows] colbert-report-10078: Downloading show index
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 1 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 2 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 3 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 4 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 5 / 6
[ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 6 / 6
[download] Downloading playlist: thecolbertreport Colbert Report 10078
[ComedyCentralShows] playlist thecolbertreport Colbert Report 10078: Collected 6 video ids (downloading 6 of them)
[download] Downloading video #1 of 6
[debug] Invoking downloader on 'http://mtvnmobile.vo.llnwd.net/kip0/_pxn=1+_pxI0=Ripod-h264+_pxL0=undefined+_pxM0=+_pxK=18639+_pxE=mp4/44620/mtvnorigin/gsp.comedystor/com/colbert/season_10/episode_078/cr_10078_01_1280x720_3500_h32.mp4'
ERROR: unable to download video data: HTTP Error 400: Bad Request
Traceback (most recent call last):
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1022, in process_info
success = dl(filename, info_dict)
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 998, in dl
return fd.download(name, info)
File "/usr/bin/youtube-dl/youtube_dl/downloader/common.py", line 291, in download
return self.real_download(filename, info_dict)
File "/usr/bin/youtube-dl/youtube_dl/downloader/http.py", line 58, in real_download
data = self.ydl.urlopen(request)
File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1231, in urlopen
return self._opener.open(req, timeout=self._socket_timeout)
File "/usr/lib/python3.3/urllib/request.py", line 479, in open
response = meth(req, response)
File "/usr/lib/python3.3/urllib/request.py", line 591, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/lib/python3.3/urllib/request.py", line 517, in error
return self._call_chain(_args)
File "/usr/lib/python3.3/urllib/request.py", line 451, in _call_chain
result = func(_args)
File "/usr/lib/python3.3/urllib/request.py", line 599, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request

@friedretinas commented on GitHub (Aug 4, 2014): Used to work, but I just tried the same I got the same errors as bartpolot did. I then tried with a related URL but that yielded a different set of errors as shown. $ youtube-dl -v http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078 [debug] System config: [] [debug] User config: [] [debug] Command-line args: ['-v', 'http://thecolbertreport.cc.com/video-playlists/mp16x2/colbert-report-10078'] [debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8 [debug] youtube-dl version 2014.08.02.1 [debug] Python version 3.3.1 - Linux-3.8.0-35-generic-x86_64-with-Peppermint-4-raring [debug] Proxy map: {} [ComedyCentralShows] colbert-report-10078: Downloading webpage [ComedyCentralShows] colbert-report-10078: Downloading show index [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 1 / 6 [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 2 / 6 [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 3 / 6 [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 4 / 6 [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 5 / 6 [ComedyCentralShows] colbert-report-10078: Downloading configuration for segment 6 / 6 [download] Downloading playlist: thecolbertreport Colbert Report 10078 [ComedyCentralShows] playlist thecolbertreport Colbert Report 10078: Collected 6 video ids (downloading 6 of them) [download] Downloading video #1 of 6 [debug] Invoking downloader on 'http://mtvnmobile.vo.llnwd.net/kip0/_pxn=1+_pxI0=Ripod-h264+_pxL0=undefined+_pxM0=+_pxK=18639+_pxE=mp4/44620/mtvnorigin/gsp.comedystor/com/colbert/season_10/episode_078/cr_10078_01_1280x720_3500_h32.mp4' ERROR: unable to download video data: HTTP Error 400: Bad Request Traceback (most recent call last): File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1022, in process_info success = dl(filename, info_dict) File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 998, in dl return fd.download(name, info) File "/usr/bin/youtube-dl/youtube_dl/downloader/common.py", line 291, in download return self.real_download(filename, info_dict) File "/usr/bin/youtube-dl/youtube_dl/downloader/http.py", line 58, in real_download data = self.ydl.urlopen(request) File "/usr/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1231, in urlopen return self._opener.open(req, timeout=self._socket_timeout) File "/usr/lib/python3.3/urllib/request.py", line 479, in open response = meth(req, response) File "/usr/lib/python3.3/urllib/request.py", line 591, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python3.3/urllib/request.py", line 517, in error return self._call_chain(_args) File "/usr/lib/python3.3/urllib/request.py", line 451, in _call_chain result = func(_args) File "/usr/lib/python3.3/urllib/request.py", line 599, in http_error_default raise HTTPError(req.full_url, code, msg, hdrs, fp) urllib.error.HTTPError: HTTP Error 400: Bad Request
Author
Owner

@jaimeMF commented on GitHub (Aug 4, 2014):

@friedretinas That's a known issue: #3364.

@jaimeMF commented on GitHub (Aug 4, 2014): @friedretinas That's a known issue: #3364.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/youtube-dl#2052
No description provided.