Error &#34;no fmt_url_map or conn information found in video info&#34; with specific video #72

Author

Owner

@kenrestivo commented on GitHub (May 30, 2011):

Yep, this one too: http://www.youtube.com/watch?v=TkPiXRNee7A

This patch fixes it, as noted above:

diff --git a/bin/youtube-dl b/bin/youtube-dl
index 3ac27a8..5946ed4 100755
--- a/bin/youtube-dl
+++ b/bin/youtube-dl
@@ -1079,7 +1079,7 @@ class YoutubeIE(InfoExtractor):
# Decide which formats to download
req_format = self._downloader.params.get('format', None)

  if 'fmt_url_map' in video_info and len(video_info['fmt_url_map']) >= 1 and ',' in video_info['fmt_url_map'][0]:

  if 'fmt_url_map' in video_info and len(video_info['fmt_url_map']) >= 1 :
    url_map = dict(tuple(pair.split('|')) for pair in video_info['fmt_url_map'][0].split(','))
    format_limit = self._downloader.params.get('format_limit', None)
    if format_limit is not None and format_limit in self._available_formats:

@kenrestivo commented on GitHub (May 30, 2011): Yep, this one too: http://www.youtube.com/watch?v=TkPiXRNee7A This patch fixes it, as noted above: diff --git a/bin/youtube-dl b/bin/youtube-dl index 3ac27a8..5946ed4 100755 --- a/bin/youtube-dl +++ b/bin/youtube-dl @@ -1079,7 +1079,7 @@ class YoutubeIE(InfoExtractor): # Decide which formats to download req_format = self._downloader.params.get('format', None) - if 'fmt_url_map' in video_info and len(video_info['fmt_url_map']) >= 1 and ',' in video_info['fmt_url_map'][0]: - if 'fmt_url_map' in video_info and len(video_info['fmt_url_map']) >= 1 : url_map = dict(tuple(pair.split('|')) for pair in video_info['fmt_url_map'][0].split(',')) format_limit = self._downloader.params.get('format_limit', None) if format_limit is not None and format_limit in self._available_formats:

deekerman commented

Author

Owner

@rifter commented on GitHub (Jul 18, 2011):

Any chance a new release could come out with this fix in?
Even the link to the cvs commit seems to be broken for me.

@rifter commented on GitHub (Jul 18, 2011): Any chance a new release could come out with this fix in? Even the link to the cvs commit seems to be broken for me.

deekerman commented

Author

Owner

@phihag commented on GitHub (Jul 18, 2011):

@rifter Should be fixed in my fork (download). Does that work for you?

@phihag commented on GitHub (Jul 18, 2011): @rifter Should be fixed in my fork ([download](https://raw.github.com/phihag/youtube-dl/master/youtube-dl)). Does that work for you?

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Jul 29, 2011):

@philhag, @kenrestivo

even with your latest update, it is failing on the new format youtube videos such as:
http://www.youtube.com/watch?v=gELpXbIbtPc
(this video is part of a live broadcast, and the url will permanently expire very soon, probably at the end of July 2011 or early August)

@gitupandgo commented on GitHub (Jul 29, 2011): @philhag, @kenrestivo even with your latest update, it is failing on the new format youtube videos such as: http://www.youtube.com/watch?v=gELpXbIbtPc (this video is part of a live broadcast, and the url will permanently expire very soon, probably at the end of July 2011 or early August)

deekerman commented

Author

Owner

@phihag commented on GitHub (Jul 31, 2011):

@gitupandgo I can reproduce the error with the mentioned youtube URL. The video is completely blocked for requests from Germany, so it'll take some time for me. It looks like there is a promising fmt_stream_map parameter we could fall back to.

@phihag commented on GitHub (Jul 31, 2011): @gitupandgo I can reproduce the error with the mentioned youtube URL. The video is completely blocked for requests from Germany, so it'll take some time for me. It looks like there is a promising `fmt_stream_map` parameter we could fall back to.

deekerman commented

Author

Owner

@phihag commented on GitHub (Jul 31, 2011):

@gitupandgo Should work now, although I haven't downloaded the whole video yet, as my US server's connection is really slow. Can you test again with my fork?

@phihag commented on GitHub (Jul 31, 2011): @gitupandgo Should work now, although I haven't downloaded the whole video yet, as my US server's connection is really slow. Can you test again with [my fork](https://raw.github.com/phihag/youtube-dl/master/youtube-dl)?

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Jul 31, 2011):

Yes, that's fixed it, although it now says while downloading that the file size is 2GB, which is a bit odd because it is a live webcam, streaming continuously without any fixed size or time limit.

@gitupandgo commented on GitHub (Jul 31, 2011): Yes, that's fixed it, although it now says while downloading that the file size is 2GB, which is a bit odd because it is a live webcam, streaming continuously without any fixed size or time limit.

deekerman commented

Author

Owner

@phihag commented on GitHub (Jul 31, 2011):

@gitupandgo Oh, ok. I'll leave my test running and see if it gets over 2GB. Can you watch more than 2GB at a time?

@phihag commented on GitHub (Jul 31, 2011): @gitupandgo Oh, ok. I'll leave my test running and see if it gets over 2GB. Can you watch more than 2GB at a time?

deekerman commented

Author

Owner

@phihag commented on GitHub (Aug 1, 2011):

@gitupandgo My test finished: youtube-dl creates a 2GB file. I'm suspecting that the youtube flash client requests a new file every 2GB. How do you think youtube-dl should handle those infinite streams? (Reassembling two or more files is quite hard). At the moment, you can call youtube-dl in a loop in a shell script or so.

@phihag commented on GitHub (Aug 1, 2011): @gitupandgo My test finished: youtube-dl creates a 2GB file. I'm suspecting that the youtube flash client requests a new file every 2GB. How do you think youtube-dl should handle those infinite streams? (Reassembling two or more files is quite hard). At the moment, you can call youtube-dl in a loop in a shell script or so.

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Aug 3, 2011):

I dunno, but I'd say it would be more "Unixy" if youtube-dl was able to handle the situation without stopping after every 2GB. Since the youtube flash player will play a live webcam stream indefinitely without any user interaction to make it continue playing after receiving every 2GB, I think youtube-dl should do the same. youtube-dl could simply append a new suffix when it is saving each 2GB chunk with filenames like filename_1, filename_2, ..., filename_N for the N-th. Would that work?

@gitupandgo commented on GitHub (Aug 3, 2011): I dunno, but I'd say it would be more "Unixy" if youtube-dl was able to handle the situation without stopping after every 2GB. Since the youtube flash player will play a live webcam stream indefinitely without any user interaction to make it continue playing after receiving every 2GB, I think youtube-dl should do the same. youtube-dl could simply append a new suffix when it is saving each 2GB chunk with filenames like filename_1, filename_2, ..., filename_N for the N-th. Would that work?

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Aug 3, 2011):

or perhaps: filename, filename_2, ..., filename_N
to retain compatibility with filenames for sizes below 2GB.

@gitupandgo commented on GitHub (Aug 3, 2011): or perhaps: filename, filename_2, ..., filename_N to retain compatibility with filenames for sizes below 2GB.

deekerman commented

Author

Owner

@phihag commented on GitHub (Aug 3, 2011):

That's a reasonable proposal (we've already a similar functionality with --auto-number). There will be a short gap in between successive files, but otherwise, it should work. I'll have a shot at it, but probably not before the weekend (plus, testing it will take quite some time).

@phihag commented on GitHub (Aug 3, 2011): That's a reasonable proposal (we've already a similar functionality with `--auto-number`). There will be a short gap in between successive files, but otherwise, it should work. I'll have a shot at it, but probably not before the weekend (plus, testing it will take quite some time).

deekerman commented

Author

Owner

@mooffie commented on GitHub (Aug 4, 2011):

@phihag Your fork works for me as well.

@mooffie commented on GitHub (Aug 4, 2011): @phihag Your fork works for me as well.

deekerman commented

Author

Owner

@pleira commented on GitHub (Aug 4, 2011):

@phihag, with your version, I could get rid of the error.

@pleira commented on GitHub (Aug 4, 2011): @phihag, with your version, I could get rid of the error.

deekerman commented

Author

Owner

@rifter commented on GitHub (Aug 4, 2011):

@phihag I tried your patched version and it seems to work. Incidentally, I noticed that there is a release today but it is giving a 404 error.

@rifter commented on GitHub (Aug 4, 2011): @phihag I tried your patched version and it seems to work. Incidentally, I noticed that there is a release today but it is giving a 404 error.

deekerman commented

Author

Owner

@anondavid commented on GitHub (Aug 4, 2011):

youtube-dl is broken! For most videos it gives this ERROR: no fmt_url_map or conn information found in video info. Anyone working on fixing this?

@anondavid commented on GitHub (Aug 4, 2011): youtube-dl is broken! For most videos it gives this ERROR: no fmt_url_map or conn information found in video info. Anyone working on fixing this?

deekerman commented

Author

Owner

@phihag commented on GitHub (Aug 4, 2011):

@anondavid A new version is out by now and should have fixed the problem. If it still persists, open a new bug, and include:

The youtube URL (or better, the whole command line)
The output of youtube-dl --version
The output of python --version

@phihag commented on GitHub (Aug 4, 2011): @anondavid A [new version](https://github.com/rg3/youtube-dl/raw/2011.08.04/youtube-dl) is out by now and should have fixed the problem. If it still persists, open a new bug, and include: - The youtube URL (or better, the whole command line) - The output of `youtube-dl --version` - The output of `python --version`

deekerman commented

Author

Owner

@anondavid commented on GitHub (Aug 4, 2011):

Thanks. The new version is working for me now. Will let you know if i hit any problems.

@anondavid commented on GitHub (Aug 4, 2011): Thanks. The new version is working for me now. Will let you know if i hit any problems.

deekerman commented

Author

Owner

@girlpunk commented on GitHub (Aug 5, 2011):

I've still got problems with this error

@girlpunk commented on GitHub (Aug 5, 2011): I've still got problems with this error

deekerman commented

Author

Owner

@girlpunk commented on GitHub (Aug 5, 2011):

oh wait, I didn't have the updated version. turns out I updated about 10 mins before it was released.

@girlpunk commented on GitHub (Aug 5, 2011): oh wait, I didn't have the updated version. turns out I updated about 10 mins before it was released.

deekerman commented

Author

Owner

@chartley commented on GitHub (Aug 6, 2011):

@phihag thanks mate, excellent work

@chartley commented on GitHub (Aug 6, 2011): @phihag thanks mate, excellent work

deekerman commented

Author

Owner

@camilopereira commented on GitHub (Aug 6, 2011):

youtube-dl --update could fix this issue

@camilopereira commented on GitHub (Aug 6, 2011): `youtube-dl --update` could fix this issue

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Aug 7, 2011):

@philhag
If it's threaded properly, why would there be any gap in between successive 2GB files? Is it an issue with python?

@gitupandgo commented on GitHub (Aug 7, 2011): @philhag If it's threaded properly, why would there be any gap in between successive 2GB files? Is it an issue with python?

deekerman commented

Author

Owner

@phihag commented on GitHub (Aug 7, 2011):

@gitupandgo Well, there are a lot of corner cases that have to be considered. For example, how do you detect that a stream is infinite? How do you prevent infinite loops of a finite file/stream? What do you do if the title changes from request to request? What do you do on errors? Do you splice the files together? How do you detect a lagging stream? Note that there is no notion of 2GB "files" on youtube's side, it's just packaging the stream into chunks.

The problem is not Python-specific at all, but I'm afraid quite complex - too complex for me. I'd appreciate a code suggestion (if possible, with tests).

@phihag commented on GitHub (Aug 7, 2011): @gitupandgo Well, there are a lot of corner cases that have to be considered. For example, how do you detect that a stream is infinite? How do you prevent infinite loops of a finite file/stream? What do you do if the title changes from request to request? What do you do on errors? Do you splice the files together? How do you detect a lagging stream? Note that there is no notion of 2GB "files" on youtube's side, it's just packaging the stream into chunks. The problem is not Python-specific at all, but I'm afraid quite complex - too complex for me. I'd appreciate a code suggestion (if possible, with tests).

deekerman commented

Author

Owner

@gitupandgo commented on GitHub (Aug 7, 2011):

Ok, I think I see what you're thinking. But I'm thinking to myself do these sorts of examples of possible problems actually occur on youtube, do they occur often enough to worry about, and should it be youtube-dl's job to worry about any of them?

I like the simplest approach of keeping youtube-dl at the minimum complexity for downloading: just blindly download each 2GB chunk into a separate file - don't worry about loops, lags, name changes. Errors are potentially troublesome, though. If an error occurs in downloading one 2GB chunk, just report it and give the user the option of either stopping or continuing. That probably needs further thought.

Once youtube-dl has to start worrying about detecting infinite loops in a finite stream, it is getting to be more like an image processing problem, bringing the risks of over-developing / over-complicating youtube-dl.

@gitupandgo commented on GitHub (Aug 7, 2011): Ok, I think I see what you're thinking. But I'm thinking to myself do these sorts of examples of possible problems actually occur on youtube, do they occur often enough to worry about, and should it be youtube-dl's job to worry about any of them? I like the simplest approach of keeping youtube-dl at the minimum complexity for downloading: just blindly download each 2GB chunk into a separate file - don't worry about loops, lags, name changes. Errors are potentially troublesome, though. If an error occurs in downloading one 2GB chunk, just report it and give the user the option of either stopping or continuing. That probably needs further thought. Once youtube-dl has to start worrying about detecting infinite loops in a finite stream, it is getting to be more like an image processing problem, bringing the risks of over-developing / over-complicating youtube-dl.

deekerman commented

Author

Owner

@aageboi commented on GitHub (Aug 10, 2011):

it's worked for me : youtube-dl --update
thx.

@aageboi commented on GitHub (Aug 10, 2011): it's worked for me : youtube-dl --update thx.

deekerman commented

Author

Owner

@0031NL commented on GitHub (Aug 20, 2011):

May I thank you phihag, your version works perfect

@0031NL commented on GitHub (Aug 20, 2011): May I thank you phihag, your version works perfect

deekerman commented

Author

Owner

@ghost commented on GitHub (Aug 23, 2011):

thanks!!

@ghost commented on GitHub (Aug 23, 2011): thanks!!

deekerman commented

Author

Owner

@marupingwl commented on GitHub (Sep 9, 2011):

youtube-dl --update

Is the easiest and perfect way to fix that problem

@marupingwl commented on GitHub (Sep 9, 2011): youtube-dl --update Is the easiest and perfect way to fix that problem

deekerman commented

Author

Owner

@rg3 commented on GitHub (Sep 10, 2011):

AFAIK this is fixed.

@rg3 commented on GitHub (Sep 10, 2011): AFAIK this is fixed.

deekerman commented

Author

Owner

@saulbass commented on GitHub (Mar 2, 2013):

i'm still having issues with this. running the latest version. works fine with recorded videos but not working with live streams.

$ youtube-dl -U
youtube-dl is up-to-date (2013.02.25)
$ youtube-dl http://www.youtube.com/watch?v=y_Rd2hByRyc
[youtube] Setting language
[youtube] y_Rd2hByRyc: Downloading video webpage
[youtube] y_Rd2hByRyc: Downloading video info webpage
[youtube] y_Rd2hByRyc: Extracting video information
ERROR: no conn or url_encoded_fmt_stream_map information found in video info

@saulbass commented on GitHub (Mar 2, 2013): i'm still having issues with this. running the latest version. works fine with recorded videos but not working with live streams. $ youtube-dl -U youtube-dl is up-to-date (2013.02.25) $ youtube-dl http://www.youtube.com/watch?v=y_Rd2hByRyc [youtube] Setting language [youtube] y_Rd2hByRyc: Downloading video webpage [youtube] y_Rd2hByRyc: Downloading video info webpage [youtube] y_Rd2hByRyc: Extracting video information ERROR: no conn or url_encoded_fmt_stream_map information found in video info

deekerman commented

Author

Owner

@DaveJMir commented on GitHub (Mar 17, 2013):

Likewise:

$ youtube-dl -v --console-title -c -t http://www.youtube.com/watch?v=oLzaaLev-yc
[debug] youtube-dl version 2013.02.25
[debug] Python version 2.7.3 - Darwin-12.3.0-x86_64-i386-64bit
[debug] Proxy map: {}
[youtube] Setting language
[youtube] oLzaaLev-yc: Downloading video webpage
[youtube] oLzaaLev-yc: Downloading video info webpage
[youtube] oLzaaLev-yc: Extracting video information
ERROR: no conn or url_encoded_fmt_stream_map information found in video info
File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"main", fname, loader, pkg_name)
File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/Users/davidm/install/bin/youtube-dl/main.py", line 17, in
youtube_dl.main()
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/init.py", line 516, in main
_real_main()
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/init.py", line 500, in _real_main
retcode = fd.download(all_urls)
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/FileDownloader.py", line 507, in download
videos = ie.extract(url)
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/InfoExtractors.py", line 93, in extract
return self._real_extract(url)
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/InfoExtractors.py", line 560, in _real_extract
self._downloader.trouble(u'ERROR: no conn or url_encoded_fmt_stream_map information found in video info')
File "/Users/davidm/install/bin/youtube-dl/youtube_dl/FileDownloader.py", line 230, in trouble
tb_data = traceback.format_list(traceback.extract_stack())

@DaveJMir commented on GitHub (Mar 17, 2013): Likewise: $ youtube-dl -v --console-title -c -t http://www.youtube.com/watch?v=oLzaaLev-yc [debug] youtube-dl version 2013.02.25 [debug] Python version 2.7.3 - Darwin-12.3.0-x86_64-i386-64bit [debug] Proxy map: {} [youtube] Setting language [youtube] oLzaaLev-yc: Downloading video webpage [youtube] oLzaaLev-yc: Downloading video info webpage [youtube] oLzaaLev-yc: Extracting video information ERROR: no conn or url_encoded_fmt_stream_map information found in video info File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main "__main__", fname, loader, pkg_name) File "/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/Users/davidm/install/bin/youtube-dl/__main__.py", line 17, in <module> youtube_dl.main() File "/Users/davidm/install/bin/youtube-dl/youtube_dl/**init**.py", line 516, in main _real_main() File "/Users/davidm/install/bin/youtube-dl/youtube_dl/__init__.py", line 500, in _real_main retcode = fd.download(all_urls) File "/Users/davidm/install/bin/youtube-dl/youtube_dl/FileDownloader.py", line 507, in download videos = ie.extract(url) File "/Users/davidm/install/bin/youtube-dl/youtube_dl/InfoExtractors.py", line 93, in extract return self._real_extract(url) File "/Users/davidm/install/bin/youtube-dl/youtube_dl/InfoExtractors.py", line 560, in _real_extract self._downloader.trouble(u'ERROR: no conn or url_encoded_fmt_stream_map information found in video info') File "/Users/davidm/install/bin/youtube-dl/youtube_dl/FileDownloader.py", line 230, in trouble tb_data = traceback.format_list(traceback.extract_stack())

deekerman commented

Author

Owner

@DaveJMir commented on GitHub (Mar 17, 2013):

In particular:
video_info['hlsvp'] is a URL to a index.m3u8 playlist (with one entry per video resolution) which appears to be what we're after.
(at the moment the stream is between rebroadcasts so I end up with a 5-second, 720p H264 video of the static splashscreen) Will retry once the stream comes to life again.

@DaveJMir commented on GitHub (Mar 17, 2013): In particular: video_info['hlsvp'] is a URL to a index.m3u8 playlist (with one entry per video resolution) which appears to be what we're after. (at the moment the stream is between rebroadcasts so I end up with a 5-second, 720p H264 video of the static splashscreen) Will retry once the stream comes to life again.

deekerman commented