starred/youtube-dl

Fork 0

mirror of https://github.com/ytdl-org/youtube-dl.git synced 2026-03-02 23:07:04 -05:00

Split Retry to Retry to Access, Retry After Partial Download and Retury when Data received. #1462

New issue

Open

opened 2026-02-20 22:11:39 -05:00 by deekerman · 4 comments

deekerman commented

2026-02-20 22:11:39 -05:00

Owner

Originally created by @sirinath on GitHub (Nov 29, 2013).

The retry option can be split to 3.

retry to access page and start download. (Keep current retry option for this)
retry a part download until completed. (Introduce a new option. This can default to inf retries as if some data is received.)
retries if no data received. (# retries if no data received in the previous try. Perhaps this also can default to 10.)

Originally created by @sirinath on GitHub (Nov 29, 2013). The retry option can be split to 3. 1) retry to access page and start download. (Keep current retry option for this) 2) retry a part download until completed. (Introduce a new option. This can default to inf retries as if some data is received.) 3) retries if no data received. (# retries if no data received in the previous try. Perhaps this also can default to 10.)

deekerman commented

2026-02-20 22:11:40 -05:00

Author

Owner

@phihag commented on GitHub (Nov 29, 2013):

I think I do understand your suggestion, but I don't see any rationale. Why should we split the option in three? I'm all for making sure that retry always works (there were some reports of an error there), but as a user, I'd certainly be confused by three different retry options.

@phihag commented on GitHub (Nov 29, 2013): I think I do understand your suggestion, but I don't see any _rationale_. **Why** should we split the option in three? I'm all for making sure that retry always works (there were some reports of an error there), but as a user, I'd certainly be confused by three different retry options.

deekerman commented

2026-02-20 22:11:41 -05:00

Author

Owner

@sirinath commented on GitHub (Nov 29, 2013):

If some data was received I do not want it to give up when the retry number is reached.

@sirinath commented on GitHub (Nov 29, 2013): If some data was received I do not want it to give up when the retry number is reached.

deekerman commented

2026-02-20 22:11:41 -05:00

Author

Owner

@sirinath commented on GitHub (Nov 30, 2013):

Also would be helpful to find a way to overcome time out errors if you had finer control on what cases to re try on:

[youtube] PW1ylyeX364: Downloading video webpage
ERROR: Unable to download video webpage: <urlopen error [Errno 10054] An existin
g connection was forcibly closed by the remote host>
Traceback (most recent call last):
File "youtube_dl\extractor\youtube.pyo", line 1265, in _real_extract
File "urllib2.pyo", line 127, in urlopen
File "urllib2.pyo", line 404, in open
File "urllib2.pyo", line 422, in _open
File "urllib2.pyo", line 382, in _call_chain
File "youtube_dl\utils.pyo", line 561, in https_open
File "urllib2.pyo", line 1184, in do_open
URLError: <urlopen error [Errno 10054] An existing connection was forcibly close
d by the remote host>
Traceback (most recent call last):
File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info
File "youtube_dl\extractor\common.pyo", line 131, in extract
File "youtube_dl\extractor\youtube.pyo", line 1267, in _real_extract
ExtractorError: Unable to download video webpage: <urlopen error [Errno 10054] A
n existing connection was forcibly closed by the remote host>

[download] Downloading video #70 of 142
[youtube] LSJnX7Fi1T4: Downloading video webpage
[youtube] LSJnX7Fi1T4: Downloading video info webpage
ERROR: The read operation timed out
Traceback (most recent call last):
File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info
File "youtube_dl\extractor\common.pyo", line 131, in extract
File "youtube_dl\extractor\youtube.pyo", line 1305, in _real_extract
File "youtube_dl\extractor\common.pyo", line 211, in _download_webpage
File "youtube_dl\extractor\common.pyo", line 176, in _download_webpage_handle
File "socket.pyo", line 351, in read
File "httplib.pyo", line 543, in read
File "httplib.pyo", line 612, in _read_chunked
File "httplib.pyo", line 658, in _safe_read
File "socket.pyo", line 380, in read
File "ssl.pyo", line 241, in recv
File "ssl.pyo", line 160, in read
SSLError: The read operation timed out

[download] Downloading video #71 of 142
[youtube] NcobAzffgvg: Downloading video webpage
[youtube] NcobAzffgvg: Downloading video info webpage
ERROR: The read operation timed out
Traceback (most recent call last):
File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info
File "youtube_dl\extractor\common.pyo", line 131, in extract
File "youtube_dl\extractor\youtube.pyo", line 1305, in _real_extract
File "youtube_dl\extractor\common.pyo", line 211, in _download_webpage
File "youtube_dl\extractor\common.pyo", line 176, in _download_webpage_handle
File "socket.pyo", line 351, in read
File "httplib.pyo", line 543, in read
File "httplib.pyo", line 603, in _read_chunked
File "httplib.pyo", line 658, in _safe_read
File "socket.pyo", line 380, in read
File "ssl.pyo", line 241, in recv
File "ssl.pyo", line 160, in read
SSLError: The read operation timed out

....
....
....

[download] 2.9% of 25.02MiB at 4.92KiB/s ETA 01:24:13ERROR: unable to downloa
d video data: timed out
Traceback (most recent call last):
File "youtube_dl\YoutubeDL.pyo", line 776, in process_info
File "youtube_dl\FileDownloader.pyo", line 593, in _do_download
File "socket.pyo", line 380, in read
File "httplib.pyo", line 567, in read
File "socket.pyo", line 380, in read
timeout: timed out

@sirinath commented on GitHub (Nov 30, 2013): Also would be helpful to find a way to overcome time out errors if you had finer control on what cases to re try on: [youtube] PW1ylyeX364: Downloading video webpage ERROR: Unable to download video webpage: <urlopen error [Errno 10054] An existin g connection was forcibly closed by the remote host> Traceback (most recent call last): File "youtube_dl\extractor\youtube.pyo", line 1265, in _real_extract File "urllib2.pyo", line 127, in urlopen File "urllib2.pyo", line 404, in open File "urllib2.pyo", line 422, in _open File "urllib2.pyo", line 382, in _call_chain File "youtube_dl\utils.pyo", line 561, in https_open File "urllib2.pyo", line 1184, in do_open URLError: <urlopen error [Errno 10054] An existing connection was forcibly close d by the remote host> Traceback (most recent call last): File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info File "youtube_dl\extractor\common.pyo", line 131, in extract File "youtube_dl\extractor\youtube.pyo", line 1267, in _real_extract ExtractorError: Unable to download video webpage: <urlopen error [Errno 10054] A n existing connection was forcibly closed by the remote host> [download] Downloading video #70 of 142 [youtube] LSJnX7Fi1T4: Downloading video webpage [youtube] LSJnX7Fi1T4: Downloading video info webpage ERROR: The read operation timed out Traceback (most recent call last): File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info File "youtube_dl\extractor\common.pyo", line 131, in extract File "youtube_dl\extractor\youtube.pyo", line 1305, in _real_extract File "youtube_dl\extractor\common.pyo", line 211, in _download_webpage File "youtube_dl\extractor\common.pyo", line 176, in _download_webpage_handle File "socket.pyo", line 351, in read File "httplib.pyo", line 543, in read File "httplib.pyo", line 612, in _read_chunked File "httplib.pyo", line 658, in _safe_read File "socket.pyo", line 380, in read File "ssl.pyo", line 241, in recv File "ssl.pyo", line 160, in read SSLError: The read operation timed out [download] Downloading video #71 of 142 [youtube] NcobAzffgvg: Downloading video webpage [youtube] NcobAzffgvg: Downloading video info webpage ERROR: The read operation timed out Traceback (most recent call last): File "youtube_dl\YoutubeDL.pyo", line 428, in extract_info File "youtube_dl\extractor\common.pyo", line 131, in extract File "youtube_dl\extractor\youtube.pyo", line 1305, in _real_extract File "youtube_dl\extractor\common.pyo", line 211, in _download_webpage File "youtube_dl\extractor\common.pyo", line 176, in _download_webpage_handle File "socket.pyo", line 351, in read File "httplib.pyo", line 543, in read File "httplib.pyo", line 603, in _read_chunked File "httplib.pyo", line 658, in _safe_read File "socket.pyo", line 380, in read File "ssl.pyo", line 241, in recv File "ssl.pyo", line 160, in read SSLError: The read operation timed out .... .... .... [download] 2.9% of 25.02MiB at 4.92KiB/s ETA 01:24:13ERROR: unable to downloa d video data: timed out Traceback (most recent call last): File "youtube_dl\YoutubeDL.pyo", line 776, in process_info File "youtube_dl\FileDownloader.pyo", line 593, in _do_download File "socket.pyo", line 380, in read File "httplib.pyo", line 567, in read File "socket.pyo", line 380, in read timeout: timed out

deekerman commented

2026-02-20 22:11:41 -05:00

Author

Owner

@sehrgut commented on GitHub (Jan 9, 2016):

#4240 is specific to the SSLError part of this. While I agree they shouldn't be split out, possible exceptions should be treated specifically enough to retry after all transient errors. Because SSLError subclasses socket.error, they are being treated as socket errors (i.e. only connection resets are treated as recoverable), while there are many recoverable SSLError.

@sehrgut commented on GitHub (Jan 9, 2016): #4240 is specific to the SSLError part of this. While I agree they shouldn't be split out, possible exceptions should be treated specifically enough to retry after all transient errors. Because SSLError subclasses socket.error, they are being treated as socket errors (i.e. only connection resets are treated as recoverable), while there are many recoverable SSLError.

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/youtube-dl#1462

No description provided.

Rows
Columns