starred/youtube-dl-ytdl-org

Fork 0

mirror of https://github.com/ytdl-org/youtube-dl.git synced 2026-03-02 19:17:00 -05:00

parallel download #6920

New issue

Closed

opened 2026-02-21 03:27:13 -05:00 by deekerman · 9 comments

deekerman commented

2026-02-21 03:27:13 -05:00

Owner

Originally created by @bregon on GitHub (Feb 13, 2016).

Is it possible to download from multiple url's at the same time?

Originally created by @bregon on GitHub (Feb 13, 2016). Is it possible to download from multiple url's at the same time?

deekerman closed this issue

2026-02-21 03:27:15 -05:00

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@hrxn commented on GitHub (Feb 17, 2016):

Well, you can use aria2c to download, like this:

--external-downloader COMMAND    Use the specified external downloader.
                                 Currently supports
                                 aria2c,axel,curl,httpie,wget

@hrxn commented on GitHub (Feb 17, 2016): Well, you can use aria2c to download, like this: ``` --external-downloader COMMAND Use the specified external downloader. Currently supports aria2c,axel,curl,httpie,wget ```

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@bregon commented on GitHub (Feb 17, 2016):

If I have 1000 vimeo url's in a .txt file, can I download them 10 at a time?

The external downloaders seem to want to download one url from multiple sources or in multiple segments.

@bregon commented on GitHub (Feb 17, 2016): If I have 1000 vimeo url's in a .txt file, can I download them 10 at a time? The external downloaders seem to want to download one url from multiple sources or in multiple segments.

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@hrxn commented on GitHub (Feb 17, 2016):

Uh, yes, youtube-dl hands only one URL at a time over to external downloaders like aria2c.

So, you can't do it this way. But you can always use Batchfiles (*.bat|*.cmd) (Shell scripts on Unixoids, etc.) to start youtube-dl. And you can run multiple batch files in parallel

@hrxn commented on GitHub (Feb 17, 2016): Uh, yes, youtube-dl hands only one URL at a time over to external downloaders like aria2c. So, you can't do it this way. But you can always use Batchfiles (`*.bat|*.cmd`) (Shell scripts on Unixoids, etc.) to start youtube-dl. And you can run multiple batch files in parallel

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@bregon commented on GitHub (Feb 17, 2016):

That is what I have been doing until now. Very CPU intensive.

Would it be possible to add this feature to youtube-dl?

@bregon commented on GitHub (Feb 17, 2016): That is what I have been doing until now. Very CPU intensive. Would it be possible to add this feature to youtube-dl?

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@hrxn commented on GitHub (Feb 17, 2016):

Very CPU intensive?

How many instances of youtube-dl were up and running?
You shouldn't use more than a couple, for example.

I don't really see the point. For sites like YouTube and Vimeo, for example, my download bandwidth is already saturated, you can't further 'accelerate' a download. I don't know about your internet connection, but I think it's highly unlikely that it works in any different way.

@hrxn commented on GitHub (Feb 17, 2016): Very CPU intensive? How many instances of youtube-dl were up and running? You shouldn't use more than a couple, for example. I don't really see the point. For sites like YouTube and Vimeo, for example, my download bandwidth is already saturated, you can't further 'accelerate' a download. I don't know about your internet connection, but I think it's highly unlikely that it works in any different way.

deekerman commented

2026-02-21 03:27:16 -05:00

Author

Owner

@bregon commented on GitHub (Feb 17, 2016):

On my 2.3 GHz dual-core laptop I can only run about 20.

Is it possible to modify youtube-dl to handle multiple downloads?

@bregon commented on GitHub (Feb 17, 2016): On my 2.3 GHz dual-core laptop I can only run about 20. Is it possible to modify youtube-dl to handle multiple downloads?

deekerman commented

2026-02-21 03:27:17 -05:00

Author

Owner

@yan12125 commented on GitHub (Feb 17, 2016):

Duplicate of #3746.

@yan12125 commented on GitHub (Feb 17, 2016): Duplicate of #3746.

deekerman commented

2026-02-21 03:27:17 -05:00

Author

Owner

@hrxn commented on GitHub (Feb 17, 2016):

Is it possible to modify youtube-dl to handle multiple downloads?

Yes, theoretically. But it's not feasible, it would require to rewrite significant parts of the program.
You can download in parallel when running youtube-dl in parallel.

But this doesn't help against sites that limit download rates somewhat, keep that in mind..

@hrxn commented on GitHub (Feb 17, 2016): > Is it possible to modify youtube-dl to handle multiple downloads? Yes, theoretically. But it's not feasible, it would require to rewrite significant parts of the program. You can download in parallel when running youtube-dl in parallel. But this doesn't help against sites that limit download rates somewhat, keep that in mind..

deekerman commented

2026-02-21 03:27:17 -05:00

Author

Owner

@alexanderluna commented on GitHub (Sep 26, 2019):

My bandwidth is bigger than the download speed I get from most sites. When I batch download using the -a flag it caps at around 1mb/s. Using xargs I was able to use my full bandwidth:

xargs -n 1 -P 10 youtube-dl < my_video_links.txt

My bandwidth caps at around 10mb/s so this downloads 10 videos at the same time each caping at around 1-1.2mb/s. Hope this is helpful for someone

@alexanderluna commented on GitHub (Sep 26, 2019): My bandwidth is bigger than the download speed I get from most sites. When I batch download using the `-a` flag it caps at around 1mb/s. Using xargs I was able to use my full bandwidth: `xargs -n 1 -P 10 youtube-dl < my_video_links.txt` My bandwidth caps at around 10mb/s so this downloads 10 videos at the same time each caping at around 1-1.2mb/s. Hope this is helpful for someone

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/youtube-dl-ytdl-org#6920

No description provided.

Rows
Columns