Feature Request: Download all videos that haven't been downloaded before #6475

Closed
opened 2026-02-21 02:00:14 -05:00 by deekerman · 8 comments
Owner

Originally created by @forthrin on GitHub (Dec 20, 2015).

Take a look at Apple Trailers Downloader. It has the brilliant function of continuously downloading all new ("Latest") trailers from Apple, by keeping track of already downloaded trailers by checking a text file rather than local file existence. Thus trailers that are downloaded earlier and deleted are not downloaded again!

youtube-dl already supports Apple Trailers. Could a similar "download all videos that haven't been downloaded earlier" functionality be added for all sites that have video lists of some sort. I reckon a single text file would suffice for keeping track of all downloaded videos.

Originally created by @forthrin on GitHub (Dec 20, 2015). Take a look at [Apple Trailers Downloader](https://github.com/aag/apple_trailer_downloader). It has the brilliant function of continuously downloading all new ("Latest") trailers from Apple, by keeping track of already downloaded trailers by checking a text file rather than local file existence. Thus trailers that are downloaded earlier and deleted are not downloaded again! `youtube-dl` already supports Apple Trailers. Could a similar "download all videos that haven't been downloaded earlier" functionality be added for all sites that have video lists of some sort. I reckon a single text file would suffice for keeping track of all downloaded videos.
Author
Owner

@dstftw commented on GitHub (Dec 20, 2015):

Use --download-archive.

@dstftw commented on GitHub (Dec 20, 2015): Use `--download-archive`.
Author
Owner

@forthrin commented on GitHub (Dec 20, 2015):

You guys have thought of everything, haven't you? :) I really got to read the manual thoroughly some day! However, which URL do I give youtube-dl for downloading all (latest) Apple Trailers?

youtube-dl --download-archive ~/.youtube-dl.txt http://trailers.apple.com/#section=justadded
ERROR: Unsupported URL: http://trailers.apple.com/#section=justadded
@forthrin commented on GitHub (Dec 20, 2015): You guys have thought of everything, haven't you? :) I really got to read the manual thoroughly some day! However, which URL do I give `youtube-dl` for downloading all (latest) Apple Trailers? ``` youtube-dl --download-archive ~/.youtube-dl.txt http://trailers.apple.com/#section=justadded ERROR: Unsupported URL: http://trailers.apple.com/#section=justadded ```
Author
Owner

@dstftw commented on GitHub (Dec 20, 2015):

Trailers' playlists are unsupported currently.

@dstftw commented on GitHub (Dec 20, 2015): Trailers' playlists are unsupported currently.
Author
Owner

@forthrin commented on GitHub (Dec 20, 2015):

I'll ask the author of ATD if he would be willing to merge the functionality into youtube-dl. Both tools are Python which should make things easier.

@forthrin commented on GitHub (Dec 20, 2015): I'll ask the author of ATD if he would be willing to merge the functionality into `youtube-dl`. Both tools are Python which should make things easier.
Author
Owner

@dstftw commented on GitHub (Dec 20, 2015):

youtube-dl may not depend on BeautifulSoup.

@dstftw commented on GitHub (Dec 20, 2015): youtube-dl may not depend on BeautifulSoup.
Author
Owner

@forthrin commented on GitHub (Dec 23, 2015):

See comment https://github.com/aag/apple_trailer_downloader/issues/9#issuecomment-166712991 It would be nice if someone took the effort to support playlists at Apple Trailers.

@forthrin commented on GitHub (Dec 23, 2015): See comment https://github.com/aag/apple_trailer_downloader/issues/9#issuecomment-166712991 It would be nice if someone took the effort to support playlists at Apple Trailers.
Author
Owner

@remitamine commented on GitHub (Dec 23, 2015):

support playlists at Apple Trailers.

will be supported in the next version.

youtube-dl -F http://trailers.apple.com/#section=mostpopular
[appletrailers:section] mostpopular: Downloading JSON metadata
[download] Downloading playlist: Most Popular
[appletrailers:section] playlist Most Popular: Collected 80 video ids (downloading 80 of them)
[download] Downloading video 1 of 80
[appletrailers] diablo: Downloading XML
[appletrailers] diablo-tlr1: Downloading settings json
[download] Downloading playlist: diablo
[appletrailers] playlist diablo: Collected 1 video ids (downloading 1 of them)
[download] Downloading video 1 of 1
[info] Available formats for diablo-trailer:
format code  extension  resolution note
0            mov        848x360    
1            mov        848x360    
2            mov        1280x544   
3            mov        1280x544   
4            mov        1920x816   (best)
[download] Finished downloading playlist: diablo
[download] Downloading video 2 of 80
...
@remitamine commented on GitHub (Dec 23, 2015): > support playlists at Apple Trailers. will be supported in the next version. ``` youtube-dl -F http://trailers.apple.com/#section=mostpopular [appletrailers:section] mostpopular: Downloading JSON metadata [download] Downloading playlist: Most Popular [appletrailers:section] playlist Most Popular: Collected 80 video ids (downloading 80 of them) [download] Downloading video 1 of 80 [appletrailers] diablo: Downloading XML [appletrailers] diablo-tlr1: Downloading settings json [download] Downloading playlist: diablo [appletrailers] playlist diablo: Collected 1 video ids (downloading 1 of them) [download] Downloading video 1 of 1 [info] Available formats for diablo-trailer: format code extension resolution note 0 mov 848x360 1 mov 848x360 2 mov 1280x544 3 mov 1280x544 4 mov 1920x816 (best) [download] Finished downloading playlist: diablo [download] Downloading video 2 of 80 ... ```
Author
Owner

@forthrin commented on GitHub (Dec 23, 2015):

That's brilliant news! I really appreciate it and will use it a lot. I'm quite impressed with the prompt responses for this tool. Keep up the good work!

@forthrin commented on GitHub (Dec 23, 2015): That's brilliant news! I really appreciate it and will use it a lot. I'm quite impressed with the prompt responses for this tool. Keep up the good work!
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/youtube-dl#6475
No description provided.