Help with Twitter profile scraper command line #25234

Open
opened 2026-02-21 13:42:54 -05:00 by deekerman · 5 comments
Owner

Originally created by @TheMissingPort on GitHub (May 9, 2022).

Here is the line of code I enter in terminal. I put in my own username and password

youtube-dl -u, --username USERNAME -p, --password PASSWORD https://twitter.com/mankoprincess

This is what I get:

[generic] Username: Requesting header
WARNING: Falling back on generic information extractor.
[generic] Username: Downloading webpage
[generic] Username: Extracting information
ERROR: Unsupported URL: https://twitter.com/Username

Any ideas? Thanks

Originally created by @TheMissingPort on GitHub (May 9, 2022). Here is the line of code I enter in terminal. I put in my own username and password >youtube-dl -u, --username USERNAME -p, --password PASSWORD https://twitter.com/mankoprincess This is what I get: [generic] Username: Requesting header WARNING: Falling back on generic information extractor. [generic] Username: Downloading webpage [generic] Username: Extracting information ERROR: Unsupported URL: https://twitter.com/Username Any ideas? Thanks
Author
Owner

@dirkf commented on GitHub (May 9, 2022):

The option name is either -u or --username, not both. Similarly with -p. So no commas, either.

The short names are convenient; the long names can be better in scripts that people may want to read without having to look up what each option means.

Also, it's possible that the login procedure doesn't work in the Twitter extractor (any longer, if it did). You may need to use --cookies ..., for which read the manual.

@dirkf commented on GitHub (May 9, 2022): The option name is either `-u` or `--username`, not both. Similarly with `-p`. So no commas, either. The short names are convenient; the long names can be better in scripts that people may want to read without having to look up what each option means. Also, it's possible that the login procedure doesn't work in the Twitter extractor (any longer, if it did). You may need to use `--cookies ...`, for which read the manual.
Author
Owner

@TheMissingPort commented on GitHub (May 9, 2022):

The option name is either -u or --username, not both. Similarly with -p. So no commas, either.

The short names are convenient; the long names can be better in scripts that people may want to read without having to look up what each option means.

Also, it's possible that the login procedure doesn't work in the Twitter extractor (any longer, if it did). You may need to use --cookies ..., for which read the manual.

Thanks for the response. I updated my line but I still get "unsupported URL" error. Is there something else im missing?

it looks like this now (changed my info to "username" for privacy)

youtube-dl -u username -p password! https://twitter.com/username

@TheMissingPort commented on GitHub (May 9, 2022): > The option name is either `-u` or `--username`, not both. Similarly with `-p`. So no commas, either. > > The short names are convenient; the long names can be better in scripts that people may want to read without having to look up what each option means. > > Also, it's possible that the login procedure doesn't work in the Twitter extractor (any longer, if it did). You may need to use `--cookies ...`, for which read the manual. Thanks for the response. I updated my line but I still get "unsupported URL" error. Is there something else im missing? it looks like this now (changed my info to "username" for privacy) >youtube-dl -u username -p password! https://twitter.com/username
Author
Owner

@dirkf commented on GitHub (May 9, 2022):

The extractor module for Twitter doesn't extract an entire profile. Things like these might work:

@dirkf commented on GitHub (May 9, 2022): The extractor module for Twitter doesn't extract an entire profile. Things like these might work: * https://twitter.com/i/cards/tfw/v1/560070183650213889 * https://twitter.com/i/videos/tweet/705235433198714880 * https://twitter.com/starwars/status/665052190608723968 * https://twitter.com/i/web/status/910031516746514432
Author
Owner

@TheMissingPort commented on GitHub (May 9, 2022):

The extractor module for Twitter doesn't extract an entire profile. Things like these might work:

Is it possible to extract all media from a profile?

@TheMissingPort commented on GitHub (May 9, 2022): > The extractor module for Twitter doesn't extract an entire profile. Things like these might work: > > * https://twitter.com/i/cards/tfw/v1/560070183650213889 > * https://twitter.com/i/videos/tweet/705235433198714880 > * https://twitter.com/starwars/status/665052190608723968 > * https://twitter.com/i/web/status/910031516746514432 Is it possible to extract all media from a profile?
Author
Owner

@afterdelight commented on GitHub (May 16, 2022):

use gallery-dl instead and read my issue
https://github.com/mikf/gallery-dl/issues/2588

@afterdelight commented on GitHub (May 16, 2022): use gallery-dl instead and read my issue\ https://github.com/mikf/gallery-dl/issues/2588
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/youtube-dl-ytdl-org#25234
No description provided.