Ability to stagger RSS feed refresh interval for individual rules #14404

New issue

Closed

opened 2026-02-22 01:01:48 -05:00 by deekerman · 2 comments

deekerman commented

2026-02-22 01:01:48 -05:00

Owner

Originally created by @ghost on GitHub (Mar 7, 2023).

Suggestion

I am running into an issue with one torrent site, RARBG, where my RSS feed rules are being rate limited.

I would like to do this, but when I do I am rate limited because these are all run one after the next. There is no option to run one, wait 15 min, run the next, etc. A few will run but then others will get stuck and show up with error icons, the logs also show the error.

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76177

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=397060

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393197

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=364093

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=382389

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=39358

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393187

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76119

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=361753

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=81157

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=278518

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=84082

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=159651

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=74379

http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393189

Use case

I use jackett and, instead of using a single RSS feed for a single category and then hoping my regex rules will find the torrents I want, I would rather use the show ID. But this reveals a limitation of qBittorrent where all of these RSS rules are run one immediately after the next ( for the same category ID ) causing me to be rate limited (520). (I have set every 15 minutes in qbittorrent and cache to 2400 seconds in jackett.)

If we could stagger the RSS fetch when multiple feeds have the same category ( or maybe based on Rules in folder?) this would be avoided and I could run my rules and abide by RARBGs API rules.

As it stands I don't see a way to take advantage of the jackett show ID feature while abiding by RSS fetch API rules

Extra info/examples/attachments

2023-03-07 10:46:32	Info	Torznab search in RARBG => Found 32 releases (from cache)
2023-03-07 10:46:32	Info	Torznab search in tag:mvgroup => Found 100 releases
2023-03-07 10:46:28	Info	CardigannIndexer (mvgroupmain): Relogin required
2023-03-07 10:46:25	Info	CardigannIndexer (mvgroupforum): Relogin required
2023-03-07 10:46:24	Info	Torznab search in RARBG => Found 100 releases
2023-03-07 10:45:52	Info	Torznab search in RARBG for BluRay => Found 100 releases (from cache)
2023-03-07 10:45:52	Info	Torznab search in RARBG for .WEB => Found 100 releases (from cache)
2023-03-07 10:45:52	Info	Torznab search in RARBG for 2160p x265 => Found 100 releases
2023-03-07 10:38:07	Info	Torznab search in RARBG => Found 32 releases
2023-03-07 10:30:58	Error	Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes
2023-03-07 10:30:53	Info	Torznab search in tag:mvgroup => Found 100 releases
2023-03-07 10:30:53	Info	Torznab search in RARBG => Found 100 releases (from cache)
2023-03-07 10:30:53	Info	Torznab search in RARBG for BluRay => Found 100 releases
2023-03-07 10:30:47	Info	Torznab search in RARBG for .WEB => Found 100 releases (from cache)
2023-03-07 10:30:47	Info	Torznab search in RARBG for 2160p x265 => Found 100 releases (from cache)
2023-03-07 10:15:58	Error	Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes

Originally created by @ghost on GitHub (Mar 7, 2023). ### Suggestion I am running into an issue with one torrent site, RARBG, where my RSS feed rules are being rate limited. I would like to do this, but when I do I am rate limited because these are all run one after the next. There is no option to run one, wait 15 min, run the next, etc. A few will run but then others will get stuck and show up with error icons, the logs also show the error. ``` http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76177 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=397060 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393197 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=364093 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=382389 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=39358 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393187 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=76119 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=361753 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=81157 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=278518 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=84082 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=159651 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=74379 http://127.0.0.1:9117/api/v2.0/indexers/rarbg/results/torznab/api?apikey=redacted&t=tvsearch&cat=5000&tvdbid=393189 ``` ### Use case I use jackett and, instead of using a single RSS feed for a single category and then hoping my regex rules will find the torrents I want, I would rather use the show ID. But this reveals a limitation of qBittorrent where all of these RSS rules are run one immediately after the next ( for the same category ID ) causing me to be rate limited (520). (I have set every 15 minutes in qbittorrent and cache to 2400 seconds in jackett.) If we could stagger the RSS fetch when multiple feeds have the same category ( or maybe based on Rules in folder?) this would be avoided and I could run my rules and abide by RARBGs API rules. As it stands I don't see a way to take advantage of the jackett show ID feature while abiding by RSS fetch API rules ### Extra info/examples/attachments 2023-03-07 10:46:32 | Info | Torznab search in RARBG => Found 32 releases (from cache) -- | -- | -- 2023-03-07 10:46:32 | Info | Torznab search in tag:mvgroup => Found 100 releases 2023-03-07 10:46:28 | Info | CardigannIndexer (mvgroupmain): Relogin required 2023-03-07 10:46:25 | Info | CardigannIndexer (mvgroupforum): Relogin required 2023-03-07 10:46:24 | Info | Torznab search in RARBG => Found 100 releases 2023-03-07 10:45:52 | Info | Torznab search in RARBG for BluRay => Found 100 releases (from cache) 2023-03-07 10:45:52 | Info | Torznab search in RARBG for .WEB => Found 100 releases (from cache) 2023-03-07 10:45:52 | Info | Torznab search in RARBG for 2160p x265 => Found 100 releases 2023-03-07 10:38:07 | Info | Torznab search in RARBG => Found 32 releases 2023-03-07 10:30:58 | Error | Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes 2023-03-07 10:30:53 | Info | Torznab search in tag:mvgroup => Found 100 releases 2023-03-07 10:30:53 | Info | Torznab search in RARBG => Found 100 releases (from cache) 2023-03-07 10:30:53 | Info | Torznab search in RARBG for BluRay => Found 100 releases 2023-03-07 10:30:47 | Info | Torznab search in RARBG for .WEB => Found 100 releases (from cache) 2023-03-07 10:30:47 | Info | Torznab search in RARBG for 2160p x265 => Found 100 releases (from cache) 2023-03-07 10:15:58 | Error | Jackett.Common.IndexerException: Exception (rarbg): Rate limited with StatusCode 520, retry in 3 minutes

deekerman

2026-02-22 01:01:48 -05:00

closed this issue
added the
Feature request

RSS
labels

deekerman commented

2026-02-22 01:01:57 -05:00

Author

Owner

@luzpaz commented on GitHub (Sep 20, 2023):

Linking to #8350

@luzpaz commented on GitHub (Sep 20, 2023): Linking to #8350

deekerman commented

2026-02-22 01:01:57 -05:00

Author

Owner

@jNullj commented on GitHub (Jan 20, 2024):

Should we close this?

RARBG seems to have been shutdown https://en.wikipedia.org/wiki/RARBG#:~:text=enforcement.%5B5%5D-,Shutdown,-%5Bedit%5D
The user who opened this request seems to be deleted
There is now a rate limit feature

@jNullj commented on GitHub (Jan 20, 2024): Should we close this? 1. RARBG seems to have been shutdown https://en.wikipedia.org/wiki/RARBG#:~:text=enforcement.%5B5%5D-,Shutdown,-%5Bedit%5D 2. The user who opened this request seems to be deleted 3. There is now a rate limit feature