[AnimeBytes] Ratelimited during search. #831

New issue

Closed

opened 2026-02-20 10:04:05 -05:00 by deekerman · 0 comments

deekerman commented

2026-02-20 10:04:05 -05:00

Owner

Originally created by @lflare on GitHub (Apr 5, 2023).

Originally assigned to: @bakerboy448 on GitHub.

Is there an existing issue for this?

I have searched the existing open and closed issues

Current Behavior

The current master build of Prowlarr triggers the ratelimit enforcement action of AnimeBytes too frequently. This seems to be caused by a change made to the site about 12 hours ago from this bug report, (5th Apr 4PM GMT).

Officially stated on the wiki, the API endpoint scrape.php has a rate limit of 1 request every 10 seconds, though enforcement action such as returning a 429 only applies past 3 requests every 10 seconds.

This somehow trips up accompanying applications like Sonarr resulting in complete search/scrape failure.

Expected Behavior

Perhaps Prowlarr can have some kind of throttling mechanism, to delay or slow requests down to 1~2 requests / 10 seconds? Even better, perhaps configurable on a per-indexer scale?

Steps To Reproduce

No response

Environment

- OS: Ubuntu 22.04
- Prowlarr: Prowlarr 1.2.2.2699
- Docker Install: No
- Using Reverse Proxy: Yes
- Browser: Not related

What branch are you running?

Master

Trace Logs?

2023-04-06 00:19:47.7|Info|ReleaseSearchService|Searching indexer(s): [AnimeBytes] for Term: [Tengoku Daimakyo 01], Offset: 0, Limit: 100, Categories: [5000, 2000]
2023-04-06 00:19:47.7|Debug|AnimeBytes|Downloading Feed https://animebytes.tv/scrape.php?username=(removed)&torrent_pass=(removed)&type=anime&searchstr=Tengoku+Daimakyo&anime[tv_series]=1&anime[tv_special]=1&anime[ova]=1&anime[ona]=1&anime[dvd_special]=1&anime[bd_special]=1&anime[movie]=1
2023-04-06 00:19:47.7|Warn|AnimeBytes|HTTP Error - Res: [GET] https://animebytes.tv/scrape.php?username=(removed)&torrent_pass=(removed)&type=anime&searchstr=Tengoku+Daimakyo&anime[tv_series]=1&anime[tv_special]=1&anime[ova]=1&anime[ona]=1&anime[dvd_special]=1&anime[bd_special]=1&anime[movie]=1: 429.TooManyRequests (5363 bytes)
<!DOCTYPE html>
<!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en-US"> <![endif]-->
<!--[if IE 7]>    <html class="no-js ie7 oldie" lang="en-US"> <![endif]-->
<!--[if IE 8]>    <html class="no-js ie8 oldie" lang="en-US"> <![endif]-->
<!--[if gt IE 8]><!--> <html class="no-js" lang="en-US"> <!--<![endif]-->
<head>
<title>Access denied | animebytes.tv used Cloudflare to restrict access</title>
<meta charset="UTF-8" />
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
<meta http-equiv="X-UA-Compatible" content="IE=Edge" />
<meta name="robots" content="noindex, nofollow" />
<meta name="viewport" content="width=device-width,initial-scale=1" />
<link rel="stylesheet" id="cf_styles-css" href="/cdn-cgi/styles/main.css" />


<script>
(function(){if(document.addEventListener&&window.XMLHttpRequest&&JSON&&JSON.stringify){var e=function(a){var c=document.getElementById("error-feedback-survey"),d=document.getElementById("error-feedback-success"),b=new XMLHttpRequest;a={event:"feedback clicked",properties:{errorCode:1015,helpful:a,version:1}};b.open("POST","https://sparrow.cloudflare.com/api/v1/event");b.setRequestHeader("Content-Type","application/json");b.setRequestHeader("Sparrow-Source-Key","**REDACTED**");
b.send(JSON.stringify(a));c.classList.add("feedback-hidden");d.classList.remove("feedback-hidden")};document.addEventListener("DOMContentLoaded",function(){var a=document.getElementById("error-feedback"),c=document.getElementById("feedback-button-yes"),d=document.getElementById("feedback-button-no");"classList"in a&&(a.classList.remove("feedback-hidden"),c.addEventListener("click",function(){e(!0)}),d.addEventListener("click",function(){e(!1)}))})}})();
</script>

<script defer src="https://performance.radar.cloudflare.com/beacon.js"></script>
</head>
<body>
  <div id="cf-wrapper">
    <div class="cf-alert cf-alert-error cf-cookie-error hidden" id="cookie-alert" data-translate="enable_cookies">Please enable cookies.</div>
    <div id="cf-error-details" class="p-0">
      <header class="mx-auto pt-10 lg:pt-6 lg:px-8 w-240 lg:w-full mb-15 antialiased">
         <h1 class="inline-block md:block mr-2 md:mb-2 font-light text-60 md:text-3xl text-black-dark leading-tight">
           <span data-translate="error">Error</span>
           <span>1015</span>
         </h1>
         <span class="inline-block md:block heading-ray-id font-mono text-15 lg:text-sm lg:leading-relaxed">Ray ID: 7b331d5fade7492b &bull;</span>
         <span class="inline-block md:block heading-ray-id font-mono text-15 lg:text-sm lg:leading-relaxed">2023-04-05 16:19:47 UTC</span>
        <h2 class="text-gray-600 leading-1.3 text-3xl lg:text-2xl font-light">You are being rate limited</h2>
      </header>

      <section class="w-240 lg:w-full mx-auto mb-8 lg:px-8">
          <div id="what-happened-section" class="w-1/2 md:w-full">
            <h2 class="text-3xl leading-tight font-normal mb-4 text-black-dark antialiased" data-translate="what_happened">What happened?</h2>
            <p>The owner of this website (animebytes.tv) has banned you temporarily from accessing this website.</p>
            
          </div>

          
      </section>

      <div class="feedback-hidden py-8 text-center" id="error-feedback">
    <div id="error-feedback-survey" class="footer-line-wrapper">
        Was this page helpful?
        <button class="border border-solid bg-white cf-button cursor-pointer ml-4 px-4 py-2 rounded" id="feedback-button-yes" type="button">Yes</button>
        <button class="border border-solid bg-white cf-button cursor-pointer ml-4 px-4 py-2 rounded" id="feedback-button-no" type="button">No</button>
    </div>
    <div class="feedback-success feedback-hidden" id="error-feedback-success">
        Thank you for your feedback!
    </div>
</div>


      <div class="cf-error-footer cf-wrapper w-240 lg:w-full py-10 sm:py-4 sm:px-8 mx-auto text-center sm:text-left border-solid border-0 border-t border-gray-300">
  <p class="text-13">
    <span class="cf-footer-item sm:block sm:mb-1">Cloudflare Ray ID: <strong class="font-semibold">**REDACTED**</strong></span>
    <span class="cf-footer-separator sm:hidden">&bull;</span>
    <span id="cf-footer-item-ip" class="cf-footer-item hidden sm:block sm:mb-1">
      Your IP: **REDACTED**
      <button type="button" id="cf-footer-ip-reveal" class="cf-footer-ip-reveal-btn">Click to reveal</button>
      <span class="cf-footer-separator sm:hidden">&bull;</span>
    </span>
    <span class="cf-footer-item sm:block sm:mb-1"><span>Performance &amp; security by</span> <a rel="noopener noreferrer" href="https://www.cloudflare.com/5xx-error-landing" id="brand_link" target="_blank">Cloudflare</a></span>
    
  </p>
  <script>(function(){function d(){var b=a.getElementById("cf-footer-item-ip"),c=a.getElementById("cf-footer-ip-reveal");b&&"classList"in b&&(b.classList.remove("hidden"),c.addEventListener("click",function(){c.classList.add("hidden");a.getElementById("cf-footer-ip").classList.remove("hidden")}))}var a=document;document.addEventListener&&a.addEventListener("DOMContentLoaded",d)})();</script>
</div><!-- /.error-footer -->


    </div><!-- /#cf-error-details -->
  </div><!-- /#cf-wrapper -->

  <script>
  window._cf_translation = {};
  
  
</script>

</body>
</html>

2023-04-06 00:19:47.8|Warn|AnimeBytes|Request Limit reached for AnimeBytes. Disabled for 00:00:10
2023-04-06 00:19:47.8|Debug|ReleaseSearchService|Total of 0 reports were found for Term: [Tengoku Daimakyo 01], Offset: 0, Limit: 100, Categories: [5000, 2000] from 1 indexer(s)
2023-04-06 00:19:47.8|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated.
2023-04-06 00:19:47.8|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated.
2023-04-06 00:19:48.1|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated.
2023-04-06 00:19:48.1|Debug|Cardigann|Parsing
2023-04-06 00:19:48.2|Debug|Cardigann|Got 11 releases

Originally created by @lflare on GitHub (Apr 5, 2023). Originally assigned to: @bakerboy448 on GitHub. ### Is there an existing issue for this? - [X] I have searched the existing open and closed issues ### Current Behavior The current `master` build of Prowlarr triggers the ratelimit enforcement action of AnimeBytes too frequently. This seems to be caused by a change made to the site about 12 hours ago from this bug report, (5th Apr 4PM GMT). Officially stated on the wiki, the API endpoint `scrape.php` has a rate limit of **1 request** every **10 seconds**, though enforcement action such as returning a 429 only applies past **3 requests** every **10 seconds**. This somehow trips up accompanying applications like Sonarr resulting in complete search/scrape failure. ### Expected Behavior Perhaps Prowlarr can have some kind of throttling mechanism, to delay or slow requests down to 1~2 requests / 10 seconds? Even better, perhaps configurable on a per-indexer scale? ### Steps To Reproduce _No response_ ### Environment ```markdown - OS: Ubuntu 22.04 - Prowlarr: Prowlarr 1.2.2.2699 - Docker Install: No - Using Reverse Proxy: Yes - Browser: Not related ``` ### What branch are you running? Master ### Trace Logs? ``` 2023-04-06 00:19:47.7|Info|ReleaseSearchService|Searching indexer(s): [AnimeBytes] for Term: [Tengoku Daimakyo 01], Offset: 0, Limit: 100, Categories: [5000, 2000] 2023-04-06 00:19:47.7|Debug|AnimeBytes|Downloading Feed https://animebytes.tv/scrape.php?username=(removed)&torrent_pass=(removed)&type=anime&searchstr=Tengoku+Daimakyo&anime[tv_series]=1&anime[tv_special]=1&anime[ova]=1&anime[ona]=1&anime[dvd_special]=1&anime[bd_special]=1&anime[movie]=1 2023-04-06 00:19:47.7|Warn|AnimeBytes|HTTP Error - Res: [GET] https://animebytes.tv/scrape.php?username=(removed)&torrent_pass=(removed)&type=anime&searchstr=Tengoku+Daimakyo&anime[tv_series]=1&anime[tv_special]=1&anime[ova]=1&anime[ona]=1&anime[dvd_special]=1&anime[bd_special]=1&anime[movie]=1: 429.TooManyRequests (5363 bytes) <!DOCTYPE html>     <html class="no-js" lang="en-US">  <head> <title>Access denied | animebytes.tv used Cloudflare to restrict access</title> <meta charset="UTF-8" /> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <meta http-equiv="X-UA-Compatible" content="IE=Edge" /> <meta name="robots" content="noindex, nofollow" /> <meta name="viewport" content="width=device-width,initial-scale=1" /> <link rel="stylesheet" id="cf_styles-css" href="/cdn-cgi/styles/main.css" /> <script> (function(){if(document.addEventListener&&window.XMLHttpRequest&&JSON&&JSON.stringify){var e=function(a){var c=document.getElementById("error-feedback-survey"),d=document.getElementById("error-feedback-success"),b=new XMLHttpRequest;a={event:"feedback clicked",properties:{errorCode:1015,helpful:a,version:1}};b.open("POST","https://sparrow.cloudflare.com/api/v1/event");b.setRequestHeader("Content-Type","application/json");b.setRequestHeader("Sparrow-Source-Key","**REDACTED**"); b.send(JSON.stringify(a));c.classList.add("feedback-hidden");d.classList.remove("feedback-hidden")};document.addEventListener("DOMContentLoaded",function(){var a=document.getElementById("error-feedback"),c=document.getElementById("feedback-button-yes"),d=document.getElementById("feedback-button-no");"classList"in a&&(a.classList.remove("feedback-hidden"),c.addEventListener("click",function(){e(!0)}),d.addEventListener("click",function(){e(!1)}))})}})(); </script> <script defer src="https://performance.radar.cloudflare.com/beacon.js"></script> </head> <body> <div id="cf-wrapper"> <div class="cf-alert cf-alert-error cf-cookie-error hidden" id="cookie-alert" data-translate="enable_cookies">Please enable cookies.</div> <div id="cf-error-details" class="p-0"> <header class="mx-auto pt-10 lg:pt-6 lg:px-8 w-240 lg:w-full mb-15 antialiased"> <h1 class="inline-block md:block mr-2 md:mb-2 font-light text-60 md:text-3xl text-black-dark leading-tight"> <span data-translate="error">Error</span> <span>1015</span> </h1> <span class="inline-block md:block heading-ray-id font-mono text-15 lg:text-sm lg:leading-relaxed">Ray ID: 7b331d5fade7492b •</span> <span class="inline-block md:block heading-ray-id font-mono text-15 lg:text-sm lg:leading-relaxed">2023-04-05 16:19:47 UTC</span> <h2 class="text-gray-600 leading-1.3 text-3xl lg:text-2xl font-light">You are being rate limited</h2> </header> <section class="w-240 lg:w-full mx-auto mb-8 lg:px-8"> <div id="what-happened-section" class="w-1/2 md:w-full"> <h2 class="text-3xl leading-tight font-normal mb-4 text-black-dark antialiased" data-translate="what_happened">What happened?</h2> <p>The owner of this website (animebytes.tv) has banned you temporarily from accessing this website.</p> </div> </section> <div class="feedback-hidden py-8 text-center" id="error-feedback"> <div id="error-feedback-survey" class="footer-line-wrapper"> Was this page helpful? <button class="border border-solid bg-white cf-button cursor-pointer ml-4 px-4 py-2 rounded" id="feedback-button-yes" type="button">Yes</button> <button class="border border-solid bg-white cf-button cursor-pointer ml-4 px-4 py-2 rounded" id="feedback-button-no" type="button">No</button> </div> <div class="feedback-success feedback-hidden" id="error-feedback-success"> Thank you for your feedback! </div> </div> <div class="cf-error-footer cf-wrapper w-240 lg:w-full py-10 sm:py-4 sm:px-8 mx-auto text-center sm:text-left border-solid border-0 border-t border-gray-300"> <p class="text-13"> <span class="cf-footer-item sm:block sm:mb-1">Cloudflare Ray ID: <strong class="font-semibold">**REDACTED**</strong></span> <span class="cf-footer-separator sm:hidden">•</span> <span id="cf-footer-item-ip" class="cf-footer-item hidden sm:block sm:mb-1"> Your IP: **REDACTED** <button type="button" id="cf-footer-ip-reveal" class="cf-footer-ip-reveal-btn">Click to reveal</button> <span class="cf-footer-separator sm:hidden">•</span> </span> <span class="cf-footer-item sm:block sm:mb-1"><span>Performance & security by</span> <a rel="noopener noreferrer" href="https://www.cloudflare.com/5xx-error-landing" id="brand_link" target="_blank">Cloudflare</a></span> </p> <script>(function(){function d(){var b=a.getElementById("cf-footer-item-ip"),c=a.getElementById("cf-footer-ip-reveal");b&&"classList"in b&&(b.classList.remove("hidden"),c.addEventListener("click",function(){c.classList.add("hidden");a.getElementById("cf-footer-ip").classList.remove("hidden")}))}var a=document;document.addEventListener&&a.addEventListener("DOMContentLoaded",d)})();</script> </div> </div> </div> <script> window._cf_translation = {}; </script> </body> </html> 2023-04-06 00:19:47.8|Warn|AnimeBytes|Request Limit reached for AnimeBytes. Disabled for 00:00:10 2023-04-06 00:19:47.8|Debug|ReleaseSearchService|Total of 0 reports were found for Term: [Tengoku Daimakyo 01], Offset: 0, Limit: 100, Categories: [5000, 2000] from 1 indexer(s) 2023-04-06 00:19:47.8|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated. 2023-04-06 00:19:47.8|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated. 2023-04-06 00:19:48.1|Debug|Prowlarr.Http.Authentication.ApiKeyAuthenticationHandler|AuthenticationScheme: API was successfully authenticated. 2023-04-06 00:19:48.1|Debug|Cardigann|Parsing 2023-04-06 00:19:48.2|Debug|Cardigann|Got 11 releases ```