Exclude certain domains / IPs from statistics #1601

Closed
opened 2026-03-04 01:24:41 -05:00 by deekerman · 29 comments
Owner

Originally created by @adrianmace on GitHub (May 22, 2020).

Originally assigned to: @schzhn on GitHub.

Prerequisites

Please answer the following questions for yourself before submitting an issue. YOU MAY DELETE THE PREREQUISITES SECTION.

  • I am running the latest version
  • I checked the documentation and found no answer
  • I checked to make sure that this issue has not already been filed

Problem Description

A number of devices - monitoring and updaters - check frequently for the same hostnames. Due to the fact that the TTL is overriden by Adguardhome, these checks greatly skew the statistics. My monitoring device makes 21,600 requests to google.com a day - one every 4 seconds - for example.

My Swann cameras have a bug that's causing a lookup every 5 seconds to www.amazonaws.com. 17,280 times per 24 hours.

Proposed Solution

Offer a way to remove certain domains (www.amazonaws.com) and certain IPs (192.168.1.2) from the statistics gathering process. Still apply the same customised filters and what not, but remove them from the statistics.

Alternatives Considered

Currently bypassing the Adguardhome for these devices affected and going straight to upstream DNS.

Additional Information

PiHole has this, but I like Adguardhome's UI and static Go binary more.

Originally created by @adrianmace on GitHub (May 22, 2020). Originally assigned to: @schzhn on GitHub. <!-- As an open-source project with a dedicated but small maintainer team, it can sometimes take a long time for issues to be addressed so please be patient and we will get back to you as soon as we can. --> ### Prerequisites Please answer the following questions for yourself before submitting an issue. **YOU MAY DELETE THE PREREQUISITES SECTION.** - [x] I am running the latest version - [x] I checked the documentation and found no answer - [x] I checked to make sure that this issue has not already been filed ### Problem Description A number of devices - monitoring and updaters - check frequently for the same hostnames. Due to the fact that the TTL is overriden by Adguardhome, these checks greatly skew the statistics. My monitoring device makes 21,600 requests to google.com a day - one every 4 seconds - for example. My Swann cameras have a bug that's causing a lookup every 5 seconds to www.amazonaws.com. 17,280 times per 24 hours. ### Proposed Solution Offer a way to remove certain domains (www.amazonaws.com) and certain IPs (192.168.1.2) from the statistics gathering process. Still apply the same customised filters and what not, but remove them from the statistics. ### Alternatives Considered Currently bypassing the Adguardhome for these devices affected and going straight to upstream DNS. ### Additional Information PiHole has this, but I like Adguardhome's UI and static Go binary more.
deekerman 2026-03-04 01:24:41 -05:00
Author
Owner

@ameshkov commented on GitHub (May 22, 2020):

Well, let's see how many upvotes it gets.

@ameshkov commented on GitHub (May 22, 2020): Well, let's see how many upvotes it gets.
Author
Owner

@adrianmace commented on GitHub (May 22, 2020):

Well, let's see how many upvotes it gets.

Thanks for getting back to me. All the best.

@adrianmace commented on GitHub (May 22, 2020): > Well, let's see how many upvotes it gets. Thanks for getting back to me. All the best.
Author
Owner

@ameshkov commented on GitHub (May 22, 2020):

One more similar feature request:
https://github.com/AdguardTeam/AdGuardHome/issues/1714

@ameshkov commented on GitHub (May 22, 2020): One more similar feature request: https://github.com/AdguardTeam/AdGuardHome/issues/1714
Author
Owner

@Aikatsui commented on GitHub (May 22, 2020):

Suggestion: implement this feature on single control panel https://github.com/AdguardTeam/AdGuardHome/issues/481#issuecomment-515673586 in query log then user can apply complex/flexible rules, filters, sorts (date range, time range, hide unwanted domains https://github.com/AdguardTeam/AdGuardHome/issues/594#issuecomment-469129412, hide clients, sort for certain devices) etc and then generate result for web-app wide including dashboard, lists pages (see -->#580), client page (see --> https://github.com/AdguardTeam/AdGuardHome/issues/1336) and keep till user edit or clear it manually same as github.

If add control panel(s) to dashboard then it takes unwanted space but it'll be better if dashboard results (total queries, malware/phishing, adult queries, processing time, top clients, domains top blocked clients, domains etc) able to manage through query log control panel as mentioned above

Similar feature requests #1714 > #594 https://github.com/AdguardTeam/AdGuardHome/issues/594#issuecomment-469129412

Optionally, you can get benefit from #1164 (Collapse feature)

@Aikatsui commented on GitHub (May 22, 2020): Suggestion: implement this feature on single control panel https://github.com/AdguardTeam/AdGuardHome/issues/481#issuecomment-515673586 in query log then user can apply complex/flexible rules, filters, sorts (date range, time range, hide unwanted domains https://github.com/AdguardTeam/AdGuardHome/issues/594#issuecomment-469129412, hide clients, sort for certain devices) etc and then generate result for web-app wide including dashboard, lists pages (see -->#580), client page (see --> https://github.com/AdguardTeam/AdGuardHome/issues/1336) and keep till user edit or clear it manually same as github. If add control panel(s) to dashboard then it takes unwanted space but it'll be better if dashboard results (total queries, malware/phishing, adult queries, processing time, top clients, domains top blocked clients, domains etc) able to manage through query log control panel as mentioned above Similar feature requests #1714 > #594 https://github.com/AdguardTeam/AdGuardHome/issues/594#issuecomment-469129412 Optionally, you can get benefit from #1164 (Collapse feature)
Author
Owner

@adrianmace commented on GitHub (May 24, 2020):

Some images to highlight the problem:
image
image

@adrianmace commented on GitHub (May 24, 2020): Some images to highlight the problem: ![image](https://user-images.githubusercontent.com/5071859/82747246-661f9a80-9dda-11ea-840b-dbccd2316374.png) ![image](https://user-images.githubusercontent.com/5071859/82747253-7b94c480-9dda-11ea-88cd-9683b99ccc51.png)
Author
Owner

@ameshkov commented on GitHub (May 24, 2020):

I wonder would it be enough if we simply add a Client setting: "Do not log queries"?

@ameshkov commented on GitHub (May 24, 2020): I wonder would it be enough if we simply add a Client setting: "Do not log queries"?
Author
Owner

@adrianmace commented on GitHub (May 24, 2020):

That would work for me. The reason they’re named is because I set that up in my search for this setting before realising it didn’t exist.

I’d like to eventually be able to exclude domains, but per-client is good enough if it’s easier / faster to develop.

@adrianmace commented on GitHub (May 24, 2020): That would work for me. The reason they’re named is because I set that up in my search for this setting before realising it didn’t exist. I’d like to eventually be able to exclude _domains_, but per-client is good enough if it’s easier / faster to develop.
Author
Owner

@Aikatsui commented on GitHub (May 24, 2020):

I wonder would it be enough if we simply add a Client setting: "Do not log queries"?

If implement, Would it be possible to mod it bit: "Do not display queries"? so we still have them to check when necessary and again user has chance to enable/disable that "do not display" option through client settings.

@Aikatsui commented on GitHub (May 24, 2020): > I wonder would it be enough if we simply add a Client setting: "Do not log queries"? If implement, Would it be possible to mod it bit: **"Do not display queries"**? so we still have them to check when necessary and again user has chance to enable/disable that "do not display" option through client settings.
Author
Owner

@Buddinski88 commented on GitHub (Jan 11, 2022):

Is there any info here on when this feature will be ready?
I currently have 120k requests in the log coming from my RaspberryPi with Raspberrymatic. Every 15 seconds it checks against my Fritzbox if two devices are online (presence detection). This distorts the statistics enormously :-)

@Buddinski88 commented on GitHub (Jan 11, 2022): Is there any info here on when this feature will be ready? I currently have 120k requests in the log coming from my RaspberryPi with Raspberrymatic. Every 15 seconds it checks against my Fritzbox if two devices are online (presence detection). This distorts the statistics enormously :-)
Author
Owner

@ameshkov commented on GitHub (Jan 11, 2022):

Will only be done after the frontend rework.

Tbh, I'd like to keep this feature purely on the UI side (show smth like "X domains are hidden (N requests)").

@ameshkov commented on GitHub (Jan 11, 2022): Will only be done after the frontend rework. Tbh, I'd like to keep this feature purely on the UI side (show smth like "X domains are hidden (N requests)").
Author
Owner

@Buddinski88 commented on GitHub (Jan 11, 2022):

Will only be done after the frontend rework.
Tbh, I'd like to keep this feature purely on the UI side (show smth like "X domains are hidden (N requests)").

Thank you for the update.
In general that seems to be fine. Will that count then also be excluded from the statistics?

@Buddinski88 commented on GitHub (Jan 11, 2022): > Will only be done after the frontend rework. > Tbh, I'd like to keep this feature purely on the UI side (show smth like "X domains are hidden (N requests)"). Thank you for the update. In general that seems to be fine. Will that count then also be excluded from the statistics?
Author
Owner

@ameshkov commented on GitHub (Jan 11, 2022):

In general that seems to be fine. Will that count then also be excluded from the statistics?

No, if it's purely frontend we won't be able to get rid of them there.

@ameshkov commented on GitHub (Jan 11, 2022): > In general that seems to be fine. Will that count then also be excluded from the statistics? No, if it's purely frontend we won't be able to get rid of them there.
Author
Owner

@Buddinski88 commented on GitHub (Feb 2, 2022):

In general that seems to be fine. Will that count then also be excluded from the statistics?

No, if it's purely frontend we won't be able to get rid of them there.

First of all, thank you for your feedback and sorry that it took me so long.
Basically I understand your answer, but it would only provide a real added value if the numbers are also excluded from the statistics. For example, the statement "5%" requests were blocked would be appropriate.
I think this adjustment is not a short term issue, but for the future - I think - everyone would benefit from exculpating certain devices from the statistics. Example from my side. Due to presence detection, my smarthome system asks my Fritzbox every 30 seconds if two devices are logged into the WLAN. That's X thousands of requests in a few days and that distorts the statistics enormously.

@Buddinski88 commented on GitHub (Feb 2, 2022): > > In general that seems to be fine. Will that count then also be excluded from the statistics? > > No, if it's purely frontend we won't be able to get rid of them there. First of all, thank you for your feedback and sorry that it took me so long. Basically I understand your answer, but it would only provide a real added value if the numbers are also excluded from the statistics. For example, the statement "5%" requests were blocked would be appropriate. I think this adjustment is not a short term issue, but for the future - I think - everyone would benefit from exculpating certain devices from the statistics. Example from my side. Due to presence detection, my smarthome system asks my Fritzbox every 30 seconds if two devices are logged into the WLAN. That's X thousands of requests in a few days and that distorts the statistics enormously.
Author
Owner

@danieletorelli commented on GitHub (Feb 2, 2022):

Sometimes you might just want to hide some queries from the statistics, while some other times you might not even care of recording some queries at all.
I suppose that leaving the user free to choose would provide way better added value in both cases, since IMO the use cases are so vary that all assumptions here could be misleading.

@danieletorelli commented on GitHub (Feb 2, 2022): Sometimes you might just want to hide some queries from the statistics, while some other times you might not even care of recording some queries at all. I suppose that leaving the user free to choose would provide way better added value in both cases, since IMO the use cases are so vary that all assumptions here could be misleading.
Author
Owner

@MattXcz commented on GitHub (Mar 30, 2022):

I am also +1 for this future request... I have some IOT clients, which spam query log and statistics

@MattXcz commented on GitHub (Mar 30, 2022): I am also +1 for this future request... I have some IOT clients, which spam query log and statistics
Author
Owner

@Toxicolo commented on GitHub (Mar 31, 2022):

+1 from my side. Would really nice to a a filter or exclude option!

@Toxicolo commented on GitHub (Mar 31, 2022): +1 from my side. Would really nice to a a filter or exclude option!
Author
Owner

@NemoN commented on GitHub (Mar 31, 2022):

+1 really an important feature

@NemoN commented on GitHub (Mar 31, 2022): +1 really an important feature
Author
Owner

@MSlawik commented on GitHub (Mar 31, 2022):

+1 !!!!

@MSlawik commented on GitHub (Mar 31, 2022): +1 !!!!
Author
Owner

@jamboc88 commented on GitHub (Mar 31, 2022):

+1 !!

@jamboc88 commented on GitHub (Mar 31, 2022): +1 !!
Author
Owner

@ameshkov commented on GitHub (Mar 31, 2022):

Okay, it's too popular to keep it on v1.0.0. We're doing the frontend rework&redesign in v0.108.0, let's squeeze this one there as well.

@ameshkov commented on GitHub (Mar 31, 2022): Okay, it's too popular to keep it on v1.0.0. We're doing the frontend rework&redesign in v0.108.0, let's squeeze this one there as well.
Author
Owner

@MattXcz commented on GitHub (Mar 31, 2022):

Stats + query log too.So we dont have these request over and over in log

@MattXcz commented on GitHub (Mar 31, 2022): Stats + query log too.So we dont have these request over and over in log
Author
Owner

@HyperCriSiS commented on GitHub (Jul 23, 2022):

I also have devices which do HUGE amounts of querys of one or more domains. It would be good to be able to drop specific domains completely. No log at all.

@HyperCriSiS commented on GitHub (Jul 23, 2022): I also have devices which do HUGE amounts of querys of one or more domains. It would be good to be able to drop specific domains completely. No log at all.
Author
Owner

@danbo commented on GitHub (Oct 1, 2022):

I was going to ask about a slightly different feature - separate statistics out by interface or subnet.

Ultimately I think we're all saying the same thing here - we would very much appreciate a way to filter noise out of statistics. (domain/ips/subnets/interfaces)

@danbo commented on GitHub (Oct 1, 2022): I was going to ask about a slightly different feature - separate statistics out by interface or subnet. Ultimately I think we're all saying the same thing here - we would very much appreciate a way to filter noise out of statistics. (domain/ips/subnets/interfaces)
Author
Owner

@nemo-ex commented on GitHub (Mar 10, 2023):

+1

@nemo-ex commented on GitHub (Mar 10, 2023): +1
Author
Owner

@ainar-g commented on GitHub (Mar 10, 2023):

@jiangmw, please use reactions on the OP instead of “+1”-like comments. Thanks.

In case people watching this issue have missed it, the most recent releases of AdGuard Home have the feature of ignoring requests by their query domain names, but it's currently only available through the configuration file. API and UI are coming soon.

@ainar-g commented on GitHub (Mar 10, 2023): @jiangmw, please use reactions on the OP instead of “+1”-like comments. Thanks. In case people watching this issue have missed it, the most recent releases of AdGuard Home have the feature of ignoring requests by their query domain names, but it's currently only available through the configuration file. API and UI are coming soon.
Author
Owner

@ainar-g commented on GitHub (Apr 18, 2023):

Implemented for both domains and clients on Edge and in the upcoming release.

@ainar-g commented on GitHub (Apr 18, 2023): Implemented for both domains and clients on Edge and in the upcoming release.
Author
Owner

@rfgamaral commented on GitHub (May 15, 2023):

Is it possible to ignore wildcard domains? Adding *.example.com doesn't seem to be working :(

@rfgamaral commented on GitHub (May 15, 2023): Is it possible to ignore wildcard domains? Adding `*.example.com` doesn't seem to be working :(
Author
Owner

@don-dolarson commented on GitHub (Jun 30, 2023):

Is it possible to ignore wildcard domains? Adding *.example.com doesn't seem to be working :(

Wildcards doesn't seem to work for me neither on latest v0.107.32. Anyone else?

@don-dolarson commented on GitHub (Jun 30, 2023): > Is it possible to ignore wildcard domains? Adding `*.example.com` doesn't seem to be working :( Wildcards doesn't seem to work for me neither on latest v0.107.32. Anyone else?
Author
Owner

@ainar-g commented on GitHub (Jun 30, 2023):

@rfgamaral, @don-dolarson, they aren't supported now. Please upvote #5720. (Do not post “+1” comments as one cannot sort by those in Github; a “👍” reaction on the top comment is enough.)

@ainar-g commented on GitHub (Jun 30, 2023): @rfgamaral, @don-dolarson, they aren't supported now. Please upvote #5720. (Do not post “+1” comments as one cannot sort by those in Github; a “:+1:” reaction on the top comment is enough.)
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/AdGuardHome#1601
No description provided.