adguard.com
robots.txt

Robots Exclusion Standard data for adguard.com

Resource Scan

Scan Details

Site Domain adguard.com
Base Domain adguard.com
Scan Status Ok
Last Scan2024-11-04T14:38:45+00:00
Next Scan 2024-11-18T14:38:45+00:00

Last Scan

Scanned2024-11-04T14:38:45+00:00
URL https://adguard.com/robots.txt
Domain IPs 104.18.163.229, 104.18.164.229, 2606:4700::6812:a3e5, 2606:4700::6812:a4e5
Response IP 104.18.163.229
Found Yes
Hash 13fd175aa31189ba459ccf85e151d064f3655e289d7eaafa3c8cfecc17baf968
SimHash baabc86e991c

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Disallow */promo/
Disallow */discuss.html
Disallow */blog/author/
Disallow */blog/tag/
Disallow */eula.html
Disallow */promotion.html
Allow /de/eula.html
Allow /en/eula.html
Allow /es/eula.html
Allow /fr/eula.html
Allow /it/eula.html
Allow /ja/eula.html
Allow /ko/eula.html
Allow /pt_br/eula.html
Allow /pt_pt/eula.html
Allow /ru/eula.html
Allow /zh_cn/eula.html
Allow /zh_tw/eula.html
Disallow */privacy.html
Disallow */privacy/
Allow /de/privacy.html
Allow /de/privacy/
Allow /en/privacy.html
Allow /en/privacy/
Allow /es/privacy.html
Allow /es/privacy/
Allow /fr/privacy.html
Allow /fr/privacy/
Allow /it/privacy.html
Allow /it/privacy/
Allow /ja/privacy.html
Allow /ja/privacy/
Allow /ko/privacy.html
Allow /ko/privacy/
Allow /pt_br/privacy.html
Allow /pt_br/privacy/
Allow /pt_pt/privacy.html
Allow /pt_pt/privacy/
Allow /ru/privacy.html
Allow /ru/privacy/
Allow /zh_cn/privacy.html
Allow /zh_cn/privacy/
Allow /zh_tw/privacy.html
Allow /zh_tw/privacy/
Disallow */press-releases.html
Allow /en/press-releases.html
Disallow */media-materials.html
Allow /en/media-materials.html
Disallow */awards.html
Allow /en/awards.html
Allow /ru/awards.html
Disallow */payment-success.html
Disallow */terms-of-sale.html
Disallow */account/
Disallow */adguard-report/
Disallow */upgrade.html
Disallow /oauth/connect.html
Disallow */renew.html
Disallow */invoice.html
Disallow */giveaway/*.html
Allow /en/renew.html
Allow /de/renew.html
Allow /pl/renew.html
Allow /no/renew.html
Allow /fr/renew.html
Allow /cs/renew.html
Allow /be/renew.html
Allow /es/renew.html
Allow /ru/renew.html
Allow /pt_br/renew.html
Allow /pt_pt/renew.html
Allow /tr/renew.html
Allow /sr_latn/renew.html
Allow /sk/renew.html
Allow /zh_cn/renew.html
Allow /nl/renew.html
Allow /ja/renew.html
Allow /it/renew.html
Allow /da/renew.html
Allow /ko/renew.html
Allow /zh_tw/renew.html
Allow /sv/renew.html
Allow /fi/renew.html
Allow /fa/renew.html
Allow /uk/renew.html
Allow /hr/renew.html
Allow /sl/renew.html
Allow /ro/renew.html
Allow /hu/renew.html
Allow /id/renew.html
Allow /vi/renew.html
Disallow /pl/blog/
Disallow /pl/article/
Disallow /no/blog/
Disallow /no/article/
Disallow /cs/blog/
Disallow /cs/article/
Disallow /be/blog/
Disallow /be/article/
Disallow /pt_pt/blog/
Disallow /pt_pt/article/
Disallow /tr/blog/
Disallow /sr_latn/blog/
Disallow /sr_latn/article/
Disallow /sk/blog/
Disallow /sk/article/
Disallow /zh_cn/article/
Disallow /nl/blog/
Disallow /da/blog/
Disallow /da/article/
Disallow /zh_tw/blog/
Disallow /sv/blog/
Disallow /sv/article/
Disallow /fi/blog/
Disallow /fi/article/
Disallow /fa/blog/
Disallow /fa/article/
Disallow /uk/blog/
Disallow /uk/article/
Disallow /hr/blog/
Disallow /hr/article/
Disallow /sl/blog/
Disallow /sl/article/
Disallow /ro/blog/
Disallow /ro/article/
Disallow /hu/blog/
Disallow /hu/article/
Disallow /id/blog/
Disallow /id/article/
Disallow /vi/blog/
Disallow /vi/article/
Disallow */versions/*/release.html
Disallow */versions/*/beta.html
Disallow */versions/*/nightly.html
Disallow */versions.html
Allow /en/versions/*/release.html
Allow /en/versions/*/beta.html
Allow /en/versions/*/nightly.html
Allow /en/versions.html
Allow /ru/versions/*/release.html
Allow /ru/versions/*/beta.html
Allow /ru/versions/*/nightly.html
Allow /ru/versions.html
Allow /ja/versions/*/release.html
Allow /ja/versions.html
Allow /fr/versions/*/release.html
Allow /fr/versions.html
Allow /zh_cn/versions/*/release.html
Allow /zh_cn/versions.html
Allow /it/versions/*/release.html
Allow /it/versions.html
Allow /zh_tw/versions/*/release.html
Allow /zh_tw/versions.html
Allow /ko/versions/*/release.html
Allow /ko/versions.html
Allow /de/versions/*/release.html
Allow /de/versions.html
Allow /es/versions/*/release.html
Allow /es/versions.html
Disallow */support/
Allow */support.html
Allow /en/support/
Allow /zh_cn/support/
Allow /fr/support/
Allow /de/support/
Allow /ja/support/
Allow /ko/support/
Allow /pt_pt/support/
Allow /it/support/
Allow /pt_br/support/
Allow /tr/support/
Allow /ru/support/
Allow */support/apps.html

Other Records

Field Value
sitemap https://adguard.com/sitemap.xml
sitemap https://adguard.com/blog-sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.