Log In Sign Up

discountcodes.com
robots.txt

Robots Exclusion Standard data for discountcodes.com

Resource Scan

Scan Details

Site Domain discountcodes.com
Base Domain discountcodes.com
Scan Status Ok
Last Scan2025-10-05T18:20:17+00:00
Next Scan 2025-11-04T18:20:17+00:00

Last Scan

Scanned2025-10-05T18:20:17+00:00
URL https://discountcodes.com/robots.txt
Redirect https://www.discountcodes.com/robots.txt
Redirect Domain www.discountcodes.com
Redirect Base discountcodes.com
Domain IPs 162.159.140.98, 172.66.0.96, 2606:4700:7::60, 2a06:98c1:58::60
Redirect IPs 162.159.140.98, 172.66.0.96, 2606:4700:7::60, 2a06:98c1:58::60
Response IP 162.159.140.98
Found Yes
Hash 0baa74a2caad259262a8f8499a10b3f0c6c51f4e3a52ee3d76f3067a6a04e500
SimHash e691cedac7a2

Groups

*

Rule Path
Allow /
Disallow /rc/
Disallow /rm/
Disallow /auth/
Disallow /c/
Disallow /cdn-cgi/

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.discountcodes.com/sitemap.xml
Back to top

Comments

  • Specific rule for Microsoft AdIdxBot
  • Host (optional, used by some search engines like Yandex)
  • Sitemap
Back to top

Warnings

  • `host` is not a known field.
Back to top