forum-audi.com
robots.txt

Robots Exclusion Standard data for forum-audi.com

Resource Scan

Scan Details

Site Domain forum-audi.com
Base Domain forum-audi.com
Scan Status Ok
Last Scan2024-07-08T10:09:49+00:00
Next Scan 2024-07-15T10:09:49+00:00

Last Scan

Scanned2024-07-08T10:09:49+00:00
URL https://forum-audi.com/robots.txt
Redirect https://www.forum-audi.com/robots.txt
Redirect Domain www.forum-audi.com
Redirect Base forum-audi.com
Domain IPs 104.21.86.107, 172.67.218.105, 2606:4700:3031::ac43:da69, 2606:4700:3033::6815:566b
Redirect IPs 104.21.86.107, 172.67.218.105, 2606:4700:3031::ac43:da69, 2606:4700:3033::6815:566b
Response IP 104.21.86.107
Found Yes
Hash 2f748b8d2f92fb01633bfa5a92abea87591a3e7c847daead9eafa0a36d8a3e65
SimHash 610cd860cf95

Groups

*

Rule Path
Disallow /404.php
Disallow /register.php
Allow /

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.forum-audi.com/sitemap.xml