forumbmw.net
robots.txt

Robots Exclusion Standard data for forumbmw.net

Resource Scan

Scan Details

Site Domain forumbmw.net
Base Domain forumbmw.net
Scan Status Ok
Last Scan2024-07-08T15:08:07+00:00
Next Scan 2024-07-15T15:08:07+00:00

Last Scan

Scanned2024-07-08T15:08:07+00:00
URL https://forumbmw.net/robots.txt
Redirect https://www.forumbmw.net/robots.txt
Redirect Domain www.forumbmw.net
Redirect Base forumbmw.net
Domain IPs 104.21.95.27, 172.67.169.76, 2606:4700:3031::6815:5f1b, 2606:4700:3035::ac43:a94c
Redirect IPs 104.21.95.27, 172.67.169.76, 2606:4700:3031::6815:5f1b, 2606:4700:3035::ac43:a94c
Response IP 172.67.169.76
Found Yes
Hash c6b4c4aebd21d9640f847775b64d02d65eadfa1016f3e1cf9fde8e37cc14f56d
SimHash 4118d860ce93

Groups

*

Rule Path
Disallow /404.php
Allow /

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.forumbmw.net/sitemap.xml