artbmxmagazine.com
robots.txt

Robots Exclusion Standard data for artbmxmagazine.com

Resource Scan

Scan Details

Site Domain artbmxmagazine.com
Base Domain artbmxmagazine.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-11T07:16:30+00:00
Next Scan 2024-12-11T07:16:30+00:00

Last Successful Scan

Scanned2024-10-13T07:15:40+00:00
URL https://artbmxmagazine.com/robots.txt
Domain IPs 104.21.15.34, 172.67.161.75, 2606:4700:3030::ac43:a14b, 2606:4700:3032::6815:f22
Response IP 172.67.161.75
Found Yes
Hash c337730a99d08814656cedcd9b47e1bd4b8762ebcb6d9779d2a20eb3e56bdaba
SimHash 6709004143b1

Groups

*

Rule Path
Disallow

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://artbmxmagazine.com/sitemap.xml

Warnings

  • `host` is not a known field.