Log In Sign Up

rookieroad.com
robots.txt

Robots Exclusion Standard data for rookieroad.com

Resource Scan

Scan Details

Site Domain rookieroad.com
Base Domain rookieroad.com
Scan Status Ok
Last Scan2024-09-26T23:53:56+00:00
Next Scan 2024-10-03T23:53:56+00:00

Last Scan

Scanned2024-09-26T23:53:56+00:00
URL https://rookieroad.com/robots.txt
Redirect https://www.rookieroad.com/robots.txt
Redirect Domain www.rookieroad.com
Redirect Base rookieroad.com
Domain IPs 13.33.88.116, 13.33.88.12, 13.33.88.122, 13.33.88.82, 2600:9000:223b:3800:b:e206:64c0:93a1, 2600:9000:223b:4000:b:e206:64c0:93a1, 2600:9000:223b:4400:b:e206:64c0:93a1, 2600:9000:223b:6c00:b:e206:64c0:93a1, 2600:9000:223b:9200:b:e206:64c0:93a1, 2600:9000:223b:ae00:b:e206:64c0:93a1, 2600:9000:223b:b800:b:e206:64c0:93a1, 2600:9000:223b:ee00:b:e206:64c0:93a1
Redirect IPs 13.35.238.129, 13.35.238.16, 13.35.238.70, 13.35.238.73, 2600:9000:2085:1a00:7:824e:de80:93a1, 2600:9000:2085:2000:7:824e:de80:93a1, 2600:9000:2085:3000:7:824e:de80:93a1, 2600:9000:2085:8600:7:824e:de80:93a1, 2600:9000:2085:9000:7:824e:de80:93a1, 2600:9000:2085:b800:7:824e:de80:93a1, 2600:9000:2085:da00:7:824e:de80:93a1, 2600:9000:2085:dc00:7:824e:de80:93a1
Response IP 13.35.238.73
Found Yes
Hash 781f5d2b6a88212a28a0a55eafd43da979236bc8f4b9bafcf9b41b3f0d1e09fd
SimHash 6104dd54c952

Groups

*
pinterest

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.rookieroad.com/sitemap.xml
Back to top