Log In Sign Up

rookieroad.com
robots.txt

Robots Exclusion Standard data for rookieroad.com

Resource Scan

Scan Details

Site Domain rookieroad.com
Base Domain rookieroad.com
Scan Status Ok
Last Scan2024-11-15T03:05:43+00:00
Next Scan 2024-11-22T03:05:43+00:00

Last Scan

Scanned2024-11-15T03:05:43+00:00
URL https://rookieroad.com/robots.txt
Redirect https://www.rookieroad.com/robots.txt
Redirect Domain www.rookieroad.com
Redirect Base rookieroad.com
Domain IPs 13.33.88.116, 13.33.88.12, 13.33.88.122, 13.33.88.82, 2600:9000:223b:3000:b:e206:64c0:93a1, 2600:9000:223b:3800:b:e206:64c0:93a1, 2600:9000:223b:5000:b:e206:64c0:93a1, 2600:9000:223b:9e00:b:e206:64c0:93a1, 2600:9000:223b:a800:b:e206:64c0:93a1, 2600:9000:223b:bc00:b:e206:64c0:93a1, 2600:9000:223b:c600:b:e206:64c0:93a1, 2600:9000:223b:ce00:b:e206:64c0:93a1
Redirect IPs 13.33.28.21, 13.33.28.54, 13.33.28.72, 13.33.28.78, 2600:9000:229f:3600:7:824e:de80:93a1, 2600:9000:229f:3e00:7:824e:de80:93a1, 2600:9000:229f:4200:7:824e:de80:93a1, 2600:9000:229f:5000:7:824e:de80:93a1, 2600:9000:229f:5400:7:824e:de80:93a1, 2600:9000:229f:6000:7:824e:de80:93a1, 2600:9000:229f:6a00:7:824e:de80:93a1, 2600:9000:229f:d000:7:824e:de80:93a1
Response IP 13.33.28.72
Found Yes
Hash 781f5d2b6a88212a28a0a55eafd43da979236bc8f4b9bafcf9b41b3f0d1e09fd
SimHash 6104dd54c952

Groups

*
pinterest

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.rookieroad.com/sitemap.xml
Back to top