offexploring.com
robots.txt

Robots Exclusion Standard data for offexploring.com

Resource Scan

Scan Details

Site Domain offexploring.com
Base Domain offexploring.com
Scan Status Ok
Last Scan2024-10-25T11:22:48+00:00
Next Scan 2024-11-24T11:22:48+00:00

Last Scan

Scanned2024-10-25T11:22:48+00:00
URL https://offexploring.com/robots.txt
Redirect https://www.offexploring.com/robots.txt
Redirect Domain www.offexploring.com
Redirect Base offexploring.com
Domain IPs 104.21.9.28, 172.67.141.47, 2606:4700:3033::6815:91c, 2606:4700:3033::ac43:8d2f
Redirect IPs 104.21.9.28, 172.67.141.47, 2606:4700:3033::6815:91c, 2606:4700:3033::ac43:8d2f
Response IP 172.67.141.47
Found Yes
Hash f68b584e9ae7efcdee63de556d99afdc0914243530dffbd6a98ac07cb53cd1b9
SimHash c84f8212ab92

Groups

*

Rule Path
Disallow /partners/

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.offexploring.com/static/sitemap/

Warnings

  • 2 invalid lines.