Log In Sign Up

hotelcrawfordinn.com
robots.txt

Robots Exclusion Standard data for hotelcrawfordinn.com

Resource Scan

Scan Details

Site Domain hotelcrawfordinn.com
Base Domain hotelcrawfordinn.com
Scan Status Ok
Last Scan2024-09-25T04:33:21+00:00
Next Scan 2024-10-25T04:33:21+00:00

Last Scan

Scanned2024-09-25T04:33:21+00:00
URL https://www.hotelcrawfordinn.com/robots.txt
Domain IPs 108.156.133.36, 108.156.133.63, 108.156.133.78, 108.156.133.85, 2600:9000:2755:3200:14:4594:e480:93a1, 2600:9000:2755:4a00:14:4594:e480:93a1, 2600:9000:2755:6800:14:4594:e480:93a1, 2600:9000:2755:b200:14:4594:e480:93a1, 2600:9000:2755:d200:14:4594:e480:93a1, 2600:9000:2755:d400:14:4594:e480:93a1, 2600:9000:2755:d600:14:4594:e480:93a1, 2600:9000:2755:de00:14:4594:e480:93a1
Response IP 108.156.133.78
Found Yes
Hash 86ef2730e02a58fc746d17af5e0477a3c8af73b08d462b707226070ea2d6a611
SimHash a1555e5c8d12

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout
Disallow /gmc-and-refund-policy
Disallow /resubscribe
Disallow /securepay
Disallow /transaction-status
Disallow /unsubscribe
Disallow /404
Disallow /500
Disallow /fonts/
Disallow /partial/

builtbottough

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

bytedancespider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.hotelcrawfordinn.com/sitemap.xml
Back to top

Comments

  • Powered by Boost360
Back to top