crozetgazette.com
robots.txt

Robots Exclusion Standard data for crozetgazette.com

Resource Scan

Scan Details

Site Domain crozetgazette.com
Base Domain crozetgazette.com
Scan Status Ok
Last Scan2024-10-26T03:48:18+00:00
Next Scan 2024-11-25T03:48:18+00:00

Last Scan

Scanned2024-10-26T03:48:18+00:00
URL https://crozetgazette.com/robots.txt
Redirect https://www.crozetgazette.com/robots.txt
Redirect Domain www.crozetgazette.com
Redirect Base crozetgazette.com
Domain IPs 104.21.12.138, 172.67.194.188, 2606:4700:3033::6815:c8a, 2606:4700:3033::ac43:c2bc
Redirect IPs 104.21.12.138, 172.67.194.188, 2606:4700:3033::6815:c8a, 2606:4700:3033::ac43:c2bc
Response IP 172.67.194.188
Found Yes
Hash 97d8dfc7525fb9c6a79d3088606c1ee1c7de7569c76eb4ead9320f719011a980
SimHash 8009425386e3

Groups

meta-externalagent

Rule Path Comment
Allow / Allow everything
Disallow /private/ -

facebookexternalhit

Rule Path
Allow /
Disallow /private/

Comments

  • User-agent: *
  • Disallow:
  • Disallow: /wp-admin/
  • Disallow: /wp-content/plugins/