Log In Sign Up

sizecharter.com
robots.txt

Robots Exclusion Standard data for sizecharter.com

Resource Scan

Scan Details

Site Domain sizecharter.com
Base Domain sizecharter.com
Scan Status Ok
Last Scan2025-04-06T07:47:10+00:00
Next Scan 2025-04-13T07:47:10+00:00

Last Scan

Scanned2025-04-06T07:47:10+00:00
URL https://sizecharter.com/robots.txt
Domain IPs 54.242.49.189
Response IP 54.242.49.189
Found Yes
Hash 9f0f040702d4e4cb71f7717407bc61faf3db9385d67aab1d980f474f81a6a615
SimHash 078529cd6064

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Fri Sep 14 12:19:54 PDT 2018, dianem
Back to top