Log In Sign Up

fontstruct.com
robots.txt

Robots Exclusion Standard data for fontstruct.com

Resource Scan

Scan Details

Site Domain fontstruct.com
Base Domain fontstruct.com
Scan Status Ok
Last Scan2025-10-20T16:33:10+00:00
Next Scan 2025-10-27T16:33:10+00:00

Last Scan

Scanned2025-10-20T16:33:10+00:00
URL https://fontstruct.com/robots.txt
Domain IPs 78.47.160.126
Response IP 78.47.160.126
Found Yes
Hash 1798d8db2075b39d2f506bd56a016e89615af7da5240d9f8d4edb52f925c91ec
SimHash 025cd083c213

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

exabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Comments

  • http://www.robotstxt.org/robotstxt.html
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • http://stackoverflow.com/questions/17377835/robots-txt-what-is-the-proper-format-for-a-crawl-delay-for-multiple-user-agent
Back to top