fathomaway.com
robots.txt

Robots Exclusion Standard data for fathomaway.com

Resource Scan

Scan Details

Site Domain fathomaway.com
Base Domain fathomaway.com
Scan Status Ok
Last Scan2024-11-09T18:45:12+00:00
Next Scan 2024-11-16T18:45:12+00:00

Last Scan

Scanned2024-11-09T18:45:12+00:00
URL https://fathomaway.com/robots.txt
Redirect https://fathomaway.com/robots.txt/
Domain IPs 34.200.181.6, 34.200.28.139
Response IP 34.200.28.139
Found Yes
Hash a4391ed59740c42d27c638d001cb9b90cf9e5e0b8437a7a185e923d4a548a8e0
SimHash 8e1c9d50c675

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Comments

  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html