geofflawrence.com
robots.txt

Robots Exclusion Standard data for geofflawrence.com

Resource Scan

Scan Details

Site Domain geofflawrence.com
Base Domain geofflawrence.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-09T10:00:18+00:00
Next Scan 2025-12-08T10:00:18+00:00

Last Successful Scan

Scanned2024-07-24T02:04:16+00:00
URL https://geofflawrence.com/robots.txt
Domain IPs 104.21.29.54, 172.67.171.96, 2606:4700:3032::ac43:ab60, 2606:4700:3037::6815:1d36
Response IP 104.21.29.54
Found Yes
Hash 404f9fcf699d19a722ecdea436e502b1dbd297e4d58dc64f130f0bcf20c2007d
SimHash 33f4bf85cf95

Groups

*

Rule Path
Disallow

*

Rule Path
Disallow newsletters

*

Rule Path
Disallow JhuspGqNcs

Other Records

Field Value
sitemap http://www.geofflawrence.com/sitemap.xml

Comments

  • Robots.txt file created by http://www.webtoolcentral.com
  • For domain: http://www.geofflawrence.com
  • All robots will spider the domain
  • Disallow directory newsletters
  • Disallow directory JhuspGqNcs