suffolkconstruction.com
robots.txt

Robots Exclusion Standard data for suffolkconstruction.com

Resource Scan

Scan Details

Site Domain suffolkconstruction.com
Base Domain suffolkconstruction.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-03T08:57:27+00:00
Next Scan 2024-12-02T08:57:27+00:00

Last Successful Scan

Scanned2023-09-16T09:18:07+00:00
URL https://suffolkconstruction.com/robots.txt
Redirect https://suffolk.com/robots.txt
Redirect Domain suffolk.com
Redirect Base suffolk.com
Domain IPs 141.193.213.20
Redirect IPs 141.193.213.20
Response IP 141.193.213.20
Found Yes
Hash aaff8a0ff94f0a1c4a7a5bca0e87f5b530bd9cc02ea78433dca0344133163847
SimHash 42014c10ebb2

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://www.suffolk.com/sitemap.xml
sitemap http://www.suffolk.com/sitemap.rss