headwaydigital.com
robots.txt

Robots Exclusion Standard data for headwaydigital.com

Resource Scan

Scan Details

Site Domain headwaydigital.com
Base Domain headwaydigital.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-03-21T20:44:36+00:00
Next Scan 2024-06-19T20:44:36+00:00

Last Successful Scan

Scanned2022-11-05T15:26:27+00:00
URL https://headwaydigital.com/robots.txt
Response IP 50.116.93.190
Found Yes
Hash fa1a7c4e95b8894463a56302b83601c746e316a28aee9ec901ee801b23efe1e8
SimHash 71b45b48c1d0

Groups

google

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /mkt/
Disallow /wp-admin/
Disallow /wp-includes/

Comments

  • Blocks robots from specific folders / directories