hanneganconstruction.com
robots.txt

Robots Exclusion Standard data for hanneganconstruction.com

Resource Scan

Scan Details

Site Domain hanneganconstruction.com
Base Domain hanneganconstruction.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-13T13:27:12+00:00
Next Scan 2025-01-11T13:27:12+00:00

Last Successful Scan

Scanned2023-12-19T13:04:49+00:00
URL https://hanneganconstruction.com/robots.txt
Domain IPs 104.21.25.109, 172.67.134.8, 2606:4700:3030::6815:196d, 2606:4700:3033::ac43:8608
Response IP 104.21.25.109
Found Yes
Hash 13227e2e5530990091a08f9d5a29117c9772634bc0a492427658f2ecdfbaffe4
SimHash 58288e000481

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

js-kit

Rule Path
Disallow /

njuicebot

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

yottosbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

htmlparser

Rule Path
Disallow /

synapse

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hanneganconstruction.com/sitemap.xml

Warnings

  • `host` is not a known field.