headwayapp.co
robots.txt

Robots Exclusion Standard data for headwayapp.co

Resource Scan

Scan Details

Site Domain headwayapp.co
Base Domain headwayapp.co
Scan Status Ok
Last Scan2024-10-04T20:35:53+00:00
Next Scan 2024-11-03T20:35:53+00:00

Last Scan

Scanned2024-10-04T20:35:53+00:00
URL https://headwayapp.co/robots.txt
Domain IPs 18.214.52.112, 3.214.76.85
Response IP 18.214.52.112
Found Yes
Hash 8a694d9a9794e5f7c9d3b21e287675db1ce44193e3371646c90f9724aeb1185e
SimHash 4816d220c123

Groups

applebot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

twitterbot

Rule Path
Allow /

yandex

Rule Path
Allow /

yeti

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

*

Rule Path
Disallow /