austingrid.com
robots.txt

Robots Exclusion Standard data for austingrid.com

Resource Scan

Scan Details

Site Domain austingrid.com
Base Domain austingrid.com
Scan Status Ok
Last Scan2025-06-06T05:51:11+00:00
Next Scan 2025-06-13T05:51:11+00:00

Last Scan

Scanned2025-06-06T05:51:11+00:00
URL https://austingrid.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.112.1
Found Yes
Hash 7e2cb6ae47fa5e4ebaf5c163424b0ef6ff6c3384eb34e91469db230a50c18ade
SimHash cf16f2365751

Groups

googlebot
googlebot-image
bingbot
googlebot-news
googlebot-video
bingbot
slurp
duckduckbot
baiduspider
sogou
exabot

Rule Path
Allow /

ahrefsbot
yandexbot
petalbot
barkrowler

Rule Path
Disallow /