austinhorton16.com
robots.txt

Robots Exclusion Standard data for austinhorton16.com

Resource Scan

Scan Details

Site Domain austinhorton16.com
Base Domain austinhorton16.com
Scan Status Ok
Last Scan2025-08-29T03:42:47+00:00
Next Scan 2025-09-05T03:42:47+00:00

Last Scan

Scanned2025-08-29T03:42:47+00:00
URL https://austinhorton16.com/robots.txt
Redirect http://www.austinhorton16.com/robots.txt
Redirect Domain www.austinhorton16.com
Redirect Base austinhorton16.com
Domain IPs 52.203.154.172
Redirect IPs 2600:9000:269b:200:16:3194:a9c0:93a1, 2600:9000:269b:3400:16:3194:a9c0:93a1, 2600:9000:269b:3c00:16:3194:a9c0:93a1, 2600:9000:269b:5600:16:3194:a9c0:93a1, 2600:9000:269b:8400:16:3194:a9c0:93a1, 2600:9000:269b:9800:16:3194:a9c0:93a1, 2600:9000:269b:b000:16:3194:a9c0:93a1, 2600:9000:269b:bc00:16:3194:a9c0:93a1, 3.160.196.100, 3.160.196.103, 3.160.196.19, 3.160.196.4
Response IP 3.169.71.40
Found Yes
Hash 0ee98041a46eea9aac061b614f405ff246e54fbf1064f00673c521dce6117126
SimHash 78011c1ded12

Groups

*

Rule Path
Disallow */insider/*
Disallow */Insider/*
Disallow /admin/
Disallow /advertising/
Disallow /bin/
Disallow /css/
Disallow /error/
Disallow /image/
Disallow /images/
Disallow /Invalid/
Disallow /javascript/
Disallow /javaScript/
Disallow /messageboard/
Disallow /myaccount/
Disallow /myAccount/
Disallow /terms/
Disallow /profile/schedule/*
Disallow /profile/news/*