Log In Sign Up

hornsby.com
robots.txt

Robots Exclusion Standard data for hornsby.com

Resource Scan

Scan Details

Site Domain hornsby.com
Base Domain hornsby.com
Scan Status Ok
Last Scan2024-09-25T22:44:06+00:00
Next Scan 2024-10-25T22:44:06+00:00

Last Scan

Scanned2024-09-25T22:44:06+00:00
URL https://hornsby.com/robots.txt
Redirect https://www.hornsby.com/robots.txt
Redirect Domain www.hornsby.com
Redirect Base hornsby.com
Domain IPs 104.21.88.120, 172.67.178.180, 2606:4700:3031::6815:5878, 2606:4700:3033::ac43:b2b4
Redirect IPs 104.21.88.120, 172.67.178.180, 2606:4700:3031::6815:5878, 2606:4700:3033::ac43:b2b4
Response IP 172.67.178.180
Found Yes
Hash 7a706e354463200f3a5362f35dc29f271758e1de8d708d198ab2ea9769970da7
SimHash 330a4a714655

Groups

*
ninjabot

Rule Path
Allow /
Disallow /cgi-bin/
Disallow search.html
Disallow thank-you.html
Disallow subscriber.html
Disallow test.html
Disallow /contact/thank-you.html
Back to top

Other Records

Field Value
sitemap https://www.hornsby.com/sitemap.xml
sitemap https://www.hornsby.com/geo-sitemap.xml
Back to top

Comments

  • Richard E. Hornsby, P.A., Criminal Defense Lawyer -- www.hornsby.com
  • Robot Exclusion File -- robots.txt
  • Author: Richard Hornsby
  • Last Updated: 05/26/2023 11:00
Back to top