valleytireco.com
robots.txt

Robots Exclusion Standard data for valleytireco.com

Resource Scan

Scan Details

Site Domain valleytireco.com
Base Domain valleytireco.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-23T06:26:23+00:00
Next Scan 2025-05-24T06:26:23+00:00

Last Successful Scan

Scanned2024-07-06T04:49:55+00:00
URL https://valleytireco.com/robots.txt
Redirect https://www.valleytireco.com/robots.txt
Redirect Domain www.valleytireco.com
Redirect Base valleytireco.com
Domain IPs 104.21.58.67, 172.67.201.130, 2606:4700:3033::6815:3a43, 2606:4700:3035::ac43:c982
Redirect IPs 104.21.58.67, 172.67.201.130, 2606:4700:3033::6815:3a43, 2606:4700:3035::ac43:c982
Response IP 172.67.201.130
Found Yes
Hash fed57c1bde7e348d5e36d74a0b4f48c42352705fca0553711821adfbcae4b592
SimHash 73197540a543

Groups

amazonbot

Rule Path
Disallow /

ms search 4.0 robot

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.01; windows nt; ms search 4.0 robot) microsoft

Rule Path
Disallow /

*

Rule Path
Disallow /Activity-Feed/
Disallow /admin/
Disallow /App_Browsers/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /Config/
Disallow /contest/
Disallow /controls/
Disallow /DesktopModules/*.aspx
Disallow /Documentation/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /Providers/
Disallow /home/ctl/
Disallow /default.aspx
Disallow /home.aspx
Disallow /login.aspx
Disallow /privacy.aspx
Disallow /stats.aspx
Disallow /thank-you.aspx
Disallow /*/ctl/
Disallow /*ctl%3Dlogin
Disallow /*ctl%3Dsendpassword*
Disallow /*ctl%3Dlicense*
Disallow /*fileticket%3D*
Disallow /*scheduleitem%3D
Disallow /*%26Sched%3D*
Disallow /*submitreview*
Disallow /vlb.aspx
Disallow /VLB.aspx
Disallow /*.asmx

Other Records

Field Value
crawl-delay 30

Comments

  • Begin robots.txt file
  • End of robots.txt file