interstateteam.com
robots.txt

Robots Exclusion Standard data for interstateteam.com

Resource Scan

Scan Details

Site Domain interstateteam.com
Base Domain interstateteam.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2025-04-09T17:48:17+00:00
Next Scan 2025-04-16T17:48:17+00:00

Last Successful Scan

Scanned2025-02-24T14:53:18+00:00
URL https://interstateteam.com/robots.txt
Redirect https://www.interstateteam.com/index.php?p=robots.txt
Redirect Domain www.interstateteam.com
Redirect Base interstateteam.com
Domain IPs 104.21.34.135, 172.67.161.133, 2606:4700:3034::6815:2287, 2606:4700:3037::ac43:a185
Redirect IPs 104.21.34.135, 172.67.161.133, 2606:4700:3034::6815:2287, 2606:4700:3037::ac43:a185
Response IP 172.67.161.133
Found Yes
Hash c2ca399cd389dfc380649086881e1280b673d012aa9ecbd7ba9562746ec91105
SimHash 41101d7637b3

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.interstateteam.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.interstateteam.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/