roadreadywheels.com
robots.txt

Robots Exclusion Standard data for roadreadywheels.com

Resource Scan

Scan Details

Site Domain roadreadywheels.com
Base Domain roadreadywheels.com
Scan Status Ok
Last Scan2025-10-21T18:15:14+00:00
Next Scan 2025-11-20T18:15:14+00:00

Last Scan

Scanned2025-10-21T18:15:14+00:00
URL https://roadreadywheels.com/robots.txt
Redirect https://www.roadreadywheels.com/robots.txt
Redirect Domain www.roadreadywheels.com
Redirect Base roadreadywheels.com
Domain IPs 104.21.79.43, 172.67.141.237, 2606:4700:3033::6815:4f2b, 2606:4700:3037::ac43:8ded
Redirect IPs 104.21.79.43, 172.67.141.237, 2606:4700:3033::6815:4f2b, 2606:4700:3037::ac43:8ded
Response IP 172.67.141.237
Found Yes
Hash a40ed8a42cbc2767e3dd10a72df22bbe21d3b4117239661710608470dd2fc6df
SimHash febd4d1d6155

Groups

*

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /user
Disallow /account
Disallow /api
Disallow /password
Disallow /*search%3D*

Other Records

Field Value
crawl-delay 5

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /