rawbike.com
robots.txt

Robots Exclusion Standard data for rawbike.com

Resource Scan

Scan Details

Site Domain rawbike.com
Base Domain rawbike.com
Scan Status Ok
Last Scan2026-02-13T09:41:52+00:00
Next Scan 2026-03-15T09:41:52+00:00

Last Scan

Scanned2026-02-13T09:41:52+00:00
URL https://rawbike.com/robots.txt
Domain IPs 213.180.78.24
Response IP 213.180.78.24
Found Yes
Hash 5094c9bc1b1e64f011a26a14c081883c7b3c14199d740d59e15ea6c236952163
SimHash 6d15d002ee53

Groups

*

Rule Path
Disallow /*?*perpage=
Disallow /*?*sort=
Disallow /*?*show=
Disallow /*?*group=
Disallow /*?*matrix=
Disallow /*?*brand=
Disallow /*?*tag
Disallow /*?*price=

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://rawbike.com/sitemap.xml