99spokes.com
robots.txt

Robots Exclusion Standard data for 99spokes.com

Resource Scan

Scan Details

Site Domain 99spokes.com
Base Domain 99spokes.com
Scan Status Ok
Last Scan2024-10-29T19:05:26+00:00
Next Scan 2024-11-05T19:05:26+00:00

Last Scan

Scanned2024-10-29T19:05:26+00:00
URL https://99spokes.com/robots.txt
Domain IPs 104.26.0.8, 104.26.1.8, 172.67.74.104, 2606:4700:20::681a:108, 2606:4700:20::681a:8, 2606:4700:20::ac43:4a68
Response IP 104.26.0.8
Found Yes
Hash d81e36ac2f2d90821aed4fa1cecc2b8ec986a2d393659fb5aeb2e25d0678f4d6
SimHash a925d800c3b2

Groups

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/session
Disallow /api/a
Disallow /out

Other Records

Field Value
sitemap https:/99spokes.com/sitemap.xml