treadbikely.com
robots.txt

Robots Exclusion Standard data for treadbikely.com

Resource Scan

Scan Details

Site Domain treadbikely.com
Base Domain treadbikely.com
Scan Status Ok
Last Scan2026-03-03T03:43:54+00:00
Next Scan 2026-03-10T03:43:54+00:00

Last Scan

Scanned2026-03-03T03:43:54+00:00
URL https://treadbikely.com/robots.txt
Redirect https://www.treadbikely.com/robots.txt
Redirect Domain www.treadbikely.com
Redirect Base treadbikely.com
Domain IPs 104.21.10.227, 172.67.146.241, 2606:4700:3031::6815:ae3, 2606:4700:3032::ac43:92f1
Redirect IPs 104.21.10.227, 172.67.146.241, 2606:4700:3031::6815:ae3, 2606:4700:3032::ac43:92f1
Response IP 172.67.146.241
Found Yes
Hash 4bf4d6a3e979e8051e0a869adc5d994d02b4161cb8d6bbfd656ad9a92da8da5c
SimHash 606cdcb0e887

Groups

dmca

Rule Path
Disallow /

copyright

Rule Path
Disallow /

legal

Rule Path
Disallow /

lumenapi

Rule Path
Disallow /

lumen

Rule Path
Disallow /

google-legal-removals

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.treadbikely.com/sitemap.xml