cycleinsider.com
robots.txt

Robots Exclusion Standard data for cycleinsider.com

Resource Scan

Scan Details

Site Domain cycleinsider.com
Base Domain cycleinsider.com
Scan Status Ok
Last Scan2024-11-06T03:22:40+00:00
Next Scan 2024-12-06T03:22:40+00:00

Last Scan

Scanned2024-11-06T03:22:40+00:00
URL https://cycleinsider.com/robots.txt
Redirect https://www.cycleinsider.com/robots.txt
Redirect Domain www.cycleinsider.com
Redirect Base cycleinsider.com
Domain IPs 18.213.42.87, 23.21.52.140, 34.198.216.143
Redirect IPs 18.213.42.87, 23.21.52.140, 34.198.216.143
Response IP 23.21.52.140
Found Yes
Hash 2f2f59cbe7d5355ca0f14ff99de5cd0a8d4fad8d5896182a863fc131df70f930
SimHash f80cdc48ac93

Groups

*

Rule Path
Disallow /*page%3D*
Disallow /search/

Other Records

Field Value
sitemap https://www.cycleinsider.com/sitemap.xml