cyclingplus.com
robots.txt

Robots Exclusion Standard data for cyclingplus.com

Resource Scan

Scan Details

Site Domain cyclingplus.com
Base Domain cyclingplus.com
Scan Status Ok
Last Scan2024-06-01T08:45:30+00:00
Next Scan 2024-06-08T08:45:30+00:00

Last Scan

Scanned2024-06-01T08:45:30+00:00
URL https://cyclingplus.com/robots.txt
Redirect https://www.cyclingplus.com/robots.txt
Redirect Domain www.cyclingplus.com
Redirect Base cyclingplus.com
Domain IPs 178.79.178.218, 2a01:7e00:e000:3f7::
Redirect IPs 18.65.3.11, 18.65.3.120, 18.65.3.63, 18.65.3.79, 2600:9000:25f2:1400:3:2588:77c0:93a1, 2600:9000:25f2:200:3:2588:77c0:93a1, 2600:9000:25f2:2a00:3:2588:77c0:93a1, 2600:9000:25f2:2c00:3:2588:77c0:93a1, 2600:9000:25f2:8a00:3:2588:77c0:93a1, 2600:9000:25f2:c200:3:2588:77c0:93a1, 2600:9000:25f2:d000:3:2588:77c0:93a1, 2600:9000:25f2:fa00:3:2588:77c0:93a1
Response IP 18.165.171.20
Found Yes
Hash 49735ae31cb1ed88b661f7764d0290bba237983c62f16556054158b58bb75d77
SimHash 29048860c313

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cyclingplus.com/sitemap/index.xml.gz
sitemap https://www.cyclingplus.com/sitemap/news.xml.gz