cyclingplus.com
robots.txt

Robots Exclusion Standard data for cyclingplus.com

Resource Scan

Scan Details

Site Domain cyclingplus.com
Base Domain cyclingplus.com
Scan Status Ok
Last Scan2024-11-09T08:52:11+00:00
Next Scan 2024-11-16T08:52:11+00:00

Last Scan

Scanned2024-11-09T08:52:11+00:00
URL https://cyclingplus.com/robots.txt
Redirect https://www.cyclingplus.com/robots.txt
Redirect Domain www.cyclingplus.com
Redirect Base cyclingplus.com
Domain IPs 178.79.178.218, 2a01:7e00:e000:3f7::
Redirect IPs 2600:9000:269a:2000:3:2588:77c0:93a1, 2600:9000:269a:3200:3:2588:77c0:93a1, 2600:9000:269a:5000:3:2588:77c0:93a1, 2600:9000:269a:5200:3:2588:77c0:93a1, 2600:9000:269a:9600:3:2588:77c0:93a1, 2600:9000:269a:c000:3:2588:77c0:93a1, 2600:9000:269a:e400:3:2588:77c0:93a1, 2600:9000:269a:e600:3:2588:77c0:93a1, 3.160.188.117, 3.160.188.123, 3.160.188.4, 3.160.188.99
Response IP 3.164.68.113
Found Yes
Hash 49735ae31cb1ed88b661f7764d0290bba237983c62f16556054158b58bb75d77
SimHash 29048860c313

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cyclingplus.com/sitemap/index.xml.gz
sitemap https://www.cyclingplus.com/sitemap/news.xml.gz