bikeradar.com
robots.txt

Robots Exclusion Standard data for bikeradar.com

Resource Scan

Scan Details

Site Domain bikeradar.com
Base Domain bikeradar.com
Scan Status Ok
Last Scan2024-11-12T14:53:54+00:00
Next Scan 2024-11-19T14:53:54+00:00

Last Scan

Scanned2024-11-12T14:53:54+00:00
URL https://bikeradar.com/robots.txt
Redirect https://www.bikeradar.com/robots.txt
Redirect Domain www.bikeradar.com
Redirect Base bikeradar.com
Domain IPs 3.124.189.64
Redirect IPs 216.137.52.12, 216.137.52.21, 216.137.52.44, 216.137.52.96, 2600:9000:2181:3000:19:dfda:9900:93a1, 2600:9000:2181:5400:19:dfda:9900:93a1, 2600:9000:2181:5c00:19:dfda:9900:93a1, 2600:9000:2181:6600:19:dfda:9900:93a1, 2600:9000:2181:6e00:19:dfda:9900:93a1, 2600:9000:2181:a600:19:dfda:9900:93a1, 2600:9000:2181:d600:19:dfda:9900:93a1, 2600:9000:2181:de00:19:dfda:9900:93a1
Response IP 52.85.49.70
Found Yes
Hash 77c1d0b8442f469945ca86f04a44a1380b922da845ad8e05d517461cacb87342
SimHash 6105d170c713

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /search

Other Records

Field Value
sitemap https://www.bikeradar.com/sitemap/index.xml.gz
sitemap https://www.bikeradar.com/sitemap/news.xml.gz