bikester.se
robots.txt

Robots Exclusion Standard data for bikester.se

Resource Scan

Scan Details

Site Domain bikester.se
Base Domain bikester.se
Scan Status Ok
Last Scan2025-12-01T21:57:59+00:00
Next Scan 2025-12-31T21:57:59+00:00

Last Scan

Scanned2025-12-01T21:57:59+00:00
URL https://bikester.se/robots.txt
Redirect https://www.bikester.se/robots.txt
Redirect Domain www.bikester.se
Redirect Base bikester.se
Domain IPs 104.21.32.134, 172.67.152.74, 2606:4700:3030::ac43:984a, 2606:4700:3035::6815:2086
Redirect IPs 104.21.32.134, 172.67.152.74, 2606:4700:3030::ac43:984a, 2606:4700:3035::6815:2086
Response IP 172.67.152.74
Found Yes
Hash 43a647a8263898af14c0d5a2338d9eca5697dc52afbef28a98146ec69cd4af51
SimHash 491cd002ee13

Groups

*

Rule Path
Disallow /*?*tag
Disallow /*?*group=
Disallow /*?*brand=
Disallow /*?*price=
Disallow /*?*sort=
Disallow /*?*show=

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-searchbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bikester.se/sitemap.xml