bikester.fi
robots.txt

Robots Exclusion Standard data for bikester.fi

Resource Scan

Scan Details

Site Domain bikester.fi
Base Domain bikester.fi
Scan Status Ok
Last Scan2025-10-09T10:10:21+00:00
Next Scan 2025-11-08T10:10:21+00:00

Last Scan

Scanned2025-10-09T10:10:21+00:00
URL https://bikester.fi/robots.txt
Redirect https://www.bikester.fi/robots.txt
Redirect Domain www.bikester.fi
Redirect Base bikester.fi
Domain IPs 104.21.31.87, 172.67.175.193, 2606:4700:3033::6815:1f57, 2606:4700:3036::ac43:afc1
Redirect IPs 104.21.31.87, 172.67.175.193, 2606:4700:3033::6815:1f57, 2606:4700:3036::ac43:afc1
Response IP 172.67.175.193
Found Yes
Hash 8a95b4f50273bd01caedcd54d5e7d99ff9fc6411fb86ebe6c9322b3fa1fc7afa
SimHash 691c5802afd3

Groups

*

Rule Path
Disallow
Disallow /*?*tag
Disallow /*?*group=
Disallow /*?*brand=
Disallow /*?*price=
Disallow /*?*sort=
Disallow /*?*show=

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bikester.fi/sitemap.xml