Log In Sign Up

alex-cykler.dk
robots.txt

Robots Exclusion Standard data for alex-cykler.dk

Resource Scan

Scan Details

Site Domain alex-cykler.dk
Base Domain alex-cykler.dk
Scan Status Ok
Last Scan2024-09-22T10:38:57+00:00
Next Scan 2024-10-22T10:38:57+00:00

Last Scan

Scanned2024-09-22T10:38:57+00:00
URL https://alex-cykler.dk/robots.txt
Domain IPs 104.21.34.227, 172.67.165.240, 2606:4700:3031::ac43:a5f0, 2606:4700:3037::6815:22e3
Response IP 172.67.165.240
Found Yes
Hash f0629075aaf16d6f59d212994870ce03e9ac56f0fb69b2c5d79cc1270d5658ce
SimHash 1a1ec9602553

Groups

*

Rule Path
Disallow /*customer/account/login/referer*
Disallow /*?gear_speed=*
Disallow /*?stock=*

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

proximic

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex.3.0

Rule Path
Disallow /

webmeup

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://alex-cykler.dk/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top