sportmember.dk
robots.txt

Robots Exclusion Standard data for sportmember.dk

Resource Scan

Scan Details

Site Domain sportmember.dk
Base Domain sportmember.dk
Scan Status Ok
Last Scan2024-09-26T22:05:00+00:00
Next Scan 2024-10-03T22:05:00+00:00

Last Scan

Scanned2024-09-26T22:05:00+00:00
URL https://sportmember.dk/robots.txt
Redirect https://www.sportmember.dk/robots.txt
Redirect Domain www.sportmember.dk
Redirect Base sportmember.dk
Domain IPs 104.21.83.81, 172.67.217.216, 2606:4700:3030::6815:5351, 2606:4700:3030::ac43:d9d8
Redirect IPs 104.21.83.81, 172.67.217.216, 2606:4700:3030::6815:5351, 2606:4700:3030::ac43:d9d8
Response IP 104.21.83.81
Found Yes
Hash d686469bd4bb5277eb174cf728a287ac1d5707e89670b751b20d0de2a4f8908f
SimHash 8c72f7789955

Groups

*

Rule Path
Disallow /*_tid%3D*
Disallow /*.pdf*
Disallow /*.sfw%3D*
Disallow /*.xls%3D*
Disallow /*.doc%3D*
Disallow /3rdpartad.html
Disallow /clubs/new
Disallow /php/
Disallow /fb
Disallow /fb.mobile
Disallow /top_iframe_isense_dotdk.html
Disallow /klub/*
Disallow /hold/*
Disallow /sign_in/*
Disallow /category_products/*
Disallow /*.xls
Disallow /*.xlsx
Disallow /*.doc
Disallow /*.docx

mediapartners-google

Rule Path
Disallow

Comments

  • For Google AdSense to crawl the page