sportmember.es
robots.txt

Robots Exclusion Standard data for sportmember.es

Resource Scan

Scan Details

Site Domain sportmember.es
Base Domain sportmember.es
Scan Status Ok
Last Scan2024-10-28T13:03:00+00:00
Next Scan 2024-11-04T13:03:00+00:00

Last Scan

Scanned2024-10-28T13:03:00+00:00
URL https://sportmember.es/robots.txt
Redirect https://www.sportmember.es/robots.txt
Redirect Domain www.sportmember.es
Redirect Base sportmember.es
Domain IPs 104.26.6.213, 104.26.7.213, 172.67.69.64, 2606:4700:20::681a:6d5, 2606:4700:20::681a:7d5, 2606:4700:20::ac43:4540
Redirect IPs 104.26.6.213, 104.26.7.213, 172.67.69.64, 2606:4700:20::681a:6d5, 2606:4700:20::681a:7d5, 2606:4700:20::ac43:4540
Response IP 172.67.69.64
Found Yes
Hash bd9592e8db7d2c622dd9dd0a6c36c449a6d7e4323fa8a8d44b4b32eccd799c9e
SimHash 0c52d77899d1

Groups

*

Rule Path
Disallow /*_tid%3D*
Disallow /*.pdf*
Disallow /*.sfw%3D*
Disallow /*.xls%3D*
Disallow /*.doc%3D*
Disallow /3rdpartad.html
Disallow /clubs/new
Disallow /php/
Disallow /fb
Disallow /fb.mobile
Disallow /top_iframe_isense_dotdk.html
Disallow /klub/*
Disallow /hold/*
Disallow /sign_in/*
Disallow /category_products/*
Disallow /*.xls
Disallow /*.xlsx
Disallow /*.doc
Disallow /*.docx

googlebot-mobile
yahooseeker/m1a1-r2d2
msnbot_mobile

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

Comments

  • For Google AdSense to crawl the page