Log In Sign Up

derbund.ch
robots.txt

Robots Exclusion Standard data for derbund.ch

Resource Scan

Scan Details

Site Domain derbund.ch
Base Domain derbund.ch
Scan Status Ok
Last Scan2024-06-19T04:54:03+00:00
Next Scan 2024-06-26T04:54:03+00:00

Last Scan

Scanned2024-06-19T04:54:03+00:00
URL https://derbund.ch/robots.txt
Redirect https://www.derbund.ch/robots.txt
Redirect Domain www.derbund.ch
Redirect Base derbund.ch
Domain IPs 2600:9000:263e:2a00:e:5a66:ac0:93a1, 2600:9000:263e:4e00:e:5a66:ac0:93a1, 2600:9000:263e:6a00:e:5a66:ac0:93a1, 2600:9000:263e:a600:e:5a66:ac0:93a1, 2600:9000:263e:b600:e:5a66:ac0:93a1, 2600:9000:263e:da00:e:5a66:ac0:93a1, 2600:9000:263e:f200:e:5a66:ac0:93a1, 2600:9000:263e:fe00:e:5a66:ac0:93a1, 3.163.189.103, 3.163.189.31, 3.163.189.36, 3.163.189.41
Redirect IPs 13.226.2.114, 13.226.2.43, 13.226.2.46, 13.226.2.82, 2600:9000:25ef:2600:e:5a66:ac0:93a1, 2600:9000:25ef:4400:e:5a66:ac0:93a1, 2600:9000:25ef:4600:e:5a66:ac0:93a1, 2600:9000:25ef:7600:e:5a66:ac0:93a1, 2600:9000:25ef:9400:e:5a66:ac0:93a1, 2600:9000:25ef:a800:e:5a66:ac0:93a1, 2600:9000:25ef:d200:e:5a66:ac0:93a1, 2600:9000:25ef:f600:e:5a66:ac0:93a1
Response IP 18.165.171.66
Found Yes
Hash 15eacc5722708e0640d8cfafb709a0c2f1a9687021b3b91b3e80cf1ff92577b1
SimHash d01e89405b37

Groups

psbot
yandex
petalbot
mail.ru_bot
megaindex
baiduspider
yisouspider
bytespider
sogou web spider
sogou inst spider
proximic
admantx
seekport crawler
semrushbot
blexbot
mj12bot
dotbot
gptbot
ccbot
google-extended

Rule Path
Disallow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.derbund.ch/sitemaps/sitemapindex.xml
sitemap https://www.derbund.ch/sitemaps/news.xml
Back to top

Comments

  • Disallow commercial bots to prevent ad fraud, see DISC-2117
  • Allow crawling for other bots
Back to top

Warnings

  • 1 invalid line.
Back to top