lfu.bayern.de
robots.txt

Robots Exclusion Standard data for lfu.bayern.de

Resource Scan

Scan Details

Site Domain lfu.bayern.de
Base Domain bayern.de
Scan Status Ok
Last Scan2024-09-21T13:13:19+00:00
Next Scan 2024-10-21T13:13:19+00:00

Last Scan

Scanned2024-09-21T13:13:19+00:00
URL https://lfu.bayern.de/robots.txt
Redirect https://www.lfu.bayern.de/robots.txt
Redirect Domain www.lfu.bayern.de
Redirect Base bayern.de
Domain IPs 195.200.71.141
Redirect IPs 195.200.71.141
Response IP 195.200.71.141
Found Yes
Hash 3431daac98c82173437c647c9a2d0cbd9f1440c8752bf2ed640f3efcf19cc629
SimHash 600d1b10c751

Groups

speedy

Rule Path
Disallow /

*

Rule Path
Disallow /global/
Disallow /pic/
Disallow /script/
Disallow /style/
Disallow /_appincludes/
Disallow /buerger/doc/pdf/
Disallow /suchen/
Disallow /download/
Disallow /umrei/strvgProbe/export*
Disallow /musterinseln_online/
Disallow /publikationen/newsletter/anmeldung.htm
Disallow /wasser/sachverstaendige_wasserrecht/arbeitshilfen_psw/
Disallow /wasser/umgang_mit_wgs/infos_vaws_sv/
Disallow /wasser/gewaessernachbarschaften/intern/
Disallow /publikationen/pubman/
Disallow /publikationen/newsletter/

twitterbot

Rule Path
Allow /pic/pic_twitter/
Allow /global/
Allow /pic/
Allow /script/
Allow /style/

googlebot

Rule Path
Allow /global/
Allow /pic/
Allow /script/
Allow /style/

Other Records

Field Value
sitemap https://www.lfu.bayern.de/sitemap.xml

Comments

  • User-agent: gsa-crawler
  • User-agent: bingbot