beobachter.ch
robots.txt

Robots Exclusion Standard data for beobachter.ch

Resource Scan

Scan Details

Site Domain beobachter.ch
Base Domain beobachter.ch
Scan Status Ok
Last Scan2024-11-10T18:30:07+00:00
Next Scan 2024-11-17T18:30:07+00:00

Last Scan

Scanned2024-11-10T18:30:07+00:00
URL https://beobachter.ch/robots.txt
Redirect https://www.beobachter.ch/robots.txt
Redirect Domain www.beobachter.ch
Redirect Base beobachter.ch
Domain IPs 104.21.54.203, 172.67.169.5, 2606:4700:3031::6815:36cb, 2606:4700:3031::ac43:a905
Redirect IPs 23.215.7.4, 23.215.7.8
Response IP 96.17.180.50
Found Yes
Hash 26b5a188212be6ce68eb063c68512c70905122bf872245e705851eb27b4f90c2
SimHash a2ef8d583973

Groups

grapeshot

Rule Path
Disallow

*

Rule Path
Disallow /log/
Disallow /misc/
Disallow /t3lib/
Disallow /index.php?*
Disallow /linkTo_UnCryptMailto*
Disallow *topics
Disallow /suche/
Disallow /authorize/
Disallow /logout/
Disallow /profile/
Disallow *?*email_address=
Disallow *?*form_build_id=
Disallow *?*form_id=
Disallow *?*search_form_block=
Disallow *?*view_dom_id=
Disallow *?*pkBerichtNr=
Disallow *?*%24Version=*
Disallow *?*%24Path=*
Disallow *?*_ptid=*

Other Records

Field Value
sitemap https://www.beobachter.ch/sitemap.xml
sitemap https://www.beobachter.ch/googlenews.xml
sitemap https://www.beobachter.ch/image-sitemap.xml
sitemap https://www.beobachter.ch/sitemap-authors.xml

Comments

  • todo: check if grapeshot user agent is needed!
  • all robots
  • Sitemaps
  • Parameters