schweizseiten.com
robots.txt

Robots Exclusion Standard data for schweizseiten.com

Resource Scan

Scan Details

Site Domain schweizseiten.com
Base Domain schweizseiten.com
Scan Status Ok
Last Scan2026-01-20T08:33:19+00:00
Next Scan 2026-01-27T08:33:19+00:00

Last Scan

Scanned2026-01-20T08:33:19+00:00
URL https://schweizseiten.com/robots.txt
Domain IPs 104.21.5.29, 172.67.132.208, 2606:4700:3032::ac43:84d0, 2606:4700:3036::6815:51d
Response IP 104.21.5.29
Found Yes
Hash 7de60b8c76ee5411715eab42829da82d4a4d0e27a187039d856754e09467601e
SimHash 682ede02ca30

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /storage/
Disallow /vendor/
Disallow /dashboard/
Disallow /login
Disallow /register
Disallow /password/
Allow /firmen/
Allow /branchen/
Allow /staedte/
Allow /kantone/
Allow /services/
Allow /news/
Allow /kontakt
Allow *.css
Allow *.js
Allow *.jpg
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.svg
Allow *.webp

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://schweizseiten.com/sitemap.xml

Comments

  • Sitemaps
  • Crawl-delay für höfliches Crawling
  • Verzeichnisse die nicht gecrawlt werden sollen
  • Erlaubte wichtige Bereiche
  • Ressourcen
  • Block bad bots