namenswelt.de
robots.txt

Robots Exclusion Standard data for namenswelt.de

Resource Scan

Scan Details

Site Domain namenswelt.de
Base Domain namenswelt.de
Scan Status Ok
Last Scan2025-12-23T21:31:13+00:00
Next Scan 2025-12-30T21:31:13+00:00

Last Scan

Scanned2025-12-23T21:31:13+00:00
URL https://namenswelt.de/robots.txt
Domain IPs 104.21.82.143, 172.67.158.90, 2606:4700:3032::ac43:9e5a, 2606:4700:3036::6815:528f
Response IP 172.67.158.90
Found Yes
Hash 4bdb8d6468ae2fa2112d42d3e1cc57f78833dc5f3d88ebe1bb3cccb902f65e85
SimHash 69046d728095

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /tmp/
Disallow /cache/
Disallow /logs/
Disallow /*.sql$
Disallow /*.log$
Allow /styles.css
Allow /script.js
Allow /img/
Allow /js/
Allow /css/

Other Records

Field Value
sitemap https://www.namenswelt.de/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay (optional, falls nötig)
  • Crawl-delay: 1
  • Disallow bestimmte Verzeichnisse (falls vorhanden)
  • Erlaube wichtige Ressourcen