msgamesandsoftware.de
robots.txt

Robots Exclusion Standard data for msgamesandsoftware.de

Resource Scan

Scan Details

Site Domain msgamesandsoftware.de
Base Domain msgamesandsoftware.de
Scan Status Ok
Last Scan2025-10-21T20:16:54+00:00
Next Scan 2025-11-20T20:16:54+00:00

Last Scan

Scanned2025-10-21T20:16:54+00:00
URL https://msgamesandsoftware.de/robots.txt
Redirect https://www.msgamesandsoftware.de/robots.txt
Redirect Domain www.msgamesandsoftware.de
Redirect Base msgamesandsoftware.de
Domain IPs 195.30.85.50
Redirect IPs 195.30.85.50
Response IP 195.30.85.50
Found Yes
Hash 12cf8a309765af9668cce214ad21b79f9ca708500027fa83c6bab96a6f74a3f0
SimHash 0e0d7cc19671

Groups

*

Rule Path
Disallow /footer/
Disallow /geshi/
Disallow /girocheckout/
Disallow /header/
Disallow /inc/
Disallow /js/
Disallow /maintenance-work/
Disallow /mysqli/
Disallow /pdf/
Disallow /staff/
Disallow /TwoFactorAuthentication/
Disallow /assets/
Disallow /style/
Disallow /images/
Disallow /js/
Disallow /admin/
Disallow /login/
Disallow /logout/
Disallow /register/
Disallow /user/settings/
Disallow /password-reset/
Disallow /bbocde.php
Disallow /generate_sitemap.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.msgamesandsoftware.de/sitemap.xml

Comments

  • Allgemeine Sperren
  • Technische Pfade (JS, CSS, Images etc. meist unnötig zu crawlen)
  • Admin-, Login- und Socherheitspfade
  • Interne Systemskripte
  • Optional: Crawler-spezifische Anweisungen
  • Sitemap verlinken (Pfad absolut angeben)