scheibitz.com
robots.txt

Robots Exclusion Standard data for scheibitz.com

Resource Scan

Scan Details

Site Domain scheibitz.com
Base Domain scheibitz.com
Scan Status Ok
Last Scan2026-01-25T18:58:47+00:00
Next Scan 2026-02-24T18:58:47+00:00

Last Scan

Scanned2026-01-25T18:58:47+00:00
URL https://scheibitz.com/robots.txt
Domain IPs 85.13.161.81
Response IP 85.13.161.81
Found Yes
Hash 309322f2f36a62bfe09d200547c0bb9d9a494b131761aa792723b44fd51db299
SimHash b9081980ef73

Groups

*

Rule Path
Disallow assets/fonts/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea
netestate ne crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.scheibitz.com/sitemap.xml

Comments

  • ===================================
  • Erstellt am: 05.10.2015, 15:20
  • Webseite: https://www.scheibitz.com
  • ===================================
  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================