minuskel.de
robots.txt

Robots Exclusion Standard data for minuskel.de

Resource Scan

Scan Details

Site Domain minuskel.de
Base Domain minuskel.de
Scan Status Ok
Last Scan2024-09-26T20:32:46+00:00
Next Scan 2024-10-26T20:32:46+00:00

Last Scan

Scanned2024-09-26T20:32:46+00:00
URL https://minuskel.de/robots.txt
Domain IPs 193.96.188.140
Response IP 193.96.188.140
Found Yes
Hash 8082543b1a6770a0b86934fa629adb827da647e4e56e8b9a8d62c45aafa3a28c
SimHash eb6cd9e09332

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /archiv/
Disallow /logfiles/
Disallow /logfiles.kreise/
Disallow /seite_versenden/
Disallow /statistik/
Disallow /test/
Disallow /typo3/
Disallow /typo3conf/
Disallow /fileadmin/support/
Disallow druckversion.html
Disallow download.pdf
Disallow *%26type%3D*
Disallow *%26words%3D*
Disallow *%26swords%3D*
Disallow *%26eID%3D*
Disallow *%26tipURL%3D*
Disallow *%26cHash%3D*

Other Records

Field Value
crawl-delay 10

jobs.de-robot

Rule Path
Disallow /

jobspider

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

Comments

  • allgemein
  • Crawl delay
  • Boese Bots