Log In Sign Up

kopf-net.de
robots.txt

Robots Exclusion Standard data for kopf-net.de

Resource Scan

Scan Details

Site Domain kopf-net.de
Base Domain kopf-net.de
Scan Status Ok
Last Scan2025-10-18T10:07:51+00:00
Next Scan 2025-11-17T10:07:51+00:00

Last Scan

Scanned2025-10-18T10:07:51+00:00
URL https://kopf-net.de/robots.txt
Redirect https://kopf.gmbh/robots.txt
Redirect Domain kopf.gmbh
Redirect Base kopf.gmbh
Domain IPs 178.250.10.88
Redirect IPs 178.250.10.88
Response IP 178.250.10.88
Found Yes
Hash a5d8db3b619a498ec38c58d8bdad941579eefb220c3424de0f67b49c693b951a
SimHash 69540b126333

Groups

*

Rule Path
Disallow /visioncontent/

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /
Back to top

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • D2
Back to top