wir-frauen-im-netz.de
robots.txt

Robots Exclusion Standard data for wir-frauen-im-netz.de

Resource Scan

Scan Details

Site Domain wir-frauen-im-netz.de
Base Domain wir-frauen-im-netz.de
Scan Status Ok
Last Scan2024-11-10T01:46:16+00:00
Next Scan 2024-11-17T01:46:16+00:00

Last Scan

Scanned2024-11-10T01:46:16+00:00
URL https://wir-frauen-im-netz.de/robots.txt
Domain IPs 2001:8d8:100f:f000::200, 217.160.0.184
Response IP 217.160.0.184
Found Yes
Hash 74a4db7fabe77db7c471e52a52b67200737d134c279ade385b4401a7314db7f2
SimHash 084750807bb2

Groups

ahrefsbot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

ahrefsbot/4.0

Rule Path
Disallow /

ahrefsbot/3.1

Rule Path
Disallow /

ahrefsbot/3.0

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

ahrefsbot/1.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /wfin/adm/

*

Rule Path
Disallow /blog/wp-admin/

Other Records

Field Value
sitemap https://www.wir-frauen-im-netz.de/sitemap.xml
sitemap https://www.wir-frauen-im-netz.de/sitemap1.xml

Comments

  • robots.txt zu https://www.wir-frauen-im-netz.de/