1pw.de
robots.txt

Robots Exclusion Standard data for 1pw.de

Resource Scan

Scan Details

Site Domain 1pw.de
Base Domain 1pw.de
Scan Status Ok
Last Scan2026-01-16T15:30:59+00:00
Next Scan 2026-02-15T15:30:59+00:00

Last Scan

Scanned2026-01-16T15:30:59+00:00
URL https://1pw.de/robots.txt
Domain IPs 217.160.0.146
Response IP 217.160.0.146
Found Yes
Hash f02bac5c5b7f84c0e7da5b6cbe09e20540f46d37bc2549a2d5173233d2e1fb6c
SimHash 421cdd707693

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/

msiecrawler

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.1pw.de/sitemap.xml

Comments

  • robots.txt file