diw.de
robots.txt

Robots Exclusion Standard data for diw.de

Resource Scan

Scan Details

Site Domain diw.de
Base Domain diw.de
Scan Status Ok
Last Scan4/19/2025, 11:13:33 PM
Next Scan 5/19/2025, 11:13:33 PM

Last Scan

Scanned4/19/2025, 11:13:33 PM
URL https://diw.de/robots.txt
Redirect https://www.diw.de/robots.txt
Redirect Domain www.diw.de
Redirect Base diw.de
Domain IPs 195.90.218.113
Redirect IPs 195.90.218.113
Response IP 195.90.218.113
Found Yes
Hash f6cc260bff3435683cf838fc65f2cc4a84b24d0b9c330588eb0ec3584e50dfe5
SimHash 6518dc44c195

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15