berliner-abendblatt.de
robots.txt

Robots Exclusion Standard data for berliner-abendblatt.de

Resource Scan

Scan Details

Site Domain berliner-abendblatt.de
Base Domain berliner-abendblatt.de
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-19T05:34:48+00:00
Next Scan 2025-01-17T05:34:48+00:00

Last Successful Scan

Scanned2024-06-22T04:54:02+00:00
URL https://berliner-abendblatt.de/robots.txt
Domain IPs 134.119.0.209, 2a00:116a:10f:d190::
Response IP 134.119.0.209
Found Yes
Hash ca7f974804b0080a35a2293b05764f33203d83925a232f616237e2f8333b08c8
SimHash 6510d556c595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4