abendblatt-berlin.de
robots.txt

Robots Exclusion Standard data for abendblatt-berlin.de

Resource Scan

Scan Details

Site Domain abendblatt-berlin.de
Base Domain abendblatt-berlin.de
Scan Status Ok
Last Scan2024-06-16T02:58:45+00:00
Next Scan 2024-06-23T02:58:45+00:00

Last Scan

Scanned2024-06-16T02:58:45+00:00
URL http://abendblatt-berlin.de/robots.txt
Redirect https://berliner-abendblatt.de/robots.txt
Redirect Domain berliner-abendblatt.de
Redirect Base berliner-abendblatt.de
Domain IPs 134.119.0.209, 2a00:116a:10f:d190::
Redirect IPs 134.119.0.209, 2a00:116a:10f:d190::
Response IP 134.119.0.209
Found Yes
Hash ca7f974804b0080a35a2293b05764f33203d83925a232f616237e2f8333b08c8
SimHash 6510d556c595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4