berliner-abendblatt.de
robots.txt

Robots Exclusion Standard data for berliner-abendblatt.de

Resource Scan

Scan Details

Site Domain berliner-abendblatt.de
Base Domain berliner-abendblatt.de
Scan Status Ok
Last Scan2024-06-08T04:53:19+00:00
Next Scan 2024-06-15T04:53:19+00:00

Last Scan

Scanned2024-06-08T04:53:19+00:00
URL https://berliner-abendblatt.de/robots.txt
Domain IPs 134.119.0.209, 2a00:116a:10f:d190::
Response IP 134.119.0.209
Found Yes
Hash ca7f974804b0080a35a2293b05764f33203d83925a232f616237e2f8333b08c8
SimHash 6510d556c595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4