mobil.koeln.de
robots.txt

Robots Exclusion Standard data for mobil.koeln.de

Resource Scan

Scan Details

Site Domain mobil.koeln.de
Base Domain koeln.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-30T10:39:53+00:00
Next Scan 2024-10-29T10:39:53+00:00

Last Successful Scan

Scanned2022-12-14T13:22:21+00:00
URL https://mobil.koeln.de/robots.txt
Domain IPs 2001:4dd0:100:1023:80:15:0:1, 81.173.246.120
Response IP 81.173.246.120
Found Yes
Hash 4ba0ba5bdda05fa78264cdc98b9ad1f7578430103bf7e983ddda4ef170d85a7f
SimHash ab42ef5043f6

Groups

*

Rule Path
Disallow /

Comments

  • Site is closed , when will you EVER stop crawling it?!?!!
  • (served via RevP)