db-regio-bus-nrw.de
robots.txt

Robots Exclusion Standard data for db-regio-bus-nrw.de

Resource Scan

Scan Details

Site Domain db-regio-bus-nrw.de
Base Domain db-regio-bus-nrw.de
Scan Status Ok
Last Scan2024-09-14T01:16:19+00:00
Next Scan 2024-10-14T01:16:19+00:00

Last Scan

Scanned2024-09-14T01:16:19+00:00
URL http://db-regio-bus-nrw.de/robots.txt
Redirect https://www.dbregiobus-nrw.de:443/robots.txt
Redirect Domain www.dbregiobus-nrw.de
Redirect Base dbregiobus-nrw.de
Domain IPs 81.200.196.33
Redirect IPs 23.59.168.129, 2600:1413:b000:6::17d5:2bda, 2600:1413:b000:6::17d5:2bdd
Response IP 23.59.168.129
Found Yes
Hash e05f7620db6872456a1deb2084e88db2739985133d5b4df8c1232b40b83b3553
SimHash 415500b55751

Groups

*

Rule Path
Disallow /.rest/
Disallow /web/

googlebot
bingbot
slurp

Rule Path
Allow /