agrarled.de
robots.txt

Robots Exclusion Standard data for agrarled.de

Resource Scan

Scan Details

Site Domain agrarled.de
Base Domain agrarled.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-06T21:53:20+00:00
Next Scan 2025-09-20T21:53:20+00:00

Last Successful Scan

Scanned2025-04-23T00:47:49+00:00
URL https://agrarled.de/robots.txt
Redirect https://www.agrarled.de/robots.txt
Redirect Domain www.agrarled.de
Redirect Base agrarled.de
Domain IPs 104.21.73.101, 172.67.189.163, 2606:4700:3030::6815:4965, 2606:4700:3033::ac43:bda3
Redirect IPs 104.21.73.101, 172.67.189.163, 2606:4700:3030::6815:4965, 2606:4700:3033::ac43:bda3
Response IP 104.21.73.101
Found Yes
Hash 80f9b236138f5ee7f466543295eba9c6e02ec9c62eba9824e4cdde56d97fddc8
SimHash e90998008bb2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow */feed/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.agrarled.de/sitemap.xml