devbert.de
robots.txt

Robots Exclusion Standard data for devbert.de

Resource Scan

Scan Details

Site Domain devbert.de
Base Domain devbert.de
Scan Status Ok
Last Scan2025-10-09T01:02:38+00:00
Next Scan 2025-10-16T01:02:38+00:00

Last Scan

Scanned2025-10-09T01:02:38+00:00
URL https://devbert.de/robots.txt
Domain IPs 104.21.1.55, 172.67.128.159, 2606:4700:3030::6815:137, 2606:4700:3036::ac43:809f
Response IP 104.21.1.55
Found Yes
Hash 6e421824359586a2b852708a98dc8af68f39f88da4cec70d4e32bea98ed9d1b7
SimHash c800ca02c3b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /wp-admin/