f-d-v.de
robots.txt
Robots Exclusion Standard data for f-d-v.de
Resource Scan
Scan Details
Site Domain | f-d-v.de |
Base Domain | f-d-v.de |
Scan Status | Ok |
Last Scan | 2025-09-27T02:49:48+00:00 |
Next Scan | 2025-10-04T02:49:48+00:00 |
Last Scan
Scanned | 2025-09-27T02:49:48+00:00 |
URL | https://f-d-v.de/robots.txt |
Domain IPs | 104.21.45.216, 172.67.219.92, 2606:4700:3033::ac43:db5c, 2606:4700:3036::6815:2dd8 |
Response IP | 172.67.219.92 |
Found | Yes |
Hash | 332cade52c64f6bfee21d963f86ec2cf19a327abd23362b02f329afc9c57f626 |
SimHash | 46354b53c5d5 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- `content-signal` is not a known field.
Comments