derf.com
robots.txt
Robots Exclusion Standard data for derf.com
Resource Scan
Scan Details
Site Domain | derf.com |
Base Domain | derf.com |
Scan Status | Ok |
Last Scan | 2025-09-24T16:35:39+00:00 |
Next Scan | 2025-10-01T16:35:39+00:00 |
Last Scan
Scanned | 2025-09-24T16:35:39+00:00 |
URL | https://derf.com/robots.txt |
Domain IPs | 104.26.0.49, 104.26.1.49, 172.67.71.220, 2606:4700:20::681a:131, 2606:4700:20::681a:31, 2606:4700:20::ac43:47dc |
Response IP | 104.26.0.49 |
Found | Yes |
Hash | 19b8edb960764c3839d99e35869f0b5926590466418b9567accd054a4df8a873 |
SimHash | 44350b53cd94 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Warnings
- `content-signal` is not a known field.
Comments