dni.today
robots.txt
Robots Exclusion Standard data for dni.today
Resource Scan
Scan Details
Site Domain | dni.today |
Base Domain | dni.today |
Scan Status | Ok |
Last Scan | 2024-06-18T05:07:54+00:00 |
Next Scan | 2024-06-25T05:07:54+00:00 |
Last Scan
Scanned | 2024-06-18T05:07:54+00:00 |
URL | https://dni.today/robots.txt |
Domain IPs | 23.111.113.4 |
Response IP | 23.111.113.4 |
Found | Yes |
Hash | dd43bc34caeaf517aadba4ce98d8f0d3b5be05a1c2796bf5bccf4fa22383bdf7 |
SimHash | 49159850c7d2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?* |
Disallow | /search |
Disallow | /preview |
Disallow | /more/ |
Other Records
Field | Value |
---|---|
sitemap | https://dni.plus/google_sitemap.xml |
Warnings
- `host` is not a known field.