dni.today
robots.txt

Robots Exclusion Standard data for dni.today

Resource Scan

Scan Details

Site Domain dni.today
Base Domain dni.today
Scan Status Ok
Last Scan2024-06-18T05:07:54+00:00
Next Scan 2024-06-25T05:07:54+00:00

Last Scan

Scanned2024-06-18T05:07:54+00:00
URL https://dni.today/robots.txt
Domain IPs 23.111.113.4
Response IP 23.111.113.4
Found Yes
Hash dd43bc34caeaf517aadba4ce98d8f0d3b5be05a1c2796bf5bccf4fa22383bdf7
SimHash 49159850c7d2

Groups

googlebot

Rule Path
Allow /
Disallow /*?*
Disallow /search
Disallow /preview
Disallow /more/

*

Rule Path
Allow /
Disallow /*?*
Disallow /search
Disallow /preview
Disallow /more/

Other Records

Field Value
sitemap https://dni.plus/google_sitemap.xml

Warnings

  • `host` is not a known field.