dilidili.io
robots.txt

Robots Exclusion Standard data for dilidili.io

Resource Scan

Scan Details

Site Domain dilidili.io
Base Domain dilidili.io
Scan Status Ok
Last Scan5/19/2025, 9:04:04 PM
Next Scan 6/18/2025, 9:04:04 PM

Last Scan

Scanned5/19/2025, 9:04:04 PM
URL https://dilidili.io/robots.txt
Domain IPs 104.21.8.106, 172.67.157.76, 2606:4700:3030::ac43:9d4c, 2606:4700:3035::6815:86a
Response IP 172.67.157.76
Found Yes
Hash 0c2950fe78781b1b67701a0c7f2e56a8edb1cde2aa66baae8970b87e4d901430
SimHash 0154c07247d3

Groups

*

Rule Path
Disallow /Disallow

*

Rule Path
Allow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /