distilled.ai
robots.txt

Robots Exclusion Standard data for distilled.ai

Resource Scan

Scan Details

Site Domain distilled.ai
Base Domain distilled.ai
Scan Status Ok
Last Scan2025-10-04T05:45:20+00:00
Next Scan 2025-11-03T05:45:20+00:00

Last Scan

Scanned2025-10-04T05:45:20+00:00
URL https://distilled.ai/robots.txt
Domain IPs 104.21.67.220, 172.67.182.11, 2606:4700:3031::ac43:b60b, 2606:4700:3034::6815:43dc
Response IP 104.21.67.220
Found Yes
Hash 207875cb608b3af66b9b6e02c247fc9f870a816ceddfc3dd81ec39db5fdc10d9
SimHash 490c4a16c693

Groups

*

Rule Path
Allow /
Disallow /private/
Disallow /admin/

Other Records

Field Value
sitemap https://distilled.ai/sitemap.xml