distil.ai
robots.txt

Robots Exclusion Standard data for distil.ai

Resource Scan

Scan Details

Site Domain distil.ai
Base Domain distil.ai
Scan Status Ok
Last Scan2025-10-20T07:58:05+00:00
Next Scan 2025-11-19T07:58:05+00:00

Last Scan

Scanned2025-10-20T07:58:05+00:00
URL https://distil.ai/robots.txt
Domain IPs 35.246.78.175
Response IP 35.246.78.175
Found Yes
Hash 430af995becc59ac736c1b53034efe0127ba0036e57a809350324a055b3c2ad4
SimHash 59004d440d91

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /temp/
Disallow /static/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
sitemap https://distil.ai/sitemap_index.xml