defined.ai
robots.txt

Robots Exclusion Standard data for defined.ai

Resource Scan

Scan Details

Site Domain defined.ai
Base Domain defined.ai
Scan Status Ok
Last Scan2025-10-27T22:03:45+00:00
Next Scan 2025-11-26T22:03:45+00:00

Last Scan

Scanned2025-10-27T22:03:45+00:00
URL https://defined.ai/robots.txt
Domain IPs 104.18.14.190, 104.18.15.190, 2606:4700::6812:ebe, 2606:4700::6812:fbe
Response IP 104.18.15.190
Found Yes
Hash 0f591cd58bb90ba496e39c2f64245eb408d6b92c940cb61e13a5190e0869cfce
SimHash 411cd551c731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://strapi.definedcrowd.com/api/sitemap/index.xml