aspecta.ai
robots.txt

Robots Exclusion Standard data for aspecta.ai

Resource Scan

Scan Details

Site Domain aspecta.ai
Base Domain aspecta.ai
Scan Status Ok
Last Scan2025-09-04T00:09:46+00:00
Next Scan 2025-10-04T00:09:46+00:00

Last Scan

Scanned2025-09-04T00:09:46+00:00
URL https://aspecta.ai/robots.txt
Domain IPs 104.26.12.205, 104.26.13.205, 172.67.74.152, 2606:4700:20::681a:ccd, 2606:4700:20::681a:dcd, 2606:4700:20::ac43:4a98
Response IP 104.26.13.205
Found Yes
Hash 5fa3e8c4a6f7f416fad5c89874b0794bbe8ec838f1ed5319e642e59d323218c1
SimHash e30159d50213

Groups

*

Rule Path
Allow /
Disallow /error
Disallow /tests/
Disallow /maintenance/
Allow /
Allow /faqs
Allow /docs

Other Records

Field Value
sitemap https://m.aspecta.ai/sitemap.xml
sitemap https://aspecta.ai/sitemap.xml

Comments

  • Disallow error and test pages
  • Allow important pages
  • Sitemap