aspecta.id
robots.txt

Robots Exclusion Standard data for aspecta.id

Resource Scan

Scan Details

Site Domain aspecta.id
Base Domain aspecta.id
Scan Status Ok
Last Scan2025-08-26T12:35:49+00:00
Next Scan 2025-09-25T12:35:49+00:00

Last Scan

Scanned2025-08-26T12:35:49+00:00
URL https://aspecta.id/robots.txt
Redirect https://aspecta.ai/robots.txt
Redirect Domain aspecta.ai
Redirect Base aspecta.ai
Domain IPs 18.217.224.200, 3.132.207.117
Redirect IPs 104.26.12.205, 104.26.13.205, 172.67.74.152, 2606:4700:20::681a:ccd, 2606:4700:20::681a:dcd, 2606:4700:20::ac43:4a98
Response IP 172.67.74.152
Found Yes
Hash 5fa3e8c4a6f7f416fad5c89874b0794bbe8ec838f1ed5319e642e59d323218c1
SimHash e30159d50213

Groups

*

Rule Path
Allow /
Disallow /error
Disallow /tests/
Disallow /maintenance/
Allow /
Allow /faqs
Allow /docs

Other Records

Field Value
sitemap https://m.aspecta.ai/sitemap.xml
sitemap https://aspecta.ai/sitemap.xml

Comments

  • Disallow error and test pages
  • Allow important pages
  • Sitemap