assembly.io
robots.txt

Robots Exclusion Standard data for assembly.io

Resource Scan

Scan Details

Site Domain assembly.io
Base Domain assembly.io
Scan Status Ok
Last Scan2025-07-17T15:44:02+00:00
Next Scan 2025-08-16T15:44:02+00:00

Last Scan

Scanned2025-07-17T15:44:02+00:00
URL https://assembly.io/robots.txt
Redirect https://www.hellozai.com/robots.txt
Redirect Domain www.hellozai.com
Redirect Base hellozai.com
Domain IPs 54.153.144.65, 54.206.167.123
Redirect IPs 199.60.103.227, 199.60.103.29, 2606:2c40::c73c:671d, 2606:2c40::c73c:67e3
Response IP 199.60.103.29
Found Yes
Hash d88e0cc728bbb1ff97e3de76167c7e207fca1c31f86073cb987696df183eb952
SimHash 7965c77557b3

Groups

*

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

claude-user

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

chatgpt-user

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

perplexity-user

Rule Path
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

Other Records

Field Value
sitemap https://www.hellozai.com/sitemap.xml

Comments

  • Allow agentic-AI users