lightsite.ai
robots.txt
Robots Exclusion Standard data for lightsite.ai
Resource Scan
Scan Details
| Site Domain | lightsite.ai |
| Base Domain | lightsite.ai |
| Scan Status | Ok |
| Last Scan | 2025-11-12T07:17:17+00:00 |
| Next Scan | 2025-11-26T07:17:17+00:00 |
Last Scan
| Scanned | 2025-11-12T07:17:17+00:00 |
| URL | https://lightsite.ai/robots.txt |
| Redirect | https://www.lightsite.ai/robots.txt |
| Redirect Domain | www.lightsite.ai |
| Redirect Base | lightsite.ai |
| Domain IPs | 75.2.60.5 |
| Redirect IPs | 75.2.60.5 |
| Response IP | 75.2.60.5 |
| Found | Yes |
| Hash | 539241ec828f62b4975722d51f7467bc67b91412daed6abd59e2613d7baa4174 |
| SimHash | 6d3c8bf2e141 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /client-login/ |
| Disallow | /account/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /admin/ |
| Disallow | /*?*sessionid=* |
| Disallow | /*?*preview=* |
| Disallow | /*?*utm_* |
gptbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
google-extended
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
claudebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
anthropic-ai
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
ccbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
perplexitybot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
| Allow | /ai-sitemap.xml |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /ai.json |
| Allow | /ai/* |
| Allow | /.well-known/ai-plugin.json |
| Allow | /.well-known/wacp.json |
| Allow | /api-docs.json |
*
| Rule | Path |
|---|---|
| Allow | /docs/ |
| Allow | /docs/* |
| Allow | /ai.json$ |
| Allow | /ai/*.json$ |
| Allow | /.well-known/ai-plugin.json$ |
| Allow | /.well-known/wacp.json$ |
| Allow | /api-docs.json$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fcfkbvculokjmzycgxbj.supabase.co/functions/v1/llm-discovery/public/sitemap.xml?domain=www.lightsite.ai |
| sitemap | https://lightsite.ai/sitemap.xml |
| sitemap | https://lightsite.ai/ai-sitemap.xml |
Comments