basedlabs.ai
robots.txt
Robots Exclusion Standard data for basedlabs.ai
Resource Scan
Scan Details
| Site Domain | basedlabs.ai |
| Base Domain | basedlabs.ai |
| Scan Status | Ok |
| Last Scan | 2025-09-16T14:02:18+00:00 |
| Next Scan | 2025-10-16T14:02:18+00:00 |
Last Scan
| Scanned | 2025-09-16T14:02:18+00:00 |
| URL | https://basedlabs.ai/robots.txt |
| Redirect | https://www.basedlabs.ai/robots.txt |
| Redirect Domain | www.basedlabs.ai |
| Redirect Base | basedlabs.ai |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.21 |
| Response IP | 76.76.21.21 |
| Found | Yes |
| Hash | 0c7c6daeffa2c76a433990a976cc2681effe1910c96d0efbfc182401f2a9910e |
| SimHash | 0008ded26521 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /explore/ |
| Allow | /images/ |
| Allow | /videos/ |
| Allow | /generate |
| Allow | /models |
| Allow | /articles |
| Allow | /threads |
| Allow | /tools |
| Allow | /tools/ |
| Allow | /tools/* |
| Allow | /tools/*/* |
| Allow | /apps |
| Allow | /memes/ |
| Disallow | /api/ |
| Disallow | /dashboard/ |
| Disallow | /signin |
| Disallow | /auth/ |
| Disallow | /test/ |
| Disallow | /admin/ |
| Disallow | /_next/ |
| Disallow | /static/ |
| Allow | /ai-api |
| Allow | /ai-plugins |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.basedlabs.ai/sitemap.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/static.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/collections.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/media.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/pages.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/articles.xml |
| sitemap | https://www.basedlabs.ai/sitemaps/memes.xml |
Comments