contentstack.io
robots.txt
Robots Exclusion Standard data for contentstack.io
Resource Scan
Scan Details
| Site Domain | contentstack.io |
| Base Domain | contentstack.io |
| Scan Status | Ok |
| Last Scan | 2024-09-19T23:47:42+00:00 |
| Next Scan | 2024-10-19T23:47:42+00:00 |
Last Scan
| Scanned | 2024-09-19T23:47:42+00:00 |
| URL | https://contentstack.io/robots.txt |
| Redirect | https://www.contentstack.com:443/robots.txt |
| Redirect Domain | www.contentstack.com |
| Redirect Base | contentstack.com |
| Domain IPs | 35.82.199.15, 52.43.163.216 |
| Redirect IPs | 104.17.186.25, 104.17.187.25, 2606:4700::6811:ba19, 2606:4700::6811:bb19 |
| Response IP | 104.17.186.25 |
| Found | Yes |
| Hash | d7bba370543d31cfebdd7bbd90ee9d757f02b7e648deb8496067753c28f7f5f7 |
| SimHash | 421442c2c151 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /blog/search |
| Disallow | /blog/search* |
| Disallow | /blog/search?* |
| Disallow | /company/contact-us/thank-you* |
| Disallow | /try-for-free/thank-you* |
| Disallow | /request-demo/thank-you* |
| Disallow | /docs/search* |
| Disallow | /techsurf21 |
| Disallow | /techsurf21* |
| Disallow | /campaigns/ |
| Disallow | /campaigns/* |
| Disallow | /customers/support/* |
| Disallow | /_next* |
| Disallow | /composable-quiz/form* |
| Disallow | /composable-quiz/question* |
| Disallow | /composable-quiz/result* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.contentstack.com/sitemap-main.xml |
Warnings
- `noindex` is not a known field.