cbinsights.com
robots.txt
Robots Exclusion Standard data for cbinsights.com
Resource Scan
Scan Details
| Site Domain | cbinsights.com |
| Base Domain | cbinsights.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-25T21:00:58+00:00 |
| Next Scan | 2024-06-24T21:00:58+00:00 |
Last Successful Scan
| Scanned | 2024-02-19T20:59:36+00:00 |
| URL | https://cbinsights.com/robots.txt |
| Redirect | https://www.cbinsights.com/robots.txt |
| Redirect Domain | www.cbinsights.com |
| Redirect Base | cbinsights.com |
| Domain IPs | 108.156.133.127, 108.156.133.128, 108.156.133.2, 108.156.133.4 |
| Redirect IPs | 13.33.33.10, 13.33.33.127, 13.33.33.62, 13.33.33.83 |
| Response IP | 108.138.189.122 |
| Found | Yes |
| Hash | 5bd7ff9fb8d9428de0eba064eb467b336c5238aeb880e343133bf1fbbc5a85e8 |
| SimHash | e8289904c2d7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /nyserda/ |
| Disallow | /embed/ |
| Disallow | /forbes/ampc-survey2.php |
| Disallow | /user_package_options.php |
| Disallow | /admin/ |
| Disallow | /pricing-monthly |
| Disallow | /marketing/mosaic_investor.php |
| Disallow | /reports/ |
| Disallow | /old-pricing |
| Disallow | /trial-pricing |
| Disallow | /marketing/*.php |
| Disallow | /contact-tos |
| Disallow | /ajax |
| Disallow | /sendgrid_event_hook.php |
| Disallow | /browser-plugins/ |
| Disallow | /performance/ |
| Disallow | /public_pages/ |
| Disallow | /research-reports/Global-Healthcare-Exits-Report.pdf |
| Disallow | /*.pdf$ |
| Disallow | /internal/ |
| Disallow | /company2/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cbinsights.com/sitemap/sitemap_master.xml |
| sitemap | https://www.cbinsights.com/research/sitemap.xml |