confused.com
robots.txt
Robots Exclusion Standard data for confused.com
Resource Scan
Scan Details
| Site Domain | confused.com |
| Base Domain | confused.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-14T08:33:43+00:00 |
| Next Scan | 2024-11-28T08:33:43+00:00 |
Last Successful Scan
| Scanned | 2024-03-27T07:49:25+00:00 |
| URL | https://confused.com/robots.txt |
| Redirect | https://www.confused.com/robots.txt |
| Redirect Domain | www.confused.com |
| Redirect Base | confused.com |
| Domain IPs | 104.16.24.88, 104.16.52.69, 2606:4700::6810:1858, 2606:4700::6810:3445 |
| Redirect IPs | 104.16.24.88, 104.16.52.69, 2606:4700::6810:1858, 2606:4700::6810:3445 |
| Response IP | 104.16.24.88 |
| Found | Yes |
| Hash | 1b7947ace432df7a51873dc3d9e40e181a3d3981983643a96952332e3e09360b |
| SimHash | a05c0e624f51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/form |
| Disallow | /*/Form |
| Disallow | /*/customersummary |
| Disallow | /*/customersummary/2 |
| Disallow | /*/customersummary/5 |
| Disallow | /*/ForgottenPassword |
| Disallow | /*/SignIn |
| Disallow | /*/signin |
| Disallow | /credit-cards/campaigns/ |
| Disallow | /credit-cards/CreditCards/More/ |
| Disallow | /credit-cards/Apply |
| Disallow | /credit-cards/CreditCards/Apply |
| Disallow | /savings/campaigns/ |
| Disallow | /savings/Apply |
| Disallow | /ClickThrough?TargetSiteAlias |
| Disallow | /account/ |
| Disallow | /services/ |
| Disallow | /ajaxServices/ |
| Disallow | /brian-the-robot/toy-claim |
| Disallow | /brian-the-robot/how-to-claim-toy/email |
| Disallow | /brian-the-robot/your-toy/claim-your-toy |
| Disallow | /carfused |
| Disallow | /api/tracking/* |
| Disallow | /redesign/ |
| Disallow | /miv2/ |
| Disallow | /mi/event |
| Disallow | /sitecore/ |
| Disallow | /campaign/ |
| Disallow | /includes/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.confused.com/sitemap.xml |
| sitemap | https://www.confused.com/sitemap_images.xml |