comparepolicy.com
robots.txt
Robots Exclusion Standard data for comparepolicy.com
Resource Scan
Scan Details
| Site Domain | comparepolicy.com |
| Base Domain | comparepolicy.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2024-09-26T08:09:06+00:00 |
| Next Scan | 2024-10-03T08:09:06+00:00 |
Last Successful Scan
| Scanned | 2024-08-26T07:59:43+00:00 |
| URL | https://comparepolicy.com/robots.txt |
| Domain IPs | 180.179.209.31 |
| Response IP | 180.179.209.31 |
| Found | Yes |
| Hash | 0a052c16860ad55ffb8a79a658338a048e0164b8da10d1c560838a1884748b24 |
| SimHash | aac7e1646d00 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /blogs/author/* |
| Disallow | /blogs/cgi-bin/* |
| Disallow | /blogs/wp-admin/* |
| Disallow | /blogs/recommended/* |
| Disallow | /blogs/comments/feed/* |
| Disallow | /blogs/trackback/* |
| Disallow | /blogs/index.php |
| Disallow | /blogs/xmlrpc.php |
| Disallow | /blogs/wp-content/plugins/* |
| Disallow | /blogs/feed/* |
| Disallow | /blogs/*/feed/ |
| Disallow | /site/public/* |
| Disallow | /index.htm |
| Disallow | /subscribe |
| Disallow | /blog/* |
| Disallow | /search/* |
| Disallow | /author/* |
| Disallow | /captcha |
| Disallow | /.well-known/apple-app-site-association |
| Disallow | /apple-app-site-association |
| Disallow | /.well-known/assetlinks.json |
| Disallow | /life-insurance/term-blog.php |
| Disallow | /life-insurance/term-form?utm_source=blogs |
| Disallow | /health-insurance/health-blog.php |
| Disallow | /ulips-insurance/userDetails.php |
| Disallow | /health-insurance/userDetails.php |
| Disallow | /life-insurance/userDetails.php |
| Disallow | /AKHGHFYRTDR/termsandconditions |
| Disallow | /HJFRTFJGU/termsandconditions |
| Disallow | /ASGHJFKF/termsandconditions |
| Disallow | /blog-form/* |
| Disallow | /blogmobile-side-form/* |
| Disallow | /api/create-lead |
| Disallow | /properties/blogs/20180117_114413_1Rcma_Best |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.comparepolicy.com/sitemap.xml |
| sitemap | https://www.comparepolicy.com/sitemap-news.xml |
| sitemap | https://www.comparepolicy.com/blogs/post-sitemap.xml |
Comments