insurancedekho.com
robots.txt
Robots Exclusion Standard data for insurancedekho.com
Resource Scan
Scan Details
Site Domain | insurancedekho.com |
Base Domain | insurancedekho.com |
Scan Status | Ok |
Last Scan | 2024-10-17T07:06:18+00:00 |
Next Scan | 2024-11-16T07:06:18+00:00 |
Last Scan
Scanned | 2024-10-17T07:06:18+00:00 |
URL | https://insurancedekho.com/robots.txt |
Redirect | https://www.insurancedekho.com:443/robots.txt |
Redirect Domain | www.insurancedekho.com |
Redirect Base | insurancedekho.com |
Domain IPs | 3.108.253.44, 35.154.5.230 |
Redirect IPs | 13.33.88.101, 13.33.88.115, 13.33.88.40, 13.33.88.49, 2600:9000:223b:2000:11:1643:eec0:93a1, 2600:9000:223b:4000:11:1643:eec0:93a1, 2600:9000:223b:5200:11:1643:eec0:93a1, 2600:9000:223b:7a00:11:1643:eec0:93a1, 2600:9000:223b:9400:11:1643:eec0:93a1, 2600:9000:223b:a00:11:1643:eec0:93a1, 2600:9000:223b:ac00:11:1643:eec0:93a1, 2600:9000:223b:e000:11:1643:eec0:93a1 |
Response IP | 13.33.88.40 |
Found | Yes |
Hash | 63bfcb9da1562521a58c1e5b5593e99d90508b6424364a0e01594199d7357c1a |
SimHash | 2244ec82cc90 |
Groups
*
Rule | Path |
---|---|
Disallow | /bike-insurance/companies/add-on |
Disallow | /health-insurance/news/full-fdi-to-attract-global-insurance-distributors-70 |
Disallow | /health-insurance/news/irdai-withdraws-sale-of-comprehensive-motor-policy-306 |
Disallow | /health-insurance/news/covid-19-third-wave-likely-this-month-india-isn-t-ready-2310 |
Other Records
Field | Value |
---|---|
sitemap | https://www.insurancedekho.com/sitemap.xml |