werecover.com
robots.txt
Robots Exclusion Standard data for werecover.com
Resource Scan
Scan Details
Site Domain | werecover.com |
Base Domain | werecover.com |
Scan Status | Ok |
Last Scan | 2024-09-17T05:34:28+00:00 |
Next Scan | 2024-10-17T05:34:28+00:00 |
Last Scan
Scanned | 2024-09-17T05:34:28+00:00 |
URL | https://werecover.com/robots.txt |
Redirect | https://www.werecover.com/robots.txt |
Redirect Domain | www.werecover.com |
Redirect Base | werecover.com |
Domain IPs | 104.198.14.52 |
Redirect IPs | 13.228.199.255, 2406:da18:880:3800::c8, 2406:da18:880:3802::c8, 46.137.195.11 |
Response IP | 46.137.195.11 |
Found | Yes |
Hash | 5f753b8d051e32d5b5d58bb58c70aab6ace70a7875a32987d40b90dc135b496a |
SimHash | 4444d140cc12 |
Groups
*
Rule | Path |
---|---|
Disallow | /signup/sud/* |
Disallow | /centers/upgrade/* |
Disallow | /my-account/* |
Disallow | /provider/* |
Disallow | /centers?* |
Disallow | /centers/index-old |
Disallow | /centers/locations |
Disallow | /baa |
Other Records
Field | Value |
---|---|
sitemap | https://www.werecover.com/sitemap/sitemap.xml.gz |