policygenius.com
robots.txt
Robots Exclusion Standard data for policygenius.com
Resource Scan
Scan Details
| Site Domain | policygenius.com |
| Base Domain | policygenius.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T19:31:56+00:00 |
| Next Scan | 2024-10-25T19:31:56+00:00 |
Last Scan
| Scanned | 2024-09-25T19:31:56+00:00 |
| URL | https://policygenius.com/robots.txt |
| Redirect | https://www.policygenius.com/robots.txt |
| Redirect Domain | www.policygenius.com |
| Redirect Base | policygenius.com |
| Domain IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217, 2a04:4e42:200::729, 2a04:4e42:400::729, 2a04:4e42:600::729, 2a04:4e42::729 |
| Redirect IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217 |
| Response IP | 199.232.46.217 |
| Found | Yes |
| Hash | bd5f5d9be968093ba67565c9d585ef26d0bc2279f1b18cea0c5e87dd404224c1 |
| SimHash | 210715080f73 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /advice |
| Disallow | /*-insurance/advice |
| Disallow | /to-do |
| Disallow | /analysis |
| Disallow | /users |
| Disallow | /job_titles |
| Disallow | /affiliates |
| Disallow | /sf |
| Disallow | /sv |
| Disallow | /SF |
| Disallow | /SV |
| Disallow | /life-insurance/health/ |
| Disallow | /life-insurance/quotes/ |
| Disallow | /life-insurance/estimation |
| Disallow | /life-insurance/comparison |
| Disallow | /life-insurance/application |
| Disallow | /life-insurance/exit_survey/new |
| Disallow | /life-insurance/completed-application/exit-survey |
| Disallow | /life-insurance/basics |
| Disallow | /life-insurance/start |
| Disallow | /homeowners-insurance/quotes/ |
| Disallow | /auto-insurance/quotes/ |
| Disallow | /wills/create/ |
| Disallow | /blog/ghost/ |
| Disallow | /blog/main_nav/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.policygenius.com/sitemap-0.xml |