smartasset.com
robots.txt
Robots Exclusion Standard data for smartasset.com
Resource Scan
Scan Details
| Site Domain | smartasset.com |
| Base Domain | smartasset.com |
| Scan Status | Ok |
| Last Scan | 2024-05-21T08:04:59+00:00 |
| Next Scan | 2024-05-28T08:04:59+00:00 |
Last Scan
| Scanned | 2024-05-21T08:04:59+00:00 |
| URL | https://smartasset.com/robots.txt |
| Domain IPs | 18.161.6.14, 18.161.6.21, 18.161.6.36, 18.161.6.91 |
| Response IP | 108.157.60.117 |
| Found | Yes |
| Hash | aa5981d034d99eb02a4dd3212218a5416569af6fd5e0772ecd1d8f267d098b9e |
| SimHash | 9d81ce2c08d5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_next/data/ |
| Disallow | /admin |
| Disallow | /adverts |
| Disallow | /ajax |
| Disallow | /api |
| Disallow | /captivate |
| Disallow | /disclosures/fee-structure/ |
| Disallow | /embed |
| Disallow | /external |
| Disallow | /files/admin/ |
| Disallow | /files/adverts/ |
| Disallow | /files/blank.html |
| Disallow | /files/captivate/ |
| Disallow | /files/data/ |
| Disallow | /files/index.html |
| Disallow | /files/infographic/ |
| Disallow | /files/mailchimp/ |
| Disallow | /files/marketwatchrss.xml |
| Disallow | /files/sheet/ |
| Disallow | /files/test/ |
| Disallow | /files/tmp/ |
| Disallow | /files/tools/ |
| Disallow | /files/widgets/ |
| Disallow | /retirement/advisor-preview |
| Disallow | /retirement/financial-advisor/start |
| Disallow | /retirement/find-a-financial-planner |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://smartasset.com/sitemap_index.xml |
| sitemap | https://smartasset.com/sitemap.xml |