freewill.com
robots.txt
Robots Exclusion Standard data for freewill.com
Resource Scan
Scan Details
Site Domain | freewill.com |
Base Domain | freewill.com |
Scan Status | Ok |
Last Scan | 2024-06-18T17:41:59+00:00 |
Next Scan | 2024-07-18T17:41:59+00:00 |
Last Scan
Scanned | 2024-06-18T17:41:59+00:00 |
URL | https://freewill.com/robots.txt |
Redirect | https://www.freewill.com/robots.txt |
Redirect Domain | www.freewill.com |
Redirect Base | freewill.com |
Domain IPs | 216.137.39.121, 216.137.39.67, 216.137.39.74, 216.137.39.97 |
Redirect IPs | 18.172.170.108, 18.172.170.41, 18.172.170.62, 18.172.170.70, 2600:9000:234c:1600:5:20f8:18c0:93a1, 2600:9000:234c:1c00:5:20f8:18c0:93a1, 2600:9000:234c:2000:5:20f8:18c0:93a1, 2600:9000:234c:5600:5:20f8:18c0:93a1, 2600:9000:234c:5c00:5:20f8:18c0:93a1, 2600:9000:234c:7a00:5:20f8:18c0:93a1, 2600:9000:234c:b400:5:20f8:18c0:93a1, 2600:9000:234c:da00:5:20f8:18c0:93a1 |
Response IP | 18.165.171.53 |
Found | Yes |
Hash | e7ab05184f57a02cff729e28ab4afd1f0e3c4d9099813c2e15171d7ef37f7134 |
SimHash | 2947d82087d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /will/ |
Disallow | /ahcd/ |
Disallow | /dfpoa/ |
Disallow | /qcd/ |
Disallow | /sg/ |
Disallow | /stocks/ |
Disallow | /rlt/ |
Disallow | /record/ |
Disallow | /beneficiaries/ |
Disallow | /daf/ |
Disallow | /docusign-stub.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.freewill.com/sitemap.xml |