women.com
robots.txt
Robots Exclusion Standard data for women.com
Resource Scan
Scan Details
| Site Domain | women.com |
| Base Domain | women.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T01:38:03+00:00 |
| Next Scan | 2024-11-17T01:38:03+00:00 |
Last Scan
| Scanned | 2024-11-10T01:38:03+00:00 |
| URL | https://women.com/robots.txt |
| Domain IPs | 13.33.88.126, 13.33.88.47, 13.33.88.65, 13.33.88.94 |
| Response IP | 13.33.88.47 |
| Found | Yes |
| Hash | f3b9b35aa1c752ff2e7103e898e4a64a1c4c77c952fb8ebc35df3fa535e1a70a |
| SimHash | bb1648496d81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /*?*ajax= |
| Disallow | /*/s/* |
| Disallow | /*/sl/* |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.women.com/sitemap_index.xml |
| sitemap | https://www.women.com/stories/sitemap-index.xml |
| sitemap | https://www.women.com/?getfeed=google |