nastygal.com
robots.txt
Robots Exclusion Standard data for nastygal.com
Resource Scan
Scan Details
Site Domain | nastygal.com |
Base Domain | nastygal.com |
Scan Status | Ok |
Last Scan | 2024-11-02T21:40:06+00:00 |
Next Scan | 2024-11-16T21:40:06+00:00 |
Last Scan
Scanned | 2024-11-02T21:40:06+00:00 |
URL | https://nastygal.com/robots.txt |
Redirect | https://www.nastygal.com/robots.txt |
Redirect Domain | www.nastygal.com |
Redirect Base | nastygal.com |
Domain IPs | 34.213.106.51, 54.68.182.72 |
Redirect IPs | 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:70e, 96.17.180.25, 96.17.180.26 |
Response IP | 23.52.171.218 |
Found | Yes |
Hash | b5c873f651c7f0e074c647afca8562d357f39d0c57df44c7082da691ede412b2 |
SimHash | e2ed055ec616 |
Groups
*
Rule | Path |
---|---|
Disallow | /account-edit* |
Disallow | /preferences-edit* |
Disallow | /checkout-login* |
Disallow | /order-confirmation* |
Disallow | /order-history* |
Disallow | /on/demandware.store/* |
Allow | /on/demandware.store/*/Product-Show?pid=* |
Allow | /on/demandware.store/*/Home-IncludeMobileMenu |
Allow | /on/demandware.store/*/Home-IncludeHeaderMenu |
Disallow | */Wishlist-Add* |
Disallow | */wishlist-add* |
Disallow | */Product-Variation* |
Disallow | */Tile-UpdateVariantTile* |
Disallow | /*sz%3D* |
Allow | /*sz%3D80* |
Disallow | /*prefn1%3D*start%3D* |
Disallow | *?defaultgrid |
Disallow | /*srule%3D* |
Disallow | /*pmin%3D* |
Disallow | /*pmax%3D* |
Disallow | /*prefn1%3D* |
Disallow | /*prefn2%3D* |
Disallow | /*prefn3%3D* |
Disallow | /*prefn4%3D* |
Disallow | /*prefn5%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://www.nastygal.com/sitemap_index.xml |
sitemap | https://www.nastygal.com/shop/nc/sitemap/keyword.xml |
sitemap | https://www.nastygal.com/au/sitemap_index.xml |
sitemap | https://www.nastygal.com/eu/sitemap_index.xml |
sitemap | https://www.nastygal.com/fr/sitemap_index.xml |
Warnings
- `noindex` is not a known field.
Comments