forever21.com
robots.txt
Robots Exclusion Standard data for forever21.com
Resource Scan
Scan Details
| Site Domain | forever21.com |
| Base Domain | forever21.com |
| Scan Status | Ok |
| Last Scan | 2024-10-08T18:26:27+00:00 |
| Next Scan | 2024-11-07T18:26:27+00:00 |
Last Scan
| Scanned | 2024-10-08T18:26:27+00:00 |
| URL | https://forever21.com/robots.txt |
| Redirect | https://www.forever21.com/robots.txt |
| Redirect Domain | www.forever21.com |
| Redirect Base | forever21.com |
| Domain IPs | 104.18.32.41, 172.64.155.215, 2606:4700:4400::6812:2029, 2606:4700:4400::ac40:9bd7 |
| Redirect IPs | 104.18.32.41, 172.64.155.215, 2606:4700:4400::6812:2029, 2606:4700:4400::ac40:9bd7 |
| Response IP | 104.18.32.41 |
| Found | Yes |
| Hash | 4a08f34704f12ebe9598895dfe5397ff0228bbba6cc52ff722175819aa35adf8 |
| SimHash | d52f8c05d774 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */gl/ |
| Disallow | */core/ |
| Disallow | */CheckOut/ |
| Disallow | */Checkout/ |
| Disallow | */checkout/ |
| Disallow | */search/ |
| Disallow | */Search-Ajax |
| Disallow | */Search-ShowAjax |
| Disallow | */login/ |
| Disallow | */Login |
| Disallow | */Account-Show |
| Disallow | */account/ |
| Disallow | *%2C* |
| Disallow | /*?q= |
| Disallow | /*prefn1%3D |
| Disallow | /*prefn2%3D |
| Disallow | /*prefn3%3D |
| Disallow | /*prefn4%3D |
| Disallow | /*prefv1%3D |
| Disallow | /*prefv2%3D |
| Disallow | /*prefv3%3D |
| Disallow | /*prefv4%3D |
| Disallow | /*pmax%3D* |
| Disallow | /*pmin%3D* |
| Disallow | *%26ir_ |
| Disallow | *%26mr%3A |
| Disallow | *%26om_ |
| Disallow | */Address |
| Disallow | */Cart |
| Disallow | */CSRF |
| Disallow | */Product-Recommendation |
| Disallow | */Product-Zoom |
| Disallow | */SaveForLater |
| Disallow | */Wishlist |
| Disallow | *?ir_ |
| Disallow | *?mr%3A |
| Disallow | *?om_ |
| Disallow | *_br_psugg_q%3D |
| Disallow | *_size%3D |
| Disallow | *AdditionalEmailAttribute |
| Disallow | *campaignid%3D |
| Disallow | *creationdate%3D |
| Disallow | *curpage%3D |
| Disallow | *dynamic%3D |
| Disallow | *et_rid%3D |
| Disallow | *ibx_source%3D |
| Disallow | *ProductID%3D |
| Disallow | *productid%3D |
| Disallow | *restrackid%3D |
| Disallow | *RIID%3D |
| Disallow | *sfmc_* |
| Disallow | *siteID%3D |
| Disallow | *utm_kxconfid%3D |
| Disallow | *variantid%3D |
| Disallow | *VariantID%3D |
| Disallow | /*%26q%3D |
| Disallow | /*_branch_match_id%3D |
| Disallow | /*crlt.pid%3D |
| Disallow | /*mi_u%3D |
| Disallow | /*recid%3D |
| Disallow | *sz%3D64 |
| Disallow | *sz%3D96 |
| Disallow | *TrueFit-Customer |
| Disallow | *Search-Show |
| Disallow | /*/product-show?pid=* |
| Disallow | /*/category-show?cid=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.forever21.com/sitemap_index.xml |