fashionchick.nl
robots.txt
Robots Exclusion Standard data for fashionchick.nl
Resource Scan
Scan Details
Site Domain | fashionchick.nl |
Base Domain | fashionchick.nl |
Scan Status | Ok |
Last Scan | 2024-06-24T17:43:49+00:00 |
Next Scan | 2024-07-01T17:43:49+00:00 |
Last Scan
Scanned | 2024-06-24T17:43:49+00:00 |
URL | https://fashionchick.nl/robots.txt |
Redirect | https://www.fashionchick.nl/robots.txt |
Redirect Domain | www.fashionchick.nl |
Redirect Base | fashionchick.nl |
Domain IPs | 13.35.18.104, 13.35.18.23, 13.35.18.6, 13.35.18.92 |
Redirect IPs | 52.84.229.46, 52.84.229.71, 52.84.229.84, 52.84.229.88 |
Response IP | 52.84.229.46 |
Found | Yes |
Hash | ade3913a1d45efebb5a50e5787eabfef67e803af76d9458b301ba946ec53d629 |
SimHash | 211c90728693 |
Groups
*
Rule | Path |
---|---|
Disallow | /*%5B%5D |
Disallow | /*%5B0%5D* |
Disallow | /*%5B1%5D* |
Disallow | /*%5B2%5D* |
Disallow | /*%5B3%5D* |
Disallow | /*%5B4%5D* |
Disallow | /*%5B5%5D* |
Disallow | /*%5B0%5D |
Disallow | /*%5B1%5D |
Disallow | /*%5B2%5D |
Disallow | /*?*brand%5B* |
Disallow | /*?*kleur%5B* |
Disallow | /*?*webshop%5B* |
Disallow | /*?*materiaal%5B* |
Disallow | */nieuw/ |
Disallow | /recomended-products/ |
Disallow | /cl/ |
Disallow | /p/ |
Disallow | /product/ |
Disallow | /cache/ |
Disallow | /CACHE/ |
Disallow | /profielen/ |
Disallow | /o/ |
Disallow | /s/ |
Disallow | /js/ |
Disallow | /theme/ |
Disallow | /preview/ |
Disallow | /girls/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.fashionchick.nl/sitemap.xml |