hollistercanada.com
robots.txt
Robots Exclusion Standard data for hollistercanada.com
Resource Scan
Scan Details
| Site Domain | hollistercanada.com |
| Base Domain | hollistercanada.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T01:04:23+00:00 |
| Next Scan | 2024-11-21T01:04:23+00:00 |
Last Scan
| Scanned | 2024-11-14T01:04:23+00:00 |
| URL | https://hollistercanada.com/robots.txt |
| Domain IPs | 89.117.217.12 |
| Response IP | 89.117.217.12 |
| Found | Yes |
| Hash | 356e738e3ccdc4cfb19a45b6f428038f3405ea86dc1cb5b354c97aa113ca3d34 |
| SimHash | 501508d466d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search?q= |
| Disallow | /search/ |
| Disallow | /community/ |
| Disallow | /*?ajax=1 |
| Disallow | /*?preview_key= |
| Disallow | /liveblog/ |
| Disallow | /poll/* |
| Disallow | /mypop/ |
| Disallow | /for-you/ |
| Disallow | /competition/ |
Other Records
| Field | Value |
|---|---|
| sitemap | /sitemap.xml |
| sitemap | /sitemap-news.xml |