capitalhairandbeauty.co.uk
robots.txt
Robots Exclusion Standard data for capitalhairandbeauty.co.uk
Resource Scan
Scan Details
| Site Domain | capitalhairandbeauty.co.uk |
| Base Domain | capitalhairandbeauty.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-20T12:13:02+00:00 |
| Next Scan | 2024-11-19T12:13:02+00:00 |
Last Scan
| Scanned | 2024-10-20T12:13:02+00:00 |
| URL | https://capitalhairandbeauty.co.uk/robots.txt |
| Redirect | https://www.capitalhairandbeauty.co.uk/robots.txt |
| Redirect Domain | www.capitalhairandbeauty.co.uk |
| Redirect Base | capitalhairandbeauty.co.uk |
| Domain IPs | 93.184.255.33 |
| Redirect IPs | 93.184.255.33 |
| Response IP | 93.184.255.33 |
| Found | Yes |
| Hash | 6546f92389adb5899625af590aede6fb4c3b66aae46ee44989c4466d2de9c0c2 |
| SimHash | 265051a4c393 |
Groups
ahrefsbot
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
mj12bot
blexbot
ezooms
mozilla/4.0 (compatible; msie 6.0; windows nt 7.0) xspider 7
aspiegelbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /*Basket.aspx |
| Disallow | /*Checkout.aspx |
| Disallow | /*Login.aspx |
| Disallow | /*checkout |
| Disallow | /*login |
| Disallow | /*basket |
| Disallow | /*?*filter=* |
| Disallow | /*?*donotindex=* |
| Disallow | /*?*sortorder=* |
| Disallow | /*?*listing_pagesize=* |
| Disallow | /students |
| Disallow | /*?*searchterm=* |
| Disallow | /*?*expand=* |
| Disallow | /leeds-only* |
| Disallow | */college-kits* |
| Disallow | /*?*productlist_add=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.capitalhairandbeauty.co.uk/sitemap_index.xml |
Comments