internetshoppingstore.co.uk
robots.txt
Robots Exclusion Standard data for internetshoppingstore.co.uk
Resource Scan
Scan Details
Site Domain | internetshoppingstore.co.uk |
Base Domain | internetshoppingstore.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-30T21:51:16+00:00 |
Next Scan | 2024-11-29T21:51:16+00:00 |
Last Successful Scan
Scanned | 2024-09-24T21:49:56+00:00 |
URL | http://internetshoppingstore.co.uk/robots.txt |
Redirect | https://www.woodenfurniture.co.uk/robots.txt |
Redirect Domain | www.woodenfurniture.co.uk |
Redirect Base | woodenfurniture.co.uk |
Domain IPs | 93.93.135.180 |
Redirect IPs | 93.93.135.180 |
Response IP | 93.93.135.180 |
Found | Yes |
Hash | ed4d3f01e9eebb2973a5885dcb2d9ac8df240937500eba7150a97e51c3ccb08f |
SimHash | 3a58454260a1 |
Groups
*
Rule | Path |
---|---|
Disallow | /summary.php |
Disallow | /search.php |
Disallow | /shop.php |
Disallow | /adv.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.woodenfurniture.co.uk/sitemap.xml |