Log In Sign Up

rugsdirect.co.uk
robots.txt

Robots Exclusion Standard data for rugsdirect.co.uk

Resource Scan

Scan Details

Site Domain rugsdirect.co.uk
Base Domain rugsdirect.co.uk
Scan Status Ok
Last Scan2024-06-01T19:06:16+00:00
Next Scan 2024-07-01T19:06:16+00:00

Last Scan

Scanned2024-06-01T19:06:16+00:00
URL https://rugsdirect.co.uk/robots.txt
Redirect https://www.rugsdirect.co.uk/robots.txt
Redirect Domain www.rugsdirect.co.uk
Redirect Base rugsdirect.co.uk
Domain IPs 104.26.0.77, 104.26.1.77, 172.67.71.58, 2606:4700:20::681a:14d, 2606:4700:20::681a:4d, 2606:4700:20::ac43:473a
Redirect IPs 104.26.0.77, 104.26.1.77, 172.67.71.58, 2606:4700:20::681a:14d, 2606:4700:20::681a:4d, 2606:4700:20::ac43:473a
Response IP 172.67.71.58
Found Yes
Hash ec1804ffa0ea9ca45920ec1bd0ac3033468ec9555fe13fc20dff5f4ab41cb13e
SimHash ee10d8058193

Groups

*

Rule Path
Disallow /search-results*
Disallow *SaleItem%26productId*
Back to top

Other Records

Field Value
sitemap https://www.rugsdirect.co.uk/sitemap.xml
Back to top