officemonster.co.uk
robots.txt
Robots Exclusion Standard data for officemonster.co.uk
Resource Scan
Scan Details
Site Domain | officemonster.co.uk |
Base Domain | officemonster.co.uk |
Scan Status | Ok |
Last Scan | 2024-06-04T23:07:25+00:00 |
Next Scan | 2024-07-04T23:07:25+00:00 |
Last Scan
Scanned | 2024-06-04T23:07:25+00:00 |
URL | https://officemonster.co.uk/robots.txt |
Redirect | https://www.officemonster.co.uk/robots.txt |
Redirect Domain | www.officemonster.co.uk |
Redirect Base | officemonster.co.uk |
Domain IPs | 18.155.202.108, 18.155.202.48, 18.155.202.8, 18.155.202.98 |
Redirect IPs | 18.155.202.108, 18.155.202.48, 18.155.202.8, 18.155.202.98 |
Response IP | 18.165.171.58 |
Found | Yes |
Hash | 14603b7f44ef3e479c23fb0a538a1faf17b636b384f5d9b22adbc82585410c8c |
SimHash | 67d55238fe32 |
Groups
adsbot-google
Rule | Path |
---|---|
Disallow | /root$ |
Disallow | /password-reset$ |
Disallow | /cart$ |
Disallow | /checkout$ |
Disallow | /checkout/ |
Disallow | /register$ |
*
Rule | Path |
---|---|
Disallow | /root$ |
Disallow | /password-reset$ |
Disallow | /cart$ |
Disallow | /checkout$ |
Disallow | /checkout/ |
Disallow | /register$ |
Disallow | /cart |
Disallow | /login |
Disallow | /register/ |
Disallow | /myaccount |
Disallow | /customer/rewards |
Disallow | /customer/user/ |
Disallow | /customer/orders |
Disallow | /customer/quotes |
Disallow | /customer/savedbaskets |
Disallow | /customer/addresses |
Disallow | /customer/payment-methods |
Disallow | /customer/quicklists |
Disallow | /checkout |
Disallow | /thanks |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.officemonster.co.uk/sitemap.xml |