dclickweb.co.uk
robots.txt
Robots Exclusion Standard data for dclickweb.co.uk
Resource Scan
Scan Details
| Site Domain | dclickweb.co.uk |
| Base Domain | dclickweb.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-08T12:44:40+00:00 |
| Next Scan | 2025-11-15T12:44:40+00:00 |
Last Successful Scan
| Scanned | 2025-10-07T17:37:59+00:00 |
| URL | https://dclickweb.co.uk/robots.txt |
| Domain IPs | 2a02:4780:16:5488:e166:2e29:73fb:aa7, 2a02:4780:39:daf8:9066:b9a8:102:b1f7, 84.32.84.114, 84.32.84.213 |
| Response IP | 77.37.115.96 |
| Found | Yes |
| Hash | 52179adedd227c537304d2098f12d8c31af099ef901e0649a69b832c6dd13d74 |
| SimHash | 6119d9cc6092 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /linkout/ |
| Disallow | /recommended/ |
| Disallow | /comments/feed/ |
| Disallow | /trackback/ |
| Disallow | /index.php |
| Disallow | /xmlrpc.php |
| Disallow | /?s= |
| Disallow | /search/ |
| Disallow | /readme.html |
| Disallow | /refer/ |
| Disallow | /blog/page/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dclickweb.co.uk/sitemap_index.xml |
| sitemap | https://dclickweb.co.uk/post-sitemap.xml |
| sitemap | https://dclickweb.co.uk/page-sitemap.xml |