theconstructionindex.co.uk
robots.txt
Robots Exclusion Standard data for theconstructionindex.co.uk
Resource Scan
Scan Details
| Site Domain | theconstructionindex.co.uk |
| Base Domain | theconstructionindex.co.uk |
| Scan Status | Ok |
| Last Scan | 2026-04-09T19:17:39+00:00 |
| Next Scan | 2026-04-16T19:17:39+00:00 |
Last Scan
| Scanned | 2026-04-09T19:17:39+00:00 |
| URL | https://theconstructionindex.co.uk/robots.txt |
| Redirect | https://www.theconstructionindex.co.uk/robots.txt |
| Redirect Domain | www.theconstructionindex.co.uk |
| Redirect Base | theconstructionindex.co.uk |
| Domain IPs | 5.134.10.228 |
| Redirect IPs | 5.134.10.228 |
| Response IP | 5.134.10.228 |
| Found | Yes |
| Hash | ad941834bde907ab54bc77587940f37cd2f1477580dfa7572ce7770d8d02fccb |
| SimHash | 018d0e41e857 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /redirect |
| Disallow | /construction-jobs/apply |
| Disallow | /admin |
| Disallow | /news-search |
| Disallow | /error-pages/404.php |
| Disallow | /error-pages/403.php |
| Disallow | /error-pages/50x.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.theconstructionindex.co.uk/sitemap.xml |
| sitemap | https://www.theconstructionindex.co.uk/sitemap.xml?switch=static |
| sitemap | https://www.theconstructionindex.co.uk/sitemaps/news.xml |
| sitemap | https://www.theconstructionindex.co.uk/sitemaps/digger.xml |
| sitemap | https://www.theconstructionindex.co.uk/videos_sitemap.xml |
Comments