barscaffolding.co.uk
robots.txt
            Robots Exclusion Standard data for barscaffolding.co.uk
Resource Scan
Scan Details
| Site Domain | barscaffolding.co.uk | 
| Base Domain | barscaffolding.co.uk | 
| Scan Status | Failed | 
| Failure Stage | Fetching resource. | 
| Failure Reason | Server returned a client error. | 
| Last Scan | 2025-10-10T17:23:49+00:00 | 
| Next Scan | 2026-01-08T17:23:49+00:00 | 
Last Successful Scan
| Scanned | 2025-02-20T16:10:24+00:00 | 
| URL | https://barscaffolding.co.uk/robots.txt | 
| Domain IPs | 104.21.91.54, 172.67.167.79, 2606:4700:3036::ac43:a74f, 2606:4700:3037::6815:5b36 | 
| Response IP | 104.21.91.54 | 
| Found | Yes | 
| Hash | 76ccadaff746936d1278bdfb4ecbd462342cd1b620e2d2ab84de5a6ef5c0c500 | 
| SimHash | 4f04dc460fd2 | 
Groups
*
          | Rule | Path | 
|---|---|
| Disallow | /dtdq/ | 
| Disallow | /frame/ | 
| Disallow | /wp-admin/ | 
| Disallow | /members/ | 
| Disallow | /category/ | 
| Disallow | /author/ | 
| Disallow | /frame/ | 
| Disallow | /wp-login.php | 
| Allow | /wp-admin/admin-ajax.php | 
Other Records
| Field | Value | 
|---|---|
| sitemap | http://barscaffolding.co.uk/sitemap.xml | 
Warnings
- `host` is not a known field.