barscaffolding.co.uk
robots.txt

Robots Exclusion Standard data for barscaffolding.co.uk

Resource Scan

Scan Details

Site Domain barscaffolding.co.uk
Base Domain barscaffolding.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-10T17:23:49+00:00
Next Scan 2026-01-08T17:23:49+00:00

Last Successful Scan

Scanned2025-02-20T16:10:24+00:00
URL https://barscaffolding.co.uk/robots.txt
Domain IPs 104.21.91.54, 172.67.167.79, 2606:4700:3036::ac43:a74f, 2606:4700:3037::6815:5b36
Response IP 104.21.91.54
Found Yes
Hash 76ccadaff746936d1278bdfb4ecbd462342cd1b620e2d2ab84de5a6ef5c0c500
SimHash 4f04dc460fd2

Groups

*

Rule Path
Disallow /dtdq/
Disallow /frame/
Disallow /wp-admin/
Disallow /members/
Disallow /category/
Disallow /author/
Disallow /frame/
Disallow /wp-login.php
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://barscaffolding.co.uk/sitemap.xml

Warnings

  • `host` is not a known field.