lily-mosaics.co.uk
robots.txt

Robots Exclusion Standard data for lily-mosaics.co.uk

Resource Scan

Scan Details

Site Domain lily-mosaics.co.uk
Base Domain lily-mosaics.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-17T23:37:45+00:00
Next Scan 2026-01-15T23:37:45+00:00

Last Successful Scan

Scanned2024-06-02T14:17:07+00:00
URL http://lily-mosaics.co.uk/robots.txt
Redirect http://www.lily-mosaics.co.uk/robots.txt
Redirect Domain www.lily-mosaics.co.uk
Redirect Base lily-mosaics.co.uk
Domain IPs 199.34.228.43
Redirect IPs 199.34.228.43
Response IP 199.34.228.43
Found Yes
Hash cd7e78c9fc360849604f340207649b943394fdb916f19463cce1b10a8493f9bb
SimHash 6b54dc542793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/

Other Records

Field Value
sitemap http://www.lily-mosaics.co.uk/sitemap.xml