crystalroof.co.uk
robots.txt

Robots Exclusion Standard data for crystalroof.co.uk

Resource Scan

Scan Details

Site Domain crystalroof.co.uk
Base Domain crystalroof.co.uk
Scan Status Ok
Last Scan2024-09-24T03:05:18+00:00
Next Scan 2024-10-01T03:05:18+00:00

Last Scan

Scanned2024-09-24T03:05:18+00:00
URL https://crystalroof.co.uk/robots.txt
Domain IPs 13.33.30.109, 13.33.30.120, 13.33.30.24, 13.33.30.87, 2600:9000:229f:1800:0:65ba:3bc0:93a1, 2600:9000:229f:2000:0:65ba:3bc0:93a1, 2600:9000:229f:4400:0:65ba:3bc0:93a1, 2600:9000:229f:5600:0:65ba:3bc0:93a1, 2600:9000:229f:7000:0:65ba:3bc0:93a1, 2600:9000:229f:a200:0:65ba:3bc0:93a1, 2600:9000:229f:e600:0:65ba:3bc0:93a1, 2600:9000:229f:fa00:0:65ba:3bc0:93a1
Response IP 13.33.30.24
Found Yes
Hash b28404530c75bc04af314a8782a1b423d322cf47e494ed68d2686c99c7627a31
SimHash 20144c10c793

Groups

*

Rule Path
Disallow /customer-api/
Disallow /data-api/
Disallow /layers/

Other Records

Field Value
sitemap https://crystalroof.co.uk/sitemap.xml