domainforsale.uk
robots.txt

Robots Exclusion Standard data for domainforsale.uk

Resource Scan

Scan Details

Site Domain domainforsale.uk
Base Domain domainforsale.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-25T00:23:16+00:00
Next Scan 2024-11-24T00:23:16+00:00

Last Successful Scan

Scanned2024-09-03T00:14:16+00:00
URL https://domainforsale.uk/robots.txt
Domain IPs 162.159.136.54, 162.159.137.54
Response IP 162.159.137.54
Found Yes
Hash 5fb566ba80a6fe414c839e2f59d956edbc4db3849ab82f2a5144e4c80d6ac913
SimHash 62188e006a33

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

linkdex

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

thumbnails

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.domainforsale.uk/sitemap.xml