avaproject.org.uk
robots.txt

Robots Exclusion Standard data for avaproject.org.uk

Resource Scan

Scan Details

Site Domain avaproject.org.uk
Base Domain avaproject.org.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-11T14:43:54+00:00
Next Scan 2025-11-10T14:43:54+00:00

Last Successful Scan

Scanned2025-06-20T08:17:30+00:00
URL https://avaproject.org.uk/robots.txt
Domain IPs 104.21.11.177, 172.67.149.209, 2606:4700:3031::6815:bb1, 2606:4700:3035::ac43:95d1
Response IP 172.67.149.209
Found Yes
Hash f9a8ec685a2ac476a540ad4f9cf7e1751dbd231d48ee9666642acebffe2993eb
SimHash 6848c800c513

Groups

*

Rule Path
Disallow
Disallow /visit/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://avaproject.org.uk/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK