visitchurches.org.uk
robots.txt

Robots Exclusion Standard data for visitchurches.org.uk

Resource Scan

Scan Details

Site Domain visitchurches.org.uk
Base Domain visitchurches.org.uk
Scan Status Ok
Last Scan2024-06-27T06:42:08+00:00
Next Scan 2024-07-11T06:42:08+00:00

Last Scan

Scanned2024-06-27T06:42:08+00:00
URL https://visitchurches.org.uk/robots.txt
Domain IPs 104.21.76.219, 172.67.201.119, 2606:4700:3033::ac43:c977, 2606:4700:3034::6815:4cdb
Response IP 104.21.76.219
Found Yes
Hash 8e32c08c219e28bfa0a0b06ebe618cb80f07c7b1727e5f1d3e631108ede89a1f
SimHash 014297c14335

Groups

*

Rule Path
Disallow */asset/*
Disallow */login/*
Disallow */edit-profile/*
Disallow */registration/*
Disallow */renew-my-subscription/*
Disallow */resourceLibrary/*
Disallow *?utm_campaign*

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap http://www.visitchurches.org.uk/sitemap.xml

Comments

  • robots.txt for http://www.visitchurches.org.uk/