childbereavementuk.org
robots.txt

Robots Exclusion Standard data for childbereavementuk.org

Resource Scan

Scan Details

Site Domain childbereavementuk.org
Base Domain childbereavementuk.org
Scan Status Ok
Last Scan2024-05-22T09:35:17+00:00
Next Scan 2024-06-21T09:35:17+00:00

Last Scan

Scanned2024-05-22T09:35:17+00:00
URL https://childbereavementuk.org/robots.txt
Redirect https://www.childbereavementuk.org/robots.txt
Redirect Domain www.childbereavementuk.org
Redirect Base childbereavementuk.org
Domain IPs 18.194.96.163
Redirect IPs 104.17.92.94, 104.17.93.94, 104.17.94.94, 104.17.95.94, 104.17.96.94, 2606:4700::6811:5c5e, 2606:4700::6811:5d5e, 2606:4700::6811:5e5e, 2606:4700::6811:5f5e, 2606:4700::6811:605e
Response IP 104.17.94.94
Found Yes
Hash 477eca3f07743c56efbd5effcc1e4ae0cc4f810b3c1cfb101e296c1c3d25418c
SimHash d2109050c4f3

Groups

*

Rule Path
Disallow /payments/donate

*

Rule Path
Disallow /getimage.aspx
Disallow /images/*/cropped
Disallow /pages/postcounter.aspx
Disallow /pages/search.aspx
Disallow /Pages/Search.aspx
Disallow /services/
Disallow /Services/
Disallow /Pages/DisplayNot.aspx
Disallow /lobby/
Disallow /Lobby/
Disallow /handlers/
Disallow /Handlers/
Disallow /Handlers/Download.ashx
Disallow /login
Disallow /Login
Disallow /pages/payment/complete.aspx
Disallow /BaseUI/v2_4/Handlers/
Disallow /pages/category/advisors

dotbot

Rule Path
Disallow /

twitterbot
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebot

Rule Path
Allow /handlers/getimage.ashx

Other Records

Field Value
sitemap https://www.childbereavementuk.org/sitemap.xml