shp.org.uk
robots.txt

Robots Exclusion Standard data for shp.org.uk

Resource Scan

Scan Details

Site Domain shp.org.uk
Base Domain shp.org.uk
Scan Status Ok
Last Scan2024-08-27T00:46:21+00:00
Next Scan 2024-09-26T00:46:21+00:00

Last Scan

Scanned2024-08-27T00:46:21+00:00
URL https://shp.org.uk/robots.txt
Redirect https://www.shp.org.uk/robots.txt
Redirect Domain www.shp.org.uk
Redirect Base shp.org.uk
Domain IPs 3.64.41.23
Redirect IPs 104.17.92.94, 104.17.93.94, 104.17.94.94, 104.17.95.94, 104.17.96.94, 2606:4700::6811:5c5e, 2606:4700::6811:5d5e, 2606:4700::6811:5e5e, 2606:4700::6811:5f5e, 2606:4700::6811:605e
Response IP 104.17.93.94
Found Yes
Hash f8f65b56106b6750290848b6263e857e8519637920c1078b5c4ce9c9464489d4
SimHash c040f050c4f3

Groups

*

Rule Path
Disallow /payments/donate

*

Rule Path
Disallow /getimage.aspx
Disallow /images/*/cropped
Disallow /pages/postcounter.aspx
Disallow /pages/search.aspx
Disallow /Pages/Search.aspx
Disallow /services/
Disallow /Services/
Disallow /Pages/DisplayNot.aspx
Disallow /lobby/
Disallow /Lobby/
Disallow /handlers/
Disallow /Handlers/
Disallow /Handlers/Download.ashx
Disallow /login
Disallow /Login
Disallow /pages/payment/complete.aspx
Disallow /BaseUI/v2_4/Handlers/

dotbot

Rule Path
Disallow /

twitterbot
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebot

Rule Path
Allow /handlers/getimage.ashx
Allow /Handlers/GetImage.ashx?IDMF=577862e3-2e39-4ac8-a8c2-0fade9f4c6de&w=32&h=23

Other Records

Field Value
sitemap https://www.shp.org.uk/sitemap.xml