rememuseum.org.uk
robots.txt

Robots Exclusion Standard data for rememuseum.org.uk

Resource Scan

Scan Details

Site Domain rememuseum.org.uk
Base Domain rememuseum.org.uk
Scan Status Ok
Last Scan2025-11-13T23:05:12+00:00
Next Scan 2025-12-13T23:05:12+00:00

Last Scan

Scanned2025-11-13T23:05:12+00:00
URL https://www.rememuseum.org.uk/robots.txt
Domain IPs 104.17.92.94, 104.17.93.94, 104.17.94.94, 104.17.95.94, 104.17.96.94, 2606:4700::6811:5c5e, 2606:4700::6811:5d5e, 2606:4700::6811:5e5e, 2606:4700::6811:5f5e, 2606:4700::6811:605e
Response IP 104.17.93.94
Found Yes
Hash 4f889c7a34aa46c614017eac1c86e77314240527f34c0f7a5f686c93df9a61ed
SimHash c150b052c4f3

Groups

*

Rule Path
Disallow /payments/donate
Disallow /cookies/manager-policy

*

Rule Path
Disallow /getimage.aspx
Disallow /images/*/cropped
Disallow /pages/postcounter.aspx
Disallow /pages/search.aspx
Disallow /Pages/Search.aspx
Disallow /services/
Disallow /Services/
Disallow /Pages/DisplayNot.aspx
Disallow /lobby/
Disallow /Lobby/
Disallow /handlers/
Disallow /Handlers/
Disallow /Handlers/Download.ashx
Disallow /login
Disallow /Login
Disallow /pages/payment/complete.aspx
Disallow /BaseUI/v2_4/Handlers/

dotbot

Rule Path
Disallow /

twitterbot
facebookexternalhit
facebookexternalhit/1.1
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
facebot

Rule Path
Allow /handlers/getimage.ashx

Other Records

Field Value
sitemap https://www.rememuseum.org.uk/sitemap.xml