rhs.org.uk
robots.txt

Robots Exclusion Standard data for rhs.org.uk

Resource Scan

Scan Details

Site Domain rhs.org.uk
Base Domain rhs.org.uk
Scan Status Ok
Last Scan2024-11-09T09:43:35+00:00
Next Scan 2024-11-16T09:43:35+00:00

Last Scan

Scanned2024-11-09T09:43:35+00:00
URL https://rhs.org.uk/robots.txt
Redirect https://www.rhs.org.uk/robots.txt
Redirect Domain www.rhs.org.uk
Redirect Base rhs.org.uk
Domain IPs 104.18.8.251, 104.18.9.251, 2606:4700::6812:8fb, 2606:4700::6812:9fb
Redirect IPs 104.18.8.251, 104.18.9.251, 2606:4700::6812:8fb, 2606:4700::6812:9fb
Response IP 104.18.8.251
Found Yes
Hash 7cd9aedaf0b09a9061203f1bf8878f5962c018c443ec9cef1e306a9517af02d4
SimHash 5904f8f4caa6

Groups

*

Rule Path
Disallow /*.doc$
Disallow /*.docx$
Disallow /*undefined$
Disallow /*thank-you$
Disallow /api/

zoominfobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.rhs.org.uk/sitemap_index.xml
sitemap https://www.rhs.org.uk/sitemap-general.xml
sitemap https://www.rhs.org.uk/sitemap-plants-1.xml
sitemap https://www.rhs.org.uk/sitemap-plants-2.xml
sitemap https://www.rhs.org.uk/sitemap-plants-3.xml
sitemap https://www.rhs.org.uk/sitemap-plants-4.xml
sitemap https://www.rhs.org.uk/sitemap-plants-5.xml
sitemap https://www.rhs.org.uk/sitemap-plants-6.xml
sitemap https://www.rhs.org.uk/sitemap-plants-7.xml
sitemap https://www.rhs.org.uk/sitemap-events.xml