royalacademy.org.uk
robots.txt

Robots Exclusion Standard data for royalacademy.org.uk

Resource Scan

Scan Details

Site Domain royalacademy.org.uk
Base Domain royalacademy.org.uk
Scan Status Ok
Last Scan2025-10-06T05:46:08+00:00
Next Scan 2025-11-05T05:46:08+00:00

Last Scan

Scanned2025-10-06T05:46:08+00:00
URL https://royalacademy.org.uk/robots.txt
Redirect https://www.royalacademy.org.uk:443/robots.txt
Redirect Domain www.royalacademy.org.uk
Redirect Base royalacademy.org.uk
Domain IPs 104.26.14.100, 104.26.15.100, 172.67.70.156, 2606:4700:20::681a:e64, 2606:4700:20::681a:f64, 2606:4700:20::ac43:469c
Redirect IPs 104.26.14.100, 104.26.15.100, 172.67.70.156, 2606:4700:20::681a:e64, 2606:4700:20::681a:f64, 2606:4700:20::ac43:469c
Response IP 172.67.70.156
Found Yes
Hash e9a8dd98b04716121bb0baf3c86c732a1932ef25e9b51f58bd47d88050cebc2b
SimHash 501c4d42c302

Groups

*

Rule Path
Disallow */search/
Disallow /search/
Disallow */search?
Disallow /search?
Disallow /search-results
Disallow /file/
Disallow /api/

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sitemap.royalacademy.org.uk/sitemap.xml