mdx.ac.uk
robots.txt

Robots Exclusion Standard data for mdx.ac.uk

Resource Scan

Scan Details

Site Domain mdx.ac.uk
Base Domain mdx.ac.uk
Scan Status Ok
Last Scan2024-06-20T12:47:25+00:00
Next Scan 2024-07-20T12:47:25+00:00

Last Scan

Scanned2024-06-20T12:47:25+00:00
URL https://mdx.ac.uk/robots.txt
Redirect https://www.mdx.ac.uk/robots.txt
Redirect Domain www.mdx.ac.uk
Redirect Base mdx.ac.uk
Domain IPs 35.71.145.196, 52.223.41.154
Redirect IPs 13.33.88.47, 13.33.88.68, 13.33.88.82, 13.33.88.94, 2600:9000:223b:0:18:309f:6100:93a1, 2600:9000:223b:1800:18:309f:6100:93a1, 2600:9000:223b:4c00:18:309f:6100:93a1, 2600:9000:223b:600:18:309f:6100:93a1, 2600:9000:223b:7200:18:309f:6100:93a1, 2600:9000:223b:8e00:18:309f:6100:93a1, 2600:9000:223b:a200:18:309f:6100:93a1, 2600:9000:223b:b600:18:309f:6100:93a1
Response IP 13.33.88.47
Found Yes
Hash 09714f90b2f0e5493762ed1b62248b470957b663eaf16fbb6f871724c768f3f0
SimHash a815d801e6f3

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

terminalfour-nutch-spider

Rule Path
Allow /

twitterbot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mdx.ac.uk/sitemap.xml