mark-gilbert.co.uk
robots.txt

Robots Exclusion Standard data for mark-gilbert.co.uk

Resource Scan

Scan Details

Site Domain mark-gilbert.co.uk
Base Domain mark-gilbert.co.uk
Scan Status Ok
Last Scan2024-08-30T08:03:25+00:00
Next Scan 2024-09-29T08:03:25+00:00

Last Scan

Scanned2024-08-30T08:03:25+00:00
URL https://mark-gilbert.co.uk/robots.txt
Redirect https://www.mark-gilbert.co.uk/robots.txt
Redirect Domain www.mark-gilbert.co.uk
Redirect Base mark-gilbert.co.uk
Domain IPs 13.33.88.118, 13.33.88.51, 13.33.88.65, 13.33.88.83, 2600:9000:223b:2000:13:f07c:3400:93a1, 2600:9000:223b:3400:13:f07c:3400:93a1, 2600:9000:223b:3a00:13:f07c:3400:93a1, 2600:9000:223b:4800:13:f07c:3400:93a1, 2600:9000:223b:6200:13:f07c:3400:93a1, 2600:9000:223b:8400:13:f07c:3400:93a1, 2600:9000:223b:d200:13:f07c:3400:93a1, 2600:9000:223b:fa00:13:f07c:3400:93a1
Redirect IPs 13.33.28.11, 13.33.28.31, 13.33.28.43, 13.33.28.63, 2600:9000:229f:2800:1a:436a:3dc0:93a1, 2600:9000:229f:3e00:1a:436a:3dc0:93a1, 2600:9000:229f:6000:1a:436a:3dc0:93a1, 2600:9000:229f:6200:1a:436a:3dc0:93a1, 2600:9000:229f:7800:1a:436a:3dc0:93a1, 2600:9000:229f:c400:1a:436a:3dc0:93a1, 2600:9000:229f:d600:1a:436a:3dc0:93a1, 2600:9000:229f:e800:1a:436a:3dc0:93a1
Response IP 13.33.28.31
Found Yes
Hash 2a0e5626456e8493a89871bfadb9393142a8d303eacc1f1659f80ccd6e487296
SimHash 4b0148402c13

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.mark-gilbert.co.uk/sitemap.xml