malverntrail.co.uk
robots.txt

Robots Exclusion Standard data for malverntrail.co.uk

Resource Scan

Scan Details

Site Domain malverntrail.co.uk
Base Domain malverntrail.co.uk
Scan Status Ok
Last Scan2025-11-28T05:46:21+00:00
Next Scan 2025-12-05T05:46:21+00:00

Last Scan

Scanned2025-11-28T05:46:21+00:00
URL https://malverntrail.co.uk/robots.txt
Redirect https://www.malverntrail.co.uk/robots.txt
Redirect Domain www.malverntrail.co.uk
Redirect Base malverntrail.co.uk
Domain IPs 185.194.90.16
Redirect IPs 185.194.90.16
Response IP 185.194.90.16
Found Yes
Hash fa36ef78118a506da0e91bee16b591f8e3ee442f705c897f08fbbb6ed6b0105f
SimHash 78757436c413

Groups

*

Rule Path
Disallow /beano/
Disallow /mt/
Disallow /wp/wp-admin/
Disallow /wp/xmlrpc.php
Disallow /wp/wp-*.php
Disallow /wp/*/trackback/
Disallow /wp/*?wptheme=
Disallow /wp/*?comments=
Disallow /wp/*?replytocom
Disallow /wp/*comment-page-
Disallow /wp/*?s=
Disallow /wp/?p=
Allow /wp/wp-includes/js/
Allow /wp/wp-includes/css/
Disallow /wp/wp-includes/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.malverntrail.co.uk/wp/sitemap.xml