wandersober.co.uk
robots.txt

Robots Exclusion Standard data for wandersober.co.uk

Resource Scan

Scan Details

Site Domain wandersober.co.uk
Base Domain wandersober.co.uk
Scan Status Ok
Last Scan2025-10-23T13:20:57+00:00
Next Scan 2025-11-22T13:20:57+00:00

Last Scan

Scanned2025-10-23T13:20:57+00:00
URL https://wandersober.co.uk/robots.txt
Domain IPs 194.1.147.40, 194.1.147.42
Response IP 194.1.147.42
Found Yes
Hash ee6ede861991f29a9f3a90144d7158d65655c5afd9e0c13a276b2a2b864e5b41
SimHash 1acc98428957

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /sitemap*.xml
Disallow /*/feed/
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

gptbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

google-extended

Rule Path
Allow /

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://wandersober.co.uk/sitemap_index.xml

Comments

  • This file is automatically added by Rank Math SEO plugin to help a website index better
  • More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP