Log In Sign Up

mattandcat.co.uk
robots.txt

Robots Exclusion Standard data for mattandcat.co.uk

Resource Scan

Scan Details

Site Domain mattandcat.co.uk
Base Domain mattandcat.co.uk
Scan Status Ok
Last Scan2025-10-08T22:53:53+00:00
Next Scan 2025-10-15T22:53:53+00:00

Last Scan

Scanned2025-10-08T22:53:53+00:00
URL https://mattandcat.co.uk/robots.txt
Domain IPs 104.21.85.213, 172.67.211.104, 2606:4700:3035::6815:55d5, 2606:4700:3035::ac43:d368
Response IP 172.67.211.104
Found Yes
Hash c83ee01f296ea51e7f71fcae07561beae193662ccf2f967a9c8a8dd27039399b
SimHash 78189902e9e2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

amazonbot
applebot-extended
ccbot
claudebot
gptbot
google-extended
googleother
meta-externalagent
facebookbot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
barkrowler
dataforseobot
dotbot
rogerbot
semrushbot
siteauditbot
semrushbot-ba

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://mattandcat.co.uk/sitemap.xml
Back to top