speechandlanguage.org.uk
robots.txt

Robots Exclusion Standard data for speechandlanguage.org.uk

Resource Scan

Scan Details

Site Domain speechandlanguage.org.uk
Base Domain speechandlanguage.org.uk
Scan Status Ok
Last Scan2025-11-15T13:53:02+00:00
Next Scan 2025-12-15T13:53:02+00:00

Last Scan

Scanned2025-11-15T13:53:02+00:00
URL https://speechandlanguage.org.uk/robots.txt
Domain IPs 104.21.21.10, 172.67.195.168, 2606:4700:3034::6815:150a, 2606:4700:3037::ac43:c3a8
Response IP 172.67.195.168
Found Yes
Hash 7b5ef73c5a44d93cb23d3bd0c64d7e2a4274a59a8ee4d604c22ab8e5a9445fa1
SimHash 4a68d8c08780

Groups

amazonbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

sebot-wa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://speechandlanguage.org.uk/wp-sitemap.xml

Comments

  • Block aggressive AI crawlers

Warnings

  • 1 invalid line.