progressivelets.co.uk
robots.txt

Robots Exclusion Standard data for progressivelets.co.uk

Resource Scan

Scan Details

Site Domain progressivelets.co.uk
Base Domain progressivelets.co.uk
Scan Status Ok
Last Scan2025-10-11T00:45:29+00:00
Next Scan 2025-11-10T00:45:29+00:00

Last Scan

Scanned2025-10-11T00:45:29+00:00
URL https://progressivelets.co.uk/robots.txt
Domain IPs 185.151.30.164
Response IP 185.151.30.164
Found Yes
Hash a751a8cdad5286a9023db004b751b56e79156124badceaa0720d6e67cc91c31e
SimHash 6bb959518df3

Groups

oai-searchbot
chatgpt-user
perplexitybot
firecrawlagent
andibot
exabot
phindbot
youbot

Rule Path
Allow /

gptbot
ccbot
google-extended

Rule Path
Disallow /

googlebot
bingbot

Rule Path
Allow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://progressivelets.co.uk/sitemap_index.xml