sampleface.co.uk
robots.txt

Robots Exclusion Standard data for sampleface.co.uk

Resource Scan

Scan Details

Site Domain sampleface.co.uk
Base Domain sampleface.co.uk
Scan Status Ok
Last Scan2025-08-28T22:53:12+00:00
Next Scan 2025-09-04T22:53:12+00:00

Last Scan

Scanned2025-08-28T22:53:12+00:00
URL https://sampleface.co.uk/robots.txt
Domain IPs 2001:8d8:100f:f000::2f0, 217.160.0.185
Response IP 217.160.0.185
Found Yes
Hash 8a0200c23b2e4bf6a5280265dd9f916cc712d878dbb899a07b3ffd83151c86a4
SimHash 6000c8408113

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sampleface.co.uk/sitemap_index.xml