Log In Sign Up

2012olympicsblog.co.uk
robots.txt

Robots Exclusion Standard data for 2012olympicsblog.co.uk

Resource Scan

Scan Details

Site Domain 2012olympicsblog.co.uk
Base Domain 2012olympicsblog.co.uk
Scan Status Ok
Last Scan2024-05-26T14:18:45+00:00
Next Scan 2024-06-25T14:18:45+00:00

Last Scan

Scanned2024-05-26T14:18:45+00:00
URL http://2012olympicsblog.co.uk/robots.txt
Domain IPs 138.68.116.54
Response IP 138.68.116.54
Found Yes
Hash 7b769c7778cf1343378c6c07b0bb43656f85dbd32fb00babe70b14e0fcdb8c76
SimHash f05ed9403015

Groups

mj12bot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

anthropicbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /
Back to top