coludata.co.uk
robots.txt

Robots Exclusion Standard data for coludata.co.uk

Resource Scan

Scan Details

Site Domain coludata.co.uk
Base Domain coludata.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-22T07:12:55+00:00
Next Scan 2025-09-05T07:12:55+00:00

Last Successful Scan

Scanned2025-07-15T04:05:21+00:00
URL https://coludata.co.uk/robots.txt
Redirect https://www.coludata.co.uk/robots.txt
Redirect Domain www.coludata.co.uk
Redirect Base coludata.co.uk
Domain IPs 185.151.30.148, 2a07:7800::148
Redirect IPs 185.151.30.148, 2a07:7800::148
Response IP 185.151.30.148
Found Yes
Hash 65a4fb3e642e06c31a05c9ce289f2dc2d1690444ac03f24671ede46293223761
SimHash 6042d0175490

Groups

googlebot

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

bingbot

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

teoma

Product Comment
teoma (Ask/Teoma)
Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

ia_archiver

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

tweetmemebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow
Allow /img/

*

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

webalta crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

Comments

  • robots.txt originally generated at http://www.mcanerin.com
  • These are not needed but keep for reference