clipartkey.com
robots.txt

Robots Exclusion Standard data for clipartkey.com

Resource Scan

Scan Details

Site Domain clipartkey.com
Base Domain clipartkey.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-05T04:18:40+00:00
Next Scan 2024-10-19T04:18:40+00:00

Last Successful Scan

Scanned2024-09-20T04:00:59+00:00
URL https://clipartkey.com/robots.txt
Redirect https://www.clipartkey.com/robots.txt
Redirect Domain www.clipartkey.com
Redirect Base clipartkey.com
Domain IPs 66.29.155.206
Redirect IPs 66.29.155.206
Response IP 66.29.155.206
Found Yes
Hash a1668dc36a1dc751c94a4bc00621f5423522bcc311679e2a4979dffd442f225f
SimHash 8015c7f07c12

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

*

Rule Path
Disallow /search.html?*
Allow /

mediapartners-google

Rule Path
Disallow