Log In Sign Up

clipartflare.com
robots.txt

Robots Exclusion Standard data for clipartflare.com

Resource Scan

Scan Details

Site Domain clipartflare.com
Base Domain clipartflare.com
Scan Status Ok
Last Scan2024-10-06T22:18:11+00:00
Next Scan 2024-10-07T22:18:11+00:00

Last Scan

Scanned2024-10-06T22:18:11+00:00
URL https://clipartflare.com/robots.txt
Domain IPs 104.21.80.218, 172.67.187.71, 2606:4700:3030::ac43:bb47, 2606:4700:3034::6815:50da
Response IP 104.21.80.218
Found Yes
Hash 208b99b1827df9397cd465fea8fde740bea3e226a0c105da17fd714cb2548df2
SimHash 811547707c5a

Groups

baiduspider
yisouspider
petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://clipartflare.com/cmmap.xml
Back to top

Warnings

  • 1 invalid line.
Back to top