Log In Sign Up

clipartlook.com
robots.txt

Robots Exclusion Standard data for clipartlook.com

Resource Scan

Scan Details

Site Domain clipartlook.com
Base Domain clipartlook.com
Scan Status Ok
Last Scan2024-09-25T08:25:23+00:00
Next Scan 2024-10-02T08:25:23+00:00

Last Scan

Scanned2024-09-25T08:25:23+00:00
URL https://clipartlook.com/robots.txt
Domain IPs 104.21.25.211, 172.67.134.175, 2606:4700:3031::ac43:86af, 2606:4700:3033::6815:19d3
Response IP 172.67.134.175
Found Yes
Hash a0bc65b14a5bc399e46b1b0681a5f781b785ce19d5fcb6f2cb35a12cadc2d97d
SimHash 8115c6707f31

Groups

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

hyscore

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

musobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify/bleriot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /
Back to top