Log In Sign Up

undraw.co
robots.txt

Robots Exclusion Standard data for undraw.co

Resource Scan

Scan Details

Site Domain undraw.co
Base Domain undraw.co
Scan Status Ok
Last Scan2025-10-25T08:25:08+00:00
Next Scan 2025-11-24T08:25:08+00:00

Last Scan

Scanned2025-10-25T08:25:08+00:00
URL https://undraw.co/robots.txt
Domain IPs 104.21.48.239, 172.67.157.1, 2606:4700:3031::ac43:9d01, 2606:4700:3033::6815:30ef
Response IP 104.21.48.239
Found Yes
Hash a3c64bd3e516bbcf7f135dec2739191557272fde9d904f5768b68e37009610a6
SimHash 682c3904c663

Groups

*

Rule Path
Allow /
Allow /search
Allow /illustrations
Allow /illustrations/*
Allow /blog
Allow /illustration/*
Allow /blog/*
Disallow /api/
Disallow /download/*
Disallow /login
Disallow /signup
Disallow /dashboard
Disallow /admin
Disallow /*.json$
Disallow /*?*

gptbot

Rule Path
Disallow /illustrations/*/svg
Disallow /download/*
Disallow /*.svg$
Allow /

chatgpt-user

Rule Path
Disallow /illustrations/*/svg
Disallow /download/*
Disallow /*.svg$
Allow /

google-extended

Rule Path
Disallow /illustrations/*/svg
Disallow /download/*
Disallow /*.svg$
Allow /

anthropic-ai

Rule Path
Disallow /illustrations/*/svg
Disallow /download/*
Disallow /*.svg$
Allow /
Back to top

Other Records

Field Value
sitemap https://undraw.co/sitemap.xml
Back to top

Comments

  • Prevent crawling of special pages
  • AI Training Protection - only for artwork
  • Point to your sitemap
Back to top