artprice.com
robots.txt

Robots Exclusion Standard data for artprice.com

Resource Scan

Scan Details

Site Domain artprice.com
Base Domain artprice.com
Scan Status Ok
Last Scan2026-01-17T13:39:24+00:00
Next Scan 2026-02-16T13:39:24+00:00

Last Scan

Scanned2026-01-17T13:39:24+00:00
URL https://artprice.com/robots.txt
Redirect https://www.artprice.com/robots.txt
Redirect Domain www.artprice.com
Redirect Base artprice.com
Domain IPs 185.14.183.52
Redirect IPs 185.14.183.52
Response IP 185.14.183.52
Found Yes
Hash 6300d2ee8fb39d2406526a6ec79d32ed411fe76a45b4cbf1bf72996ecf47f695
SimHash 013ae90106b0

Groups

amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
friendlycrawler
google-extended
googleother
googleother-image
googleother-video
gptbot
imagesiftbot
img2dataset
omgili
omgilibot
perplexitybot
youbot

Rule Path
Disallow /

sogou*

Rule Path
Disallow /

googlebot
googlebot-news
googlebot-image
googleassociationservice

Rule Path
Allow /

*

Rule Path
Disallow /store2/
Allow /sitemap/news
Allow /sitemap/index_artists
Allow /sitemap/index_classifieds
Allow /sitemap/index_stores
Allow /sitemap/index_indexes
Allow /sitemap/index_biographies

Other Records

Field Value
sitemap https://www.artprice.com/sitemap/news
sitemap https://www.artprice.com/sitemap/index_artists
sitemap https://www.artprice.com/sitemap/index_classifieds
sitemap https://www.artprice.com/sitemap/index_stores
sitemap https://www.artprice.com/sitemap/index_indexes
sitemap https://www.artprice.com/sitemap/index_biographies

Comments

  • BLOCK AI/Scrapers (keep)
  • BLOCK Chinese scrapers
  • ALLOW Google News & Search (CRITICAL)
  • General rules
  • Sitemap directives (PLAIN URLs - NO Markdown)