artfinder.com
robots.txt

Robots Exclusion Standard data for artfinder.com

Resource Scan

Scan Details

Site Domain artfinder.com
Base Domain artfinder.com
Scan Status Ok
Last Scan2024-09-18T16:49:33+00:00
Next Scan 2024-10-18T16:49:33+00:00

Last Scan

Scanned2024-09-18T16:49:33+00:00
URL https://artfinder.com/robots.txt
Redirect https://www.artfinder.com/robots.txt
Redirect Domain www.artfinder.com
Redirect Base artfinder.com
Domain IPs 13.227.254.10, 13.227.254.112, 13.227.254.12, 13.227.254.69
Redirect IPs 13.33.88.110, 13.33.88.124, 13.33.88.40, 13.33.88.74
Response IP 13.33.88.40
Found Yes
Hash 2f34b4c0e040ef74312ca899e4266c24186371f316efa7706cbcd721fef3b1c8
SimHash 636d5001ccb4

Groups

*

Rule Path
Disallow /admin/
Disallow /currency/
Disallow /collections/api/
Disallow /flags/
Disallow /forms/
Disallow /locality/
Disallow /play/
Disallow /shuffle/
Disallow /messages/
Disallow /u/
Disallow /t/
Disallow /more-like-this/*
Disallow /api/*
Disallow /checkout/*
Disallow /basket/a/*
Disallow /country/
Disallow /login/*
Disallow /shipping/track/*
Disallow /invite/*

sogou spider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot[at]gmail[dot]com)

Rule Path
Disallow /

exabot

Rule Path
Disallow /

exaleadcloudview

Rule Path
Disallow /

psbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rollcrawl

Rule Path
Disallow /

cliqusbot

Rule Path
Disallow /

xintellibot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetedtimes bot/1.0; +http://tweetedtimes.com)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.artfinder.com/sitemap.xml

Comments

  • Sogou
  • Ezooms
  • Exalead
  • psbot