Log In Sign Up

artbylogic.com
robots.txt

Robots Exclusion Standard data for artbylogic.com

Resource Scan

Scan Details

Site Domain artbylogic.com
Base Domain artbylogic.com
Scan Status Ok
Last Scan2025-12-28T20:04:27+00:00
Next Scan 2026-01-04T20:04:27+00:00

Last Scan

Scanned2025-12-28T20:04:27+00:00
URL https://artbylogic.com/robots.txt
Redirect https://www.artbylogic.com/robots.txt
Redirect Domain www.artbylogic.com
Redirect Base artbylogic.com
Domain IPs 216.120.240.100
Redirect IPs 216.120.240.100
Response IP 216.120.240.100
Found Yes
Hash 0dcbef13edb875e6b4055ff60cb202400dcf865515a73e48be633f5666d5997b
SimHash 38831b03e0e2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /admin/

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.artbylogic.com/sitemap.xml
Back to top

Comments

  • To block SemrushBot from crawling your site for different SEO and technical issues:
  • To block SemrushBot from crawling your site for Backlink Audit tool:
  • To block SemrushBot from crawling your site for On Page SEO Checker tool and similar tools:
  • To block SemrushBot from checking URLs on your site for SWA tool:
  • To block SemrushBot from crawling your site for Content Analyzer and Post Tracking tools:
  • To block SemrushBot from crawling your site for Brand Monitoring:
  • To block SplitSignalBot from crawling your site for SplitSignal tool:
  • To block SemrushBot-COUB from crawling your site for Content Outline Builder tool:
Back to top