Log In Sign Up

arting.ai
robots.txt

Robots Exclusion Standard data for arting.ai

Resource Scan

Scan Details

Site Domain arting.ai
Base Domain arting.ai
Scan Status Ok
Last Scan2025-11-28T17:33:15+00:00
Next Scan 2025-12-28T17:33:15+00:00

Last Scan

Scanned2025-11-28T17:33:15+00:00
URL https://arting.ai/robots.txt
Domain IPs 104.21.9.13, 172.67.188.223, 2606:4700:3031::ac43:bcdf, 2606:4700:3034::6815:90d
Response IP 172.67.188.223
Found Yes
Hash b94ed612d2ea549a4c106ada42d9647594e9af1490e17a41ffd12c2d7ad53204
SimHash f50c190184b5

Groups

*

Rule Path
Disallow /admin
Allow /
Allow /llms.txt

adsbot-google
adsidxbot
google-inspectiontool
facebookexternalhit
perplexitybot
perplexity-user

Rule Path
Allow /

applebot-extended
gptbot
google-extended
bytespider
claudebot
ccbot
meta-externalagent
imagesiftbot
timpibot
scrapy
ai2bot
diffbot
img2dataset
icc-crawler
facebookbot
anthropic-ai
velenpublicwebcrawler
friendlycrawler
claude-web
omgili
webzio-extended
ai2bot-dolma

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://arting.ai/sitemap_index.xml
Back to top

Comments

  • START nuxt-robots (indexable)
  • LLM-Content: https://arting.ai/llms.txt
  • END nuxt-robots
Back to top