Log In Sign Up

1stkare.com
robots.txt

Robots Exclusion Standard data for 1stkare.com

Resource Scan

Scan Details

Site Domain 1stkare.com
Base Domain 1stkare.com
Scan Status Ok
Last Scan2025-08-29T02:46:23+00:00
Next Scan 2025-09-05T02:46:23+00:00

Last Scan

Scanned2025-08-29T02:46:23+00:00
URL https://1stkare.com/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash 858b2754c00a7a5a7180b079106497b6f01723387a2718343fbd794c565715d6
SimHash 5c3661d0ed32

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

openai

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

whatsapp

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

claude

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

chatsonic

Rule Path
Disallow /

writesonic

Rule Path
Disallow /

jasper

Rule Path
Disallow /

copy.ai

Rule Path
Disallow /

ai-bot

Rule Path
Disallow /

ai-crawler

Rule Path
Disallow /

llmbot

Rule Path
Disallow /

llm-bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

iask

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /_next/
Disallow /messages
Disallow /login
Disallow /sign-up
Disallow /city-chooser
Disallow /settings/
Disallow /post/edit/
Disallow /post/payment/
Allow /ads.txt
Back to top

Other Records

Field Value
sitemap https://1stkare.com/sitemap.xml
sitemap https://1stkare.com/sitemap-static.xml
sitemap https://1stkare.com/sitemap_seller.xml
Back to top

Comments

  • Allow USA search engines
  • Block non-USA search bots
  • Block AI training bots
  • General rules for all other user agents
  • Sitemaps
  • Explicitly allow ads.txt for AdSense
Back to top

Warnings

  • 2 invalid lines.
Back to top