Log In Sign Up

kasetprice.com
robots.txt

Robots Exclusion Standard data for kasetprice.com

Resource Scan

Scan Details

Site Domain kasetprice.com
Base Domain kasetprice.com
Scan Status Ok
Last Scan2025-05-04T03:01:14+00:00
Next Scan 2025-05-11T03:01:14+00:00

Last Scan

Scanned2025-05-04T03:01:14+00:00
URL https://kasetprice.com/robots.txt
Domain IPs 52.76.201.66
Response IP 52.76.201.66
Found Yes
Hash df46fed57b14cff4186740ea7d06647283f86e126e126c2418b67858d8897808
SimHash 5216eb24c503

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

facebook external hit, facebook crawler

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yeti

Rule Path
Disallow /

advanced_crawler

Rule Path
Disallow /

alittle client

Rule Path
Disallow /

fake bot

Rule Path
Disallow /

headless chrome

Rule Path
Disallow /

monibot

Rule Path
Disallow /

netapi

Rule Path
Disallow /

mozilla

Rule Path
Disallow /
Back to top