agaradhitrends.in
robots.txt

Robots Exclusion Standard data for agaradhitrends.in

Resource Scan

Scan Details

Site Domain agaradhitrends.in
Base Domain agaradhitrends.in
Scan Status Ok
Last Scan2026-04-08T11:39:03+00:00
Next Scan 2026-05-08T11:39:03+00:00

Last Scan

Scanned2026-04-08T11:39:03+00:00
URL https://agaradhitrends.in/robots.txt
Domain IPs 2600:9000:26c0:1e00:9:9769:ac00:93a1, 2600:9000:26c0:200:9:9769:ac00:93a1, 2600:9000:26c0:7a00:9:9769:ac00:93a1, 2600:9000:26c0:a200:9:9769:ac00:93a1, 2600:9000:26c0:a400:9:9769:ac00:93a1, 2600:9000:26c0:b600:9:9769:ac00:93a1, 2600:9000:26c0:d600:9:9769:ac00:93a1, 2600:9000:26c0:f400:9:9769:ac00:93a1, 3.170.229.118, 3.170.229.21, 3.170.229.37, 3.170.229.74
Response IP 3.170.229.118
Found Yes
Hash 1fab8c072c798fe3e25c721d1bbc1532a6a7ccaaf40237b57e4acd685b026e49
SimHash 0c1b8b04c5e9

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

grok

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

*

Rule Path
Disallow /signup
Disallow /signup/
Disallow /login
Disallow /login/
Disallow /forgotpassword
Disallow /changepassword/
Disallow /edit-contact
Disallow /quickorderproduct
Disallow /account
Disallow /account/
Disallow /orderdetail/
Disallow /cart
Disallow /digitalproductcheckout
Disallow /checkout
Disallow /urlcheckout/
Disallow /subscription/
Disallow /giftcards
Disallow /giftcards/
Disallow /customersubscription/
Disallow /unsubscribe/
Disallow /order-placed
Disallow /status
Disallow /loyaltypoints
Disallow /loyaltypoints/
Disallow /*?categoryId=
Disallow /*?filter=
Disallow /*?ref=
Disallow /*?

Other Records

Field Value
sitemap https://agaradhitrends.in/sitemap.xml

Comments

  • Allow normal search engines (for SEO)
  • Block AI training crawlers (exactly like ChatGPT, Grok, Claude, Perplexity, etc.)
  • Disallow user-specific & sensitive pages
  • Disallow wildcard dynamic pages (if required)
  • Sitemap