sindhirasoi.com
robots.txt

Robots Exclusion Standard data for sindhirasoi.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	sindhirasoi.com
Base Domain	sindhirasoi.com
Scan Status	Ok
Last Scan	2026-02-04T21:33:41+00:00
Next Scan	2026-02-11T21:33:41+00:00

Last Scan

Scanned	2026-02-04T21:33:41+00:00
URL	https://sindhirasoi.com/robots.txt
Domain IPs	64.227.163.106
Response IP	64.227.163.106
Found	Yes
Hash	e3754dac4e21cf393d5eb897e87449922a2e91cc3a6529112d1058ddbde5ded8
SimHash	913ad550e888

Groups

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-seoab

Rule	Path
Disallow	/

Rule

Path

Disallow

adidxbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

twengabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

wotbox

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

zumbot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot-web

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

criteobot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

piplbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou inst spider

Rule	Path
Disallow	/

Rule

Path

Disallow

seekportbot

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

grapeshot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/
Allow	/

Rule

Path

Disallow

Allow

Other Records

Field	Value
crawl-delay	60

Field

Value

crawl-delay

Warnings

4 invalid lines.

sindhirasoi.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

petalbot

baiduspider

yandexbot

exabot

blexbot

ccbot

semrushbot-sa

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

semrushbot-seoab

adidxbot

mj12bot

twengabot

ahrefsbot

semrushbot

wotbox

sosospider

seznambot

zumbot

coccocbot-web

dotbot

criteobot/0.1

amazonbot

gptbot

serpstatbot

piplbot

anthropic-ai

claude-web

dataforseobot

proximic

yisouspider

bytespider

sogou web spider

sogou inst spider

seekportbot

barkrowler

meta-externalagent

grapeshot

imagesiftbot

Other Records

Warnings

sindhirasoi.com
robots.txt