sindhishongkong.com
robots.txt

Robots Exclusion Standard data for sindhishongkong.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	sindhishongkong.com
Base Domain	sindhishongkong.com
Scan Status	Ok
Last Scan	6/17/2025, 7:43:36 AM
Next Scan	6/24/2025, 7:43:36 AM

Last Scan

Scanned	6/17/2025, 7:43:36 AM
URL	https://sindhishongkong.com/robots.txt
Domain IPs	188.166.226.62
Response IP	188.166.226.62
Found	Yes
Hash	5c8e0859a7fccde32b1744b10938ba5572e31e95949862e830eb63817ffa2549
SimHash	1136f5f0ea80

Groups

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ba

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-seoab

Rule	Path
Disallow	/

Rule

Path

Disallow

adidxbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

twengabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

wotbox

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

zumbot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot-web

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

criteobot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

piplbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou inst spider

Rule	Path
Disallow	/

Rule

Path

Disallow

seekportbot

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/showreplies.inc.php
Disallow	/mgtwebsite/suggestion.inc.php
Allow	/

Rule

Path

Disallow

/showreplies.inc.php

Disallow

/mgtwebsite/suggestion.inc.php

Allow

Other Records

Field	Value
crawl-delay	60

Field

Value

crawl-delay

Warnings

4 invalid lines.

sindhishongkong.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

petalbot

baiduspider

yandexbot

exabot

blexbot

ccbot

semrushbot-sa

semrushbot-ba

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

semrushbot-seoab

adidxbot

mj12bot

twengabot

ahrefsbot

semrushbot

wotbox

sosospider

seznambot

zumbot

coccocbot-web

dotbot

criteobot/0.1

amazonbot

gptbot

serpstatbot

piplbot

anthropic-ai

claude-web

dataforseobot

proximic

yisouspider

bytespider

sogou web spider

sogou inst spider

seekportbot

barkrowler

meta-externalagent

*

Other Records

Warnings

sindhishongkong.com
robots.txt