sindhikalakar.com
robots.txt

Robots Exclusion Standard data for sindhikalakar.com

Resource Scan

Scan Details

Site Domain sindhikalakar.com
Base Domain sindhikalakar.com
Scan Status Ok
Last Scan5/26/2025, 1:14:07 AM
Next Scan 6/25/2025, 1:14:07 AM

Last Scan

Scanned5/26/2025, 1:14:07 AM
URL https://sindhikalakar.com/robots.txt
Domain IPs 188.166.226.62
Response IP 188.166.226.62
Found Yes
Hash 3a51fafe04cc1e46e64fff8adac9e615b4c6b0658114e0359a3e9d9a958ab20b
SimHash 0ab8fdd0c890

Groups

petalbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

Warnings

  • 2 invalid lines.