Log In Sign Up

eshakti.com
robots.txt

Robots Exclusion Standard data for eshakti.com

Resource Scan

Scan Details

Site Domain eshakti.com
Base Domain eshakti.com
Scan Status Ok
Last Scan2025-04-17T13:59:08+00:00
Next Scan 2025-04-24T13:59:08+00:00

Last Scan

Scanned2025-04-17T13:59:08+00:00
URL https://www.eshakti.com/robots.txt
Domain IPs 104.21.20.174, 172.67.193.67, 2606:4700:3031::6815:14ae, 2606:4700:3033::ac43:c143
Response IP 104.21.20.174
Found Yes
Hash e9a4e46de90e178b7f8cfda114e207f8cafb0ab1d28fc746b54a17894f3fb814
SimHash 2864c59143a5

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

slurp

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

bingbot

Rule Path
Disallow

msnbot

Rule Path
Disallow

swiftbot

Rule Path
Disallow /

teoma

Rule Path
Disallow

feedfetcher-google

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

psbot/0.1

Rule Path
Disallow /

twiceler www.cuill.com/robots.html

Rule Path
Disallow /

twiceler-0.9 http://www.cuill.com/twiceler/robot.html

Rule Path
Disallow /

dwaarbot+(dwaarbot@dwaar.com)

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

giga­mega.bot/1.0; +http://www.giga­mega.net/bot.html

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

speedy

Rule Path
Disallow /

iiitbot/1.1 (indian language web search engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in)

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow *

pinterestbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin

*

Rule Path
Disallow /
Back to top