events.sulekha.com
robots.txt

Robots Exclusion Standard data for events.sulekha.com

Resource Scan

Scan Details

Site Domain events.sulekha.com
Base Domain sulekha.com
Scan Status Ok
Last Scan2024-09-22T11:31:36+00:00
Next Scan 2024-10-22T11:31:36+00:00

Last Scan

Scanned2024-09-22T11:31:36+00:00
URL https://events.sulekha.com/robots.txt
Domain IPs 13.82.131.109
Response IP 13.82.131.109
Found Yes
Hash 9f51a78f54a10b0c331a6149920df1caac02f45e9c59cafde36450db6ea6ec11
SimHash 0155c7404481

Groups

googlebot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

alexabot

Rule Path
Allow /

applebot

Rule Path
Allow /

architextspider

Rule Path
Allow /

baiduspider

Rule Path
Allow /

bender

Rule Path
Allow /

bingbot

Rule Path
Allow /

birubot

Rule Path
Allow /

blogpulselive

Rule Path
Allow /

claritybot

Rule Path
Allow /

coccoc

Rule Path
Allow /

daumoa

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

fast

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

gulliver

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

iisbot

Rule Path
Allow /

jikespider

Rule Path
Allow /

lycos_spider_(t-rex)

Rule Path
Allow /

mail.ru_bot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

msnptc

Rule Path
Allow /

naverbot

Rule Path
Allow /

nutch

Rule Path
Allow /

quickobot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

scooter

Rule Path
Allow /

seznambot

Rule Path
Allow /

slurp

Rule Path
Allow /

stackrambler

Rule Path
Allow /

surveybot

Rule Path
Allow /

teoma

Rule Path
Allow /

twitterbot/1.0

Rule Path
Allow /

vscooter

Rule Path
Allow /

yandex

Rule Path
Allow /

yeti

Rule Path
Allow /

zyborg

Rule Path
Allow /

*

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /