localservices.sulekha.com
robots.txt

Robots Exclusion Standard data for localservices.sulekha.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	localservices.sulekha.com
Base Domain	sulekha.com
Scan Status	Ok
Last Scan	2024-05-25T16:40:18+00:00
Next Scan	2024-06-24T16:40:18+00:00

Last Scan

Scanned	2024-05-25T16:40:18+00:00
URL	https://localservices.sulekha.com/robots.txt
Domain IPs	168.62.50.249
Response IP	168.62.50.249
Found	Yes
Hash	03ebab6169150f5c664dfb69d480af780ab2610dff13a5c1d5c79d909902948e
SimHash	4155c7424681

Groups

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-google

Rule	Path
Allow	/

Rule

Path

Allow

alexabot

Rule	Path
Allow	/

Rule

Path

Allow

applebot

Rule	Path
Allow	/

Rule

Path

Allow

architextspider

Rule	Path
Allow	/

Rule

Path

Allow

baiduspider

Rule	Path
Allow	/

Rule

Path

Allow

bender

Rule	Path
Allow	/

Rule

Path

Allow

birubot

Rule	Path
Allow	/

Rule

Path

Allow

blogpulselive

Rule	Path
Allow	/

Rule

Path

Allow

claritybot

Rule	Path
Allow	/

Rule

Path

Allow

coccoc

Rule	Path
Allow	/

Rule

Path

Allow

daumoa

Rule	Path
Allow	/

Rule

Path

Allow

duckduckbot

Rule	Path
Allow	/

Rule

Path

Allow

fast

Rule	Path
Allow	/

Rule

Path

Allow

feedfetcher-google

Rule	Path
Allow	/

Rule

Path

Allow

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-image

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-mobile

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-news

Rule	Path
Allow	/

Rule

Path

Allow

googlebot-video

Rule	Path
Allow	/

Rule

Path

Allow

gulliver

Rule	Path
Allow	/

Rule

Path

Allow

ia_archiver

Rule	Path
Allow	/

Rule

Path

Allow

iisbot

Rule	Path
Allow	/

Rule

Path

Allow

jikespider

Rule	Path
Allow	/

Rule

Path

Allow

lycos_spider_(t-rex)

Rule	Path
Allow	/

Rule

Path

Allow

mail.ru_bot

Rule	Path
Allow	/

Rule

Path

Allow

mediapartners-google

Rule	Path
Allow	/

Rule

Path

Allow

msnbot

Rule	Path
Allow	/

Rule

Path

Allow

msnbot-media

Rule	Path
Allow	/

Rule

Path

Allow

msnptc

Rule	Path
Allow	/

Rule

Path

Allow

naverbot

Rule	Path
Allow	/

Rule

Path

Allow

nutch

Rule	Path
Allow	/

Rule

Path

Allow

quickobot

Rule	Path
Allow	/

Rule

Path

Allow

rogerbot

Rule	Path
Allow	/

Rule

Path

Allow

scooter

Rule	Path
Allow	/

Rule

Path

Allow

seznambot

Rule	Path
Allow	/

Rule

Path

Allow

slurp

Rule	Path
Allow	/

Rule

Path

Allow

stackrambler

Rule	Path
Allow	/

Rule

Path

Allow

surveybot

Rule	Path
Allow	/

Rule

Path

Allow

teoma

Rule	Path
Allow	/

Rule

Path

Allow

twitterbot/1.0

Rule	Path
Allow	/

Rule

Path

Allow

vscooter

Rule	Path
Allow	/

Rule

Path

Allow

yandex

Rule	Path
Allow	/

Rule

Path

Allow

yeti

Rule	Path
Allow	/

Rule

Path

Allow

zyborg

Rule	Path
Allow	/

Rule

Path

Allow

bingbot

Rule	Path
Allow	/

Rule

Path

Allow

ahrefssiteaudit

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

*

Rule

Path

Disallow

localservices.sulekha.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

googlebot

adsbot-google

alexabot

applebot

architextspider

baiduspider

bender

birubot

blogpulselive

claritybot

coccoc

daumoa

duckduckbot

fast

feedfetcher-google

googlebot

googlebot-image

googlebot-mobile

googlebot-news

googlebot-video

gulliver

ia_archiver

iisbot

jikespider

lycos_spider_(t-rex)

mail.ru_bot

mediapartners-google

msnbot

msnbot-media

msnptc

naverbot

nutch

quickobot

rogerbot

scooter

seznambot

slurp

stackrambler

surveybot

teoma

twitterbot/1.0

vscooter

yandex

yeti

zyborg

bingbot

ahrefssiteaudit

Other Records

*

localservices.sulekha.com
robots.txt