property.sulekha.com
robots.txt

Robots Exclusion Standard data for property.sulekha.com

Resource Scan

Scan Details

Site Domain property.sulekha.com
Base Domain sulekha.com
Scan Status Ok
Last Scan2024-11-03T08:36:47+00:00
Next Scan 2024-12-03T08:36:47+00:00

Last Scan

Scanned2024-11-03T08:36:47+00:00
URL https://property.sulekha.com/robots.txt
Domain IPs 52.170.100.84
Response IP 52.170.100.84
Found Yes
Hash ed91d4c3e4f1ca08ca0694c0a9f381a39641f63dd8aa4bb7d84a20411d8b0d54
SimHash 29534bc0d461

Groups

adsbot-google

Rule Path
Allow /

alexabot

Rule Path
Allow /

qwantify

Rule Path
Disallow /

architextspider

Rule Path
Allow /

bender

Rule Path
Allow /

bingbot

Rule Path
Allow /

birubot

Rule Path
Allow /

blogpulselive

Rule Path
Allow /

coccoc

Rule Path
Allow /

daumoa

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

fast

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

gulliver

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

iisbot

Rule Path
Allow /

jikespider

Rule Path
Allow /

lycos_spider_(t-rex)

Rule Path
Allow /

mail.ru_bot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

msnptc

Rule Path
Allow /

naverbot

Rule Path
Allow /

nutch

Rule Path
Allow /

quickobot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

scooter

Rule Path
Allow /

seznambot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

slurp

Rule Path
Allow /

stackrambler

Rule Path
Allow /

surveybot

Rule Path
Allow /

teoma

Rule Path
Allow /

twitterbot/1.0

Rule Path
Allow /

vscooter

Rule Path
Allow /

yandex

Rule Path
Allow /

trovitbot

Rule Path
Allow /

yeti

Rule Path
Allow /

zyborg

Rule Path
Allow /

ahrefssiteaudit

Rule Path
Allow /

*

Rule Path
Allow /mvc5/lazy/v1/listing/get-left-panel-list
Allow /common/sul-hp-proc-swig-nhp.aspx
Allow /default.aspx
Disallow /?t
Disallow /content/
Disallow /ticketsV3/
Disallow /swig/
Disallow /sangam/
Disallow /network/
Disallow /services/
Disallow /adv/
Disallow /ESS/
Disallow /?city
Disallow *ypcity*
Disallow /fps/
Disallow */business-owners?*
Disallow */members/*
Disallow */memberpages/*
Disallow */epress/*
Disallow */html/*
Disallow */expressions/*
Disallow */orgsv2/*
Disallow */articles/*
Disallow */cgi-bin/*
Disallow */movies/*
Disallow */photo/*
Disallow */news/*
Disallow */indusinquirer/*
Disallow */orgs/*
Disallow */partners/*
Disallow */philosophy/*
Disallow */citypages/*
Disallow */v2/listings/*
Disallow */eventdir.aspx*
Disallow */core/lazy/*
Disallow */mvc5/lazy/*
Disallow *tp%3Dstandalone*
Disallow */404*
Disallow */getquotes/*
Disallow */ajax/*
Disallow */handlers/*
Disallow */hpfps/*
Disallow */common/listingaj*
Disallow */js/*
Disallow */lsapi/*
Disallow */common/sul-hp-proc*
Disallow */blog/common/*
Disallow *-booking$
Disallow *business%3D*
Disallow *pagetype%3Dgetquote
Disallow /affiliate/
Disallow */*/online
Disallow *?*

screaming frog seo spider

Rule Path
Disallow /

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://property.sulekha.com/sitemap/propertysitemapindex.xml