nilamatrimony.com
robots.txt

Robots Exclusion Standard data for nilamatrimony.com

Resource Scan

Scan Details

Site Domain nilamatrimony.com
Base Domain nilamatrimony.com
Scan Status Ok
Last Scan2024-06-28T22:36:54+00:00
Next Scan 2024-07-12T22:36:54+00:00

Last Scan

Scanned2024-06-28T22:36:54+00:00
URL https://nilamatrimony.com/robots.txt
Redirect https://www.nilamatrimony.com/robots.txt
Redirect Domain www.nilamatrimony.com
Redirect Base nilamatrimony.com
Domain IPs 43.230.201.97
Redirect IPs 43.230.201.97
Response IP 43.230.201.97
Found Yes
Hash 9de946f1ab4528ffa2f88366fa44906d9806a72d9171268a5b43b64047cff060
SimHash 121676226bf8

Groups

*

Rule Path
Allow /

megaindex.ru

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

findestars

Rule Path
Disallow /

myonid

Rule Path
Disallow /

peekyou

Rule Path
Disallow /

pipl

Rule Path
Disallow /

rapleaf

Rule Path
Disallow /

snitch

Rule Path
Disallow /

spock

Rule Path
Disallow /

tweepz

Rule Path
Disallow /

wink

Rule Path
Disallow /

yasni

Rule Path
Disallow /

yoname

Rule Path
Disallow /

yourtraces

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.