kanyakumarimatrimony.com
robots.txt

Robots Exclusion Standard data for kanyakumarimatrimony.com

Resource Scan

Scan Details

Site Domain kanyakumarimatrimony.com
Base Domain kanyakumarimatrimony.com
Scan Status Ok
Last Scan2024-11-03T11:39:23+00:00
Next Scan 2024-11-17T11:39:23+00:00

Last Scan

Scanned2024-11-03T11:39:23+00:00
URL https://kanyakumarimatrimony.com/robots.txt
Redirect https://www.kanyakumarimatrimony.com/robots.txt
Redirect Domain www.kanyakumarimatrimony.com
Redirect Base kanyakumarimatrimony.com
Domain IPs 103.247.19.4
Redirect IPs 103.247.19.4
Response IP 103.247.19.4
Found Yes
Hash 9de946f1ab4528ffa2f88366fa44906d9806a72d9171268a5b43b64047cff060
SimHash 121676226bf8

Groups

*

Rule Path
Allow /

megaindex.ru

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

findestars

Rule Path
Disallow /

myonid

Rule Path
Disallow /

peekyou

Rule Path
Disallow /

pipl

Rule Path
Disallow /

rapleaf

Rule Path
Disallow /

snitch

Rule Path
Disallow /

spock

Rule Path
Disallow /

tweepz

Rule Path
Disallow /

wink

Rule Path
Disallow /

yasni

Rule Path
Disallow /

yoname

Rule Path
Disallow /

yourtraces

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.