pudukkottaimatrimony.com
robots.txt

Robots Exclusion Standard data for pudukkottaimatrimony.com

Resource Scan

Scan Details

Site Domain pudukkottaimatrimony.com
Base Domain pudukkottaimatrimony.com
Scan Status Ok
Last Scan2024-07-04T15:42:00+00:00
Next Scan 2024-07-18T15:42:00+00:00

Last Scan

Scanned2024-07-04T15:42:00+00:00
URL https://pudukkottaimatrimony.com/robots.txt
Redirect https://www.pudukkottaimatrimony.com/robots.txt
Redirect Domain www.pudukkottaimatrimony.com
Redirect Base pudukkottaimatrimony.com
Domain IPs 43.230.201.97
Redirect IPs 43.230.201.97
Response IP 43.230.201.97
Found Yes
Hash 9de946f1ab4528ffa2f88366fa44906d9806a72d9171268a5b43b64047cff060
SimHash 121676226bf8

Groups

*

Rule Path
Allow /

megaindex.ru

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

findestars

Rule Path
Disallow /

myonid

Rule Path
Disallow /

peekyou

Rule Path
Disallow /

pipl

Rule Path
Disallow /

rapleaf

Rule Path
Disallow /

snitch

Rule Path
Disallow /

spock

Rule Path
Disallow /

tweepz

Rule Path
Disallow /

wink

Rule Path
Disallow /

yasni

Rule Path
Disallow /

yoname

Rule Path
Disallow /

yourtraces

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Warnings

  • 4 invalid lines.