tdtachristianmatrimony.com
robots.txt

Robots Exclusion Standard data for tdtachristianmatrimony.com

Resource Scan

Scan Details

Site Domain tdtachristianmatrimony.com
Base Domain tdtachristianmatrimony.com
Scan Status Ok
Last Scan2024-06-14T03:05:22+00:00
Next Scan 2024-07-14T03:05:22+00:00

Last Scan

Scanned2024-06-14T03:05:22+00:00
URL https://tdtachristianmatrimony.com/robots.txt
Domain IPs 119.18.48.32
Response IP 119.18.48.32
Found Yes
Hash 85e7e9f0885cca481929aa4acf0e6e1968f0ed2d48571de4c7852e63af902538
SimHash 4216f6006af0

Groups

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /

msnbot-media

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

findestars

Rule Path
Disallow /

myonid

Rule Path
Disallow /

peekyou

Rule Path
Disallow /

pipl

Rule Path
Disallow /

rapleaf

Rule Path
Disallow /

snitch

Rule Path
Disallow /

spock

Rule Path
Disallow /

tweepz

Rule Path
Disallow /

wink

Rule Path
Disallow /

yasni

Rule Path
Disallow /

yoname

Rule Path
Disallow /

yourtraces

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

crowsnest

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /
Disallow /administrator/
Disallow /photos/
Disallow /connect/
Disallow /administrator/payment/
Disallow /administrator/profile-approval/

Warnings

  • 4 invalid lines.