forensiccounselor.org
robots.txt

Robots Exclusion Standard data for forensiccounselor.org

Resource Scan

Scan Details

Site Domain forensiccounselor.org
Base Domain forensiccounselor.org
Scan Status Ok
Last Scan2024-06-10T06:03:45+00:00
Next Scan 2024-07-10T06:03:45+00:00

Last Scan

Scanned2024-06-10T06:03:45+00:00
URL https://forensiccounselor.org/robots.txt
Domain IPs 192.169.147.224
Response IP 192.169.147.224
Found Yes
Hash 966bad4ab78bfc9f0df56bb5a7097f34f8cf83e4c00f6078598583d9b34ae999
SimHash 27d7d3b06a5a

Groups

ia_archiver
findestars
myonid
peekyou
pipl
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

googlebot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

bingbot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

msnbot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

slurp

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

googlebot-image

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

baiduspider

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

scoutjet

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

seznambot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

teoma

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

yandex

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

msnbot-media

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

googlebot-news

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

googlebot-video

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

googlebot-mobile

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

mediapartners-google

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /fetch/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

adsbot-google

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

duckduckbot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

gurujibot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

architextspider

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

daumoa

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

voilabot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

fast

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

solbot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

stackrambler

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

relcybot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/*
Disallow /uas/oauth/*
Disallow /using*

exabot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/%5C*
Disallow /uas/oauth/*
Disallow /using*

twitterbot/1.0

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/*
Disallow /uas/oauth/*
Disallow /using*

mail.ru_bot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/*
Disallow /uas/oauth/*
Disallow /using*

naverbot

Rule Path
Disallow /addContacts*
Disallow /addressBookExport*
Disallow /analytics/
Disallow /answers*
Disallow /cap/
Disallow /companyDir*
Disallow /connections*
Disallow /edurec*
Disallow /endorsements
Disallow /find/
Disallow /groupAnswers*
Disallow /groupSharingMsg*
Disallow /inviteFromProfile*
Disallow /inviteMany*
Disallow /jobs?runSearch*
Disallow /jsearch*
Disallow /lite/
Disallow /mbox*
Disallow /memberInvite*
Disallow /msgToConns*
Disallow /myprofile*
Disallow /network
Disallow /newsArticle*
Disallow /news?viewArticle*
Disallow /nus-trk*
Disallow /osview/
Disallow /otherContacts
Disallow /ppl/
Disallow /profile*
Disallow /reconnect*
Disallow /redirect*
Disallow /redir*
Disallow /reg/
Disallow /requestList*
Disallow /search*
Disallow /secure/
Disallow /settings/
Disallow /shareArticle*
Disallow /signature*
Disallow /slink*
Disallow /svpRecommendations*
Disallow /today///*
Disallow /today/*
Disallow /uas/oauth/*
Disallow /using*

nextgensearchbot

Rule Path
Disallow /directory
Disallow /register
Disallow /verifyRegister
Disallow /verifyRegisterConfirm
Disallow /clearRegister
Disallow /resendVerification
Disallow /accountWelcome
Disallow /account
Disallow /myAccount
Disallow /needVerify
Disallow /myaccount
Disallow /profile
Disallow /profileReferences
Disallow /claim
Disallow /debug
Disallow /blank
Disallow /ie6
Disallow /siteStatus
Disallow /login
Disallow /appExpired
Disallow /appSuspended
Disallow /notAuthorized
Disallow /logout
Disallow /resetPassword
Disallow /changePassword
Disallow /securityCode
Disallow /css
Disallow /js
Disallow /common
Disallow /search/person
Disallow /search/company
Disallow /search/profile
Disallow /people_directory
Disallow /people
Disallow /people-search
Disallow /location-search

zoombot

Rule Path
Disallow /directory
Disallow /register
Disallow /verifyRegister
Disallow /verifyRegisterConfirm
Disallow /clearRegister
Disallow /resendVerification
Disallow /accountWelcome
Disallow /account
Disallow /myAccount
Disallow /needVerify
Disallow /myaccount
Disallow /profile
Disallow /profileReferences
Disallow /claim
Disallow /debug
Disallow /blank
Disallow /ie6
Disallow /siteStatus
Disallow /login
Disallow /appExpired
Disallow /appSuspended
Disallow /notAuthorized
Disallow /logout
Disallow /resetPassword
Disallow /changePassword
Disallow /securityCode
Disallow /css
Disallow /js
Disallow /common
Disallow /search/person
Disallow /search/company
Disallow /search/profile
Disallow /people_directory
Disallow /people
Disallow /people-search
Disallow /location-search

baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-news
baiduspider-video
exabot
ichiro
mj12bot
moget
naverbot
sogou spider
yandex
yandexantivirus
yandexblogs
yandexbot
yandexcatalog
yandexdirect
yandexfavicons
yandeximageresizer
yandeximages
yandexmedia
yandexmetrika
yandexnews
yandexpagechecker
yandexvideo
yandexwebmaster
yandexzakladki
yasni
yeti
youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /register
Disallow /verifyRegister
Disallow /verifyRegisterConfirm
Disallow /clearRegister
Disallow /resendVerification
Disallow /accountWelcome
Disallow /account
Disallow /myAccount
Disallow /needVerify
Disallow /myaccount
Disallow /profile
Disallow /profileReferences
Disallow /claim
Disallow /debug
Disallow /blank
Disallow /ie6
Disallow /siteStatus
Disallow /login
Disallow /appExpired
Disallow /appSuspended
Disallow /notAuthorized
Disallow /logout
Disallow /resetPassword
Disallow /changePassword
Disallow /securityCode
Disallow /css
Disallow /js
Disallow /common
Disallow /search/person
Disallow /search/company
Disallow /search/profile
Disallow /embeddedcontent
Disallow /business/administrator
Disallow /usercenter

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.