Log In Sign Up

planmember.com
robots.txt

Robots Exclusion Standard data for planmember.com

Resource Scan

Scan Details

Site Domain planmember.com
Base Domain planmember.com
Scan Status Ok
Last Scan2024-06-17T16:09:22+00:00
Next Scan 2024-07-17T16:09:22+00:00

Last Scan

Scanned2024-06-17T16:09:22+00:00
URL https://planmember.com/robots.txt
Redirect https://www.planmember.com/robots.txt
Redirect Domain www.planmember.com
Redirect Base planmember.com
Domain IPs 99.84.208.105, 99.84.208.118, 99.84.208.13, 99.84.208.59
Redirect IPs 3.165.102.17, 3.165.102.34, 3.165.102.68, 3.165.102.80
Response IP 3.165.102.68
Found Yes
Hash 1b647bdb9afd7146cc07725e6456759eeb46464f6d573577d5b155704cd2dbf9
SimHash 28107d9a45e5

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

teoma

Rule Path
Disallow

rogerbot

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

facebot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

*

Rule Path
Disallow /
Disallow /access/
Disallow /login/
Disallow /planner/
Disallow /plannerdocuments/
Disallow /pmdev/
Disallow *doc.cfm
Disallow /first-time-user.cfm
Disallow /*?*moddirpath=

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • BEGIN FILE
  • The use of robots or other automated means to access the Planmember.com site
  • without the express permission of Planmember.com is strictly prohibited.
  • Notwithstanding the foregoing, Planmember.com may permit automated access to
  • access certain Planmember.com pages but soley for the limited purpose of
  • including content in publicly available search engines. Any other
  • use of robots or failure to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/wc/exclusion.html> is strictly
  • prohibited.
  • v3
  • END FILE
Back to top