Log In Sign Up

psychforums.com
robots.txt

Robots Exclusion Standard data for psychforums.com

Resource Scan

Scan Details

Site Domain psychforums.com
Base Domain psychforums.com
Scan Status Ok
Last Scan2024-10-05T06:42:51+00:00
Next Scan 2024-10-12T06:42:51+00:00

Last Scan

Scanned2024-10-05T06:42:51+00:00
URL https://psychforums.com/robots.txt
Redirect https://www.psychforums.com/robots.txt
Redirect Domain www.psychforums.com
Redirect Base psychforums.com
Domain IPs 198.50.155.85
Redirect IPs 198.50.155.85
Response IP 198.50.155.85
Found Yes
Hash 4b4ecb1a62ec2bb3394fbfaf0da59917edebd50565f2a7750d58d766db9b0bb1
SimHash 12191faa9574

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /viewtopic.php
Disallow /viewforum.php
Disallow /index.php?
Disallow /posting.php
Disallow /search.php?
Disallow /ucp.php
Disallow /mcp.php
Disallow /portal.php
Disallow /profile.php?
Disallow /privmsg.php?
Disallow /groupcp.php
Disallow /memberlist.php
Disallow /faq.php
Disallow /test/
Disallow /blog/*index_feed-JAVASCRIPT*.html$

Other Records

Field Value
crawl-delay 1
Back to top

Comments

  • ROBOTS.TXT for PHPBB3
  • or it removes /post-traumatic-stress forum
  • Disallow: /post
  • or it removes /member-corner and /member-introductions forums
  • Disallow: /member
  • Added August 2nd 2014:
Back to top