blog.keinnerd.net
robots.txt

Robots Exclusion Standard data for blog.keinnerd.net

Resource Scan

Scan Details

Site Domain blog.keinnerd.net
Base Domain keinnerd.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-13T05:47:06+00:00
Next Scan 2025-08-11T05:47:06+00:00

Last Successful Scan

Scanned2022-02-04T02:47:43+00:00
URL https://blog.keinnerd.net/robots.txt
Redirect https://keinnerd.net/robots.txt
Redirect Domain keinnerd.net
Redirect Base keinnerd.net
Response IP 172.67.75.178
Found Yes
Hash 80cb3e39960024218129c3cc0a2694a4fd62861d02da1651fbc4d88a680c95b9
SimHash b9a009104e8c

Groups

*

Rule Path
Disallow /startTopic/
Disallow /*?do=add
Disallow /*?do=submit
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=comments
Disallow /*?do=email
Disallow /*?do=findComment
Disallow /*?do=getLastComment
Disallow /*?do=getNewComment
Disallow /*?do=reportComment
Disallow /*?do=markRead
Disallow /profile/

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links