lolsharp.com
robots.txt

Robots Exclusion Standard data for lolsharp.com

Resource Scan

Scan Details

Site Domain lolsharp.com
Base Domain lolsharp.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-14T13:40:59+00:00
Next Scan 2025-12-13T13:40:59+00:00

Last Successful Scan

Scanned2023-05-03T00:17:42+00:00
URL https://lolsharp.com/robots.txt
Domain IPs 104.21.66.198, 172.67.164.30, 2606:4700:3031::ac43:a41e, 2606:4700:3037::6815:42c6
Response IP 172.67.164.30
Found Yes
Hash bc20d4a8aacdf486c008a26523aff3a06172a4084530200016c87a04a272aef4
SimHash b8304d01449c

Groups

*

Rule Path
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /profile/

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links