ioselite.com
robots.txt

Robots Exclusion Standard data for ioselite.com

Resource Scan

Scan Details

Site Domain ioselite.com
Base Domain ioselite.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-17T09:39:50+00:00
Next Scan 2026-03-17T09:39:50+00:00

Last Successful Scan

Scanned2023-03-03T10:40:35+00:00
URL https://ioselite.com/robots.txt
Redirect https://www.ioselite.com/robots.txt
Redirect Domain www.ioselite.com
Redirect Base ioselite.com
Domain IPs 104.21.21.158, 172.67.199.87, 2606:4700:3032::ac43:c757, 2606:4700:3037::6815:159e
Redirect IPs 104.21.21.158, 172.67.199.87, 2606:4700:3032::ac43:c757, 2606:4700:3037::6815:159e
Response IP 104.21.21.158
Found Yes
Hash bc20d4a8aacdf486c008a26523aff3a06172a4084530200016c87a04a272aef4
SimHash b8304d01449c

Groups

*

Rule Path
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /profile/

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links