Log In Sign Up

dinet.org
robots.txt

Robots Exclusion Standard data for dinet.org

Resource Scan

Scan Details

Site Domain dinet.org
Base Domain dinet.org
Scan Status Ok
Last Scan2024-06-10T06:41:59+00:00
Next Scan 2024-07-10T06:41:59+00:00

Last Scan

Scanned2024-06-10T06:41:59+00:00
URL https://dinet.org/robots.txt
Redirect https://www.dinet.org/robots.txt
Redirect Domain www.dinet.org
Redirect Base dinet.org
Domain IPs 2600:9000:24db:5e00:18:8e2d:7700:93a1, 2600:9000:24db:6a00:18:8e2d:7700:93a1, 2600:9000:24db:8000:18:8e2d:7700:93a1, 2600:9000:24db:b000:18:8e2d:7700:93a1, 2600:9000:24db:ca00:18:8e2d:7700:93a1, 2600:9000:24db:cc00:18:8e2d:7700:93a1, 2600:9000:24db:ce00:18:8e2d:7700:93a1, 2600:9000:24db:f800:18:8e2d:7700:93a1, 65.9.112.63, 65.9.112.73, 65.9.112.74, 65.9.112.94
Redirect IPs 108.156.201.118, 108.156.201.2, 108.156.201.36, 108.156.201.45, 2600:9000:24db:4800:18:8e2d:7700:93a1, 2600:9000:24db:5200:18:8e2d:7700:93a1, 2600:9000:24db:8800:18:8e2d:7700:93a1, 2600:9000:24db:b600:18:8e2d:7700:93a1, 2600:9000:24db:d600:18:8e2d:7700:93a1, 2600:9000:24db:d800:18:8e2d:7700:93a1, 2600:9000:24db:e800:18:8e2d:7700:93a1, 2600:9000:24db:f800:18:8e2d:7700:93a1
Response IP 18.165.171.47
Found Yes
Hash a47894105989ce683f46d957b3cb8f57af73a0b8c636109da5b7780a0708c9f3
SimHash 30306a81049a

Groups

*

Rule Path
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /cookie/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /tags/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /*?&controller=embed
Back to top

Other Records

Field Value
sitemap https://dinet.org/sitemap.php
Back to top

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Sitemap URL
Back to top