Log In Sign Up

forum.klikk.no
robots.txt

Robots Exclusion Standard data for forum.klikk.no

Resource Scan

Scan Details

Site Domain forum.klikk.no
Base Domain klikk.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-08T18:22:25+00:00
Next Scan 2026-04-09T18:22:25+00:00

Last Successful Scan

Scanned2025-11-17T11:33:35+00:00
URL https://forum.klikk.no/robots.txt
Domain IPs 104.26.8.13, 104.26.9.13, 172.67.74.5, 2606:4700:20::681a:80d, 2606:4700:20::681a:90d, 2606:4700:20::ac43:4a05
Response IP 172.67.74.5
Found Yes
Hash f533badbdaf078249ba3e9f11de7fc2c6655146885fc1081774b1fd6584dee7f
SimHash 48608d71c998

Groups

*

Rule Path
Disallow /foreldre/startTopic/
Disallow /foreldre/discover/unread/
Disallow /foreldre/markallread/
Disallow /foreldre/staff/
Disallow /foreldre/online/
Disallow /foreldre/discover/
Disallow /foreldre/leaderboard/
Disallow /foreldre/search/
Disallow /foreldre/*?advancedSearchForm=
Disallow /foreldre/register/
Disallow /foreldre/lostpassword/
Disallow /foreldre/login/
Disallow /foreldre/*?sortby=
Disallow /foreldre/*?filter=
Disallow /foreldre/*?tab=
Disallow /foreldre/*?do=
Disallow /foreldre/*ref%3D
Disallow /foreldre/*?forumId*
Disallow /foreldre/profile/
Disallow /foreldre/index.php?app=tekcode*
Back to top

Other Records

Field Value
sitemap https://forum.klikk.no/foreldre/sitemap.php
Back to top

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
  • Block custom Egmont stuff
  • Sitemap URL
Back to top