Log In Sign Up

forum.onetime.nl
robots.txt

Robots Exclusion Standard data for forum.onetime.nl

Resource Scan

Scan Details

Site Domain forum.onetime.nl
Base Domain onetime.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-29T09:10:54+00:00
Next Scan 2026-01-12T09:10:54+00:00

Last Successful Scan

Scanned2025-12-06T09:12:13+00:00
URL https://forum.onetime.nl/robots.txt
Domain IPs 104.26.10.16, 104.26.11.16, 172.67.75.100, 2606:4700:20::681a:a10, 2606:4700:20::681a:b10, 2606:4700:20::ac43:4b64
Response IP 104.26.11.16
Found Yes
Hash 43393f01d634eaa172a5f4f4727b8a78313de9f56f72c516956f1174876078cb
SimHash b83049038c9a

Groups

*

Rule Path
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /profile/
Back to top

Other Records

Field Value
sitemap https://forum.onetime.nl/sitemap.php
Back to top

Comments

  • Rules for Invision Community (https://invisioncommunity.com)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
  • Sitemap URL
Back to top