Log In Sign Up

punterplanet.com
robots.txt

Robots Exclusion Standard data for punterplanet.com

Resource Scan

Scan Details

Site Domain punterplanet.com
Base Domain punterplanet.com
Scan Status Ok
Last Scan2025-12-13T02:33:43+00:00
Next Scan 2026-01-12T02:33:43+00:00

Last Scan

Scanned2025-12-13T02:33:43+00:00
URL https://punterplanet.com/robots.txt
Domain IPs 104.26.4.205, 104.26.5.205, 172.67.71.42
Response IP 104.26.4.205
Found Yes
Hash eeb5072a41e6d4476e2fbc87db28f3621bfa0f481ace551e541b935b563adb11
SimHash 562049508cd4

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /api
Disallow /applications
Disallow /datastore
Disallow /dev
Disallow /oauth
Disallow /plugins
Disallow /system
Disallow /uploads
Disallow /vendor
Disallow /404error.php
Disallow /Credits.txt
Disallow /error.php
Disallow /login
Disallow /logout
Disallow /register
Disallow /lostpassword
Disallow /privacy
Disallow /cookies
Disallow /guidelines
Disallow /terms
Disallow /online
Disallow /staff
Disallow /contact
Disallow /announcement*
Disallow /search
Disallow /discover*
Disallow /rss*
Disallow /tags*
Disallow /activity
Disallow /new-content
Disallow /promote*
Disallow /ourpicks
Disallow /leaderboard
Disallow /pastleaders
Disallow /topmembers
Disallow /*do%3D*
Disallow /*sort%3D*
Disallow /*sortby%3D*
Disallow /*csrf%3D*
Disallow /*csrfKey%3D*
Disallow */?tab=*
Disallow */?_fromLogin=*
Disallow */?_fromLogout=*
Disallow */submit
Disallow */create
Disallow */edit
Allow /uploads/monthly_*_*/*
Disallow /startTopic/
Disallow /*?do=add
Disallow /*?do=submit
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=comments
Disallow /*?do=findComment
Disallow /*?do=getLastComment
Disallow /*?do=getNewComment
Disallow /profile/
Back to top

Other Records

Field Value
sitemap https://punterplanet.com/sitemap.php
Back to top

Comments

  • As a condition of accessing this website, you agree to abide by the following
  • content signals:
  • (a) If a content-signal = yes, you may collect content for the corresponding
  • use.
  • (b) If a content-signal = no, you may not collect content for the
  • corresponding use.
  • (c) If the website operator does not include a content signal for a
  • corresponding use, the website operator neither grants nor restricts
  • permission via content signal with respect to the corresponding use.
  • The content signals and their meanings are:
  • search: building a search index and providing search results (e.g., returning
  • hyperlinks and short excerpts from your website's contents). Search does not
  • include providing AI-generated search summaries.
  • ai-input: inputting content into one or more AI models (e.g., retrieval
  • augmented generation, grounding, or other real-time taking of content for
  • generative AI search answers).
  • ai-train: training or fine-tuning AI models.
  • ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
  • RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
  • AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
  • This robots.txt file is created by Ilya Hoilik.
  • You can contribute by visiting the link bellow.
  • https://gist.github.com/ilyahoilik/c6d70d828f42aae429e3e84283fb85f7
  • Folders and files
  • Authentication
  • Legal information
  • Staff and users
  • Contact page
  • Announcements
  • Content discovery
  • Content promotion
  • Leaderboard
  • With extra parameters
  • Create and edit pages
  • Allow attachments in the uploads folder
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Block profile pages as these have little unique value, consume a lot of crawl time and contain hundreds of 301 links
Back to top

Warnings

  • `content-signal` is not a known field.
  • `host` is not a known field.
Back to top