Log In Sign Up

kredytforum.pl
robots.txt

Robots Exclusion Standard data for kredytforum.pl

Resource Scan

Scan Details

Site Domain kredytforum.pl
Base Domain kredytforum.pl
Scan Status Ok
Last Scan2025-11-29T06:17:51+00:00
Next Scan 2025-12-06T06:17:51+00:00

Last Scan

Scanned2025-11-29T06:17:51+00:00
URL https://kredytforum.pl/robots.txt
Domain IPs 185.110.51.100
Response IP 185.110.51.100
Found Yes
Hash 1c8a715c6ad92af3cdbb97da8670399756618fc4fa806c0fb2df5d6f1585d069
SimHash ac984903c4aa

Groups

*

Rule Path
Disallow /startTopic/
Disallow /*?do=add
Disallow /*?do=submit
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /leaderboard
Disallow /pastleaders/
Disallow /topmembers/
Disallow /search/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /profile/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=comments
Disallow /*?do=email
Disallow /*?do=findComment
Disallow /*?do=getFirstComment
Disallow /*?do=getLastComment
Disallow /*?do=getNewComment
Disallow /*?do=markRead
Disallow /*?app=core
Disallow /*?view=new
Disallow /*?view=old
Disallow /*?view=getnextunread
Disallow /*?do=embed
Disallow /*?mode=linear
Disallow /*?mode=threaded
Disallow /*?view=getnewpost
Disallow /*?view=getlastpost
Disallow /usage/
Disallow /logs/
Disallow /cgi-bin/
Disallow /szukaj/

urlmetriken

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

fast

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

neticle.hu

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120
Back to top

Other Records

Field Value
sitemap https://www.kredytforum.pl/sitemap.php
Back to top

Comments

  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Additional pages
  • advertising-related bots:
  • Crawlers that are kind enough to obey, but which we'd rather not have
  • unless they're feeding search engines.
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • Misbehaving: requests much too fast:
  • Webmeup.com
Back to top