piratbit.org
robots.txt

Robots Exclusion Standard data for piratbit.org

Resource Scan

Scan Details

Site Domain piratbit.org
Base Domain piratbit.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-25T05:39:16+00:00
Next Scan 2025-11-23T05:39:16+00:00

Last Successful Scan

Scanned2023-10-12T20:34:19+00:00
URL https://piratbit.org/robots.txt
Domain IPs 104.21.32.178, 172.67.153.49, 2606:4700:3031::6815:20b2, 2606:4700:3035::ac43:9931
Response IP 172.67.153.49
Found Yes
Hash 247dbb68ca1993056ff22cbb0347e2de98eed3aa96c87d30b314f2e820c3c9b9
SimHash 5b5ec57042a0

Groups

*

Rule Path
Disallow /report.php
Disallow /bookmarks.php
Disallow /low_rating.php
Disallow /bonus.php
Disallow /admin/
Disallow /go/
Disallow /away/
Disallow /tracker/*/
Disallow /out/
Disallow /ext/
Disallow /ixt/
Disallow /exit/
Disallow /fxt/
Disallow /axt/
Disallow /oxt/
Disallow /oxita/
Disallow /goo.php
Disallow /gob.php
Disallow /gooo.php
Disallow /dl.php
Disallow /ukr_imdb.php
Disallow /down.php
Disallow /pron
Disallow /download.php
Disallow /filelst.php
Disallow /groupcp.php
Disallow /login.php
Disallow /memberlist.php
Disallow /modcp.php
Disallow /posting.php
Disallow /privmsg.php
Disallow /privmsg/
Disallow /user/
Disallow /profile.php
Disallow /misc/
Disallow /rek/
Disallow /modcp.php
Disallow /mytop.php
Disallow /game/*
Disallow /serials/*
Disallow /films/*
Disallow /4k/*
Allow /profile.php?mode=register

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

discordbot

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

buck

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

Warnings

  • `host` is not a known field.