piratbit.org
robots.txt
Robots Exclusion Standard data for piratbit.org
Resource Scan
Scan Details
Site Domain | piratbit.org |
Base Domain | piratbit.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-08-25T05:39:16+00:00 |
Next Scan | 2025-11-23T05:39:16+00:00 |
Last Successful Scan
Scanned | 2023-10-12T20:34:19+00:00 |
URL | https://piratbit.org/robots.txt |
Domain IPs | 104.21.32.178, 172.67.153.49, 2606:4700:3031::6815:20b2, 2606:4700:3035::ac43:9931 |
Response IP | 172.67.153.49 |
Found | Yes |
Hash | 247dbb68ca1993056ff22cbb0347e2de98eed3aa96c87d30b314f2e820c3c9b9 |
SimHash | 5b5ec57042a0 |
Groups
*
Rule | Path |
---|---|
Disallow | /report.php |
Disallow | /bookmarks.php |
Disallow | /low_rating.php |
Disallow | /bonus.php |
Disallow | /admin/ |
Disallow | /go/ |
Disallow | /away/ |
Disallow | /tracker/*/ |
Disallow | /out/ |
Disallow | /ext/ |
Disallow | /ixt/ |
Disallow | /exit/ |
Disallow | /fxt/ |
Disallow | /axt/ |
Disallow | /oxt/ |
Disallow | /oxita/ |
Disallow | /goo.php |
Disallow | /gob.php |
Disallow | /gooo.php |
Disallow | /dl.php |
Disallow | /ukr_imdb.php |
Disallow | /down.php |
Disallow | /pron |
Disallow | /download.php |
Disallow | /filelst.php |
Disallow | /groupcp.php |
Disallow | /login.php |
Disallow | /memberlist.php |
Disallow | /modcp.php |
Disallow | /posting.php |
Disallow | /privmsg.php |
Disallow | /privmsg/ |
Disallow | /user/ |
Disallow | /profile.php |
Disallow | /misc/ |
Disallow | /rek/ |
Disallow | /modcp.php |
Disallow | /mytop.php |
Disallow | /game/* |
Disallow | /serials/* |
Disallow | /films/* |
Disallow | /4k/* |
Allow | /profile.php?mode=register |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- `host` is not a known field.