piratbit.fun
robots.txt
Robots Exclusion Standard data for piratbit.fun
Resource Scan
Scan Details
| Site Domain | piratbit.fun |
| Base Domain | piratbit.fun |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-25T07:39:29+00:00 |
| Next Scan | 2024-10-09T07:39:29+00:00 |
Last Successful Scan
| Scanned | 2024-08-18T05:08:23+00:00 |
| URL | https://piratbit.fun/robots.txt |
| Domain IPs | 104.21.79.122, 172.67.145.160, 2606:4700:3032::ac43:91a0, 2606:4700:3035::6815:4f7a |
| Response IP | 172.67.145.160 |
| Found | Yes |
| Hash | 7e2791f812cf3869bf3a6c961bc2f1fda3ddc266ec9844399046ab62c323a1c3 |
| SimHash | 535ec5604624 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /report.php |
| Disallow | /bookmarks.php |
| Disallow | /low_rating.php |
| Disallow | /bonus.php |
| Disallow | /admin/ |
| Disallow | /go/ |
| Disallow | /away/ |
| Disallow | /tracker/*/ |
| Disallow | /out/ |
| Disallow | /ext/ |
| Disallow | /ixt/ |
| Disallow | /exit/ |
| Disallow | /fxt/ |
| Disallow | /axt/ |
| Disallow | /oxt/ |
| Disallow | /oxita/ |
| Disallow | /goo.php |
| Disallow | /gob.php |
| Disallow | /gooo.php |
| Disallow | /dl.php |
| Disallow | /ukr_imdb.php |
| Disallow | /down.php |
| Disallow | /pron |
| Disallow | /download.php |
| Disallow | /filelst.php |
| Disallow | /groupcp.php |
| Disallow | /login.php |
| Disallow | /memberlist.php |
| Disallow | /modcp.php |
| Disallow | /posting.php |
| Disallow | /privmsg.php |
| Disallow | /privmsg/ |
| Disallow | /user/ |
| Disallow | /profile.php |
| Disallow | /misc/ |
| Disallow | /rek/ |
| Disallow | /modcp.php |
| Disallow | /mytop.php |
| Disallow | /game/* |
| Disallow | /serials/* |
| Disallow | /films/* |
| Disallow | /4k/* |
| Allow | /profile.php?mode=register |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Warnings
- `host` is not a known field.