twibooru.org
robots.txt
Robots Exclusion Standard data for twibooru.org
Resource Scan
Scan Details
| Site Domain | twibooru.org |
| Base Domain | twibooru.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-11T00:02:05+00:00 |
| Next Scan | 2026-05-12T00:02:05+00:00 |
Last Successful Scan
| Scanned | 2025-06-22T08:19:15+00:00 |
| URL | https://twibooru.org/robots.txt |
| Domain IPs | 104.26.12.222, 104.26.13.222, 172.67.71.247, 2606:4700:20::681a:cde, 2606:4700:20::681a:dde, 2606:4700:20::ac43:47f7 |
| Response IP | 172.67.71.247 |
| Found | Yes |
| Hash | 0ffc8c42a0021d9d71ed4edcd67785164cc6db34c6c2a2a1bed18fa7bb4a4246 |
| SimHash | fd20dce06bd1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /users |
| Disallow | /profiles |
| Disallow | /profiles/*/tag_changes |
| Disallow | /profiles/*/source_changes |
| Disallow | /lists/user_comments |
| Disallow | /posts/favourites |
| Disallow | /posts/posted |
| Disallow | /posts/*/votes |
| Disallow | /posts/*/faves |
| Disallow | /api |
| Disallow | /filters/hide |
| Disallow | /filters/spoiler |
| Disallow | /find |
| Disallow | /harming/humans |
| Disallow | /ignoring/human/orders |
| Disallow | /harm/to/self |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |