archiveofsins.com
robots.txt
Robots Exclusion Standard data for archiveofsins.com
Resource Scan
Scan Details
| Site Domain | archiveofsins.com |
| Base Domain | archiveofsins.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-01T23:02:49+00:00 |
| Next Scan | 2025-09-29T23:02:49+00:00 |
Last Successful Scan
| Scanned | 2024-02-15T17:36:29+00:00 |
| URL | https://archiveofsins.com/robots.txt |
| Domain IPs | 104.21.7.52, 172.67.135.197, 2606:4700:3030::6815:734, 2606:4700:3035::ac43:87c5 |
| Response IP | 172.67.135.197 |
| Found | Yes |
| Hash | b3c77eac12f4ba3800b147e8d2433a28bf69a07e6dfddc7784bc92504d58a35a |
| SimHash | e2609c20c291 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Allow | / |
| Allow | /_/articles/* |
| Disallow | /admin |
| Disallow | /admin/* |
| Disallow | /cdn-cgi/* |
| Disallow | /application/* |
| Disallow | /system/* |
| Disallow | /*?task=* |
| Disallow | /*/search |
| Disallow | /*/ghost |
| Disallow | /*/reports |
| Disallow | /*/report |
| Disallow | /*/last |
| Disallow | /*/redirect |
| Disallow | /*/page_mode |
| Disallow | /*/full_image |
| Disallow | /*/submit |
| Disallow | /*/api |
| Disallow | /*/statistics |
| Disallow | /*/gallery |
| Disallow | /*/post |
| Disallow | /*/search/* |
| Disallow | /*/ghost/* |
| Disallow | /*/reports/* |
| Disallow | /*/report/* |
| Disallow | /*/last/* |
| Disallow | /*/redirect/* |
| Disallow | /*/page_mode/* |
| Disallow | /*/full_image/* |
| Disallow | /*/submit/* |
| Disallow | /*/api/* |
| Disallow | /*/statistics/* |
| Disallow | /*/gallery/* |
| Disallow | /*/post/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://archiveofsins.com/sitemap.xml |