5dok.org
robots.txt
Robots Exclusion Standard data for 5dok.org
Resource Scan
Scan Details
Site Domain | 5dok.org |
Base Domain | 5dok.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-18T11:50:23+00:00 |
Next Scan | 2025-06-16T11:50:23+00:00 |
Last Successful Scan
Scanned | 2024-08-21T10:29:25+00:00 |
URL | https://5dok.org/robots.txt |
Domain IPs | 142.93.139.232 |
Response IP | 142.93.139.232 |
Found | Yes |
Hash | 741cca37d96f96d4e90d26ee5c5b4f7c10002e3946f7e0dc4f6bbb66a8394649 |
SimHash | 7c1ac4f0c6d2 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /user/ |
Disallow | /app/ |
Disallow | /livewire/ |
Disallow | /api/ |
Disallow | /auth/ |
Disallow | /sapi/ |
Disallow | /iframe/ |
Disallow | /arrilot/ |
Disallow | /search |
Disallow | /v4/ |
Disallow | /v3/ |
Disallow | /v2/ |
Disallow | /document/download |
Disallow | /blog |
Disallow | /pub |
Disallow | /tagged |
Disallow | /upload |
Disallow | /*/download/ |
Other Records
Field | Value |
---|---|
sitemap | https://5dok.org/sitemaps/document |
sitemap | https://5dok.org/sitemaps/user-document |
sitemap | https://5dok.org/sitemaps/titles |
sitemap | https://5dok.org/sitemaps/subjects |
sitemap | https://5dok.org/sitemaps/parts |
sitemap | https://5dok.org/sitemap/recent-documents.xml |
sitemap | https://5dok.org/sitemap/recent-articles.xml |