darkcrime.pm
robots.txt
Robots Exclusion Standard data for darkcrime.pm
Resource Scan
Scan Details
| Site Domain | darkcrime.pm |
| Base Domain | darkcrime.pm |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-08-23T11:24:59+00:00 |
| Next Scan | 2025-11-21T11:24:59+00:00 |
Last Successful Scan
| Scanned | 2023-07-13T06:52:47+00:00 |
| URL | https://darkcrime.pm/robots.txt |
| Domain IPs | 104.21.15.40, 172.67.161.101, 2606:4700:3034::ac43:a165, 2606:4700:3035::6815:f28 |
| Response IP | 172.67.161.101 |
| Found | Yes |
| Hash | 6b7f310f5375a475003c81a172f3d68e3c25eaf8e80267b9da5769e54034e6f6 |
| SimHash | 4b04e29049d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /forum/admin/ |
| Disallow | /forum/cache/ |
| Disallow | /forum/converge_local/ |
| Disallow | /forum/hooks/ |
| Disallow | /forum/ips_kernel/ |
| Disallow | /forum/retail/ |
| Disallow | /forum/public/style_captcha/ |
| Disallow | /forum/index.php?app=core&module=task |
| Disallow | /forum/index.php?app=forums&module=moderate§ion=moderate |
| Disallow | /forum/index.php?app=forums&module=extras§ion=forward |
| Disallow | /forum/index.php?app=members&module=chat |
| Disallow | /forum/index.php?&unlockUserAgent=1 |
| Disallow | /forum/*%26module%3Dsearch |
| Disallow | /forum/*%26module%3Dsearch |
| Disallow | /index.php?app=members* |
| Allow | /forum/*%26search_tags%3D |
| Disallow | /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation |
| Disallow | /forum/*app%3Dcore%26module%3Dusercp |
| Disallow | /forum/*app%3Dmembers%26module%3Dmessaging |
| Disallow | /forum/*%26p%3D |
| Disallow | /forum/*%26pid%3D |
| Disallow | /forum/*%26hl%3D |
| Disallow | /forum/*%26start%3D |
| Disallow | /forum/*view__getnewpost$ |
| Disallow | /forum/*view__getlastpost$ |
| Disallow | /forum/*view__old$ |
| Disallow | /forum/*view__new$ |
| Disallow | /forum/*view__getfirst$ |
| Disallow | /forum/*view__getprevious$ |
| Disallow | /forum/*view__getnext$ |
| Disallow | /forum/*view__getlast$ |
| Disallow | /forum/*%26view%3Dgetnewpost$ |
| Disallow | /forum/*%26view%3Dgetlastpost$ |
| Disallow | /forum/*%26view%3Dold$ |
| Disallow | /forum/*%26view%3Dnew$ |
| Disallow | /forum/*%26view%3Dgetfirst$ |
| Disallow | /forum/*%26view%3Dgetprevious$ |
| Disallow | /forum/*%26view%3Dgetnext$ |
| Disallow | /forum/*%26view%3Dgetlast$ |
| Disallow | /forum/*?s= |
| Disallow | /forum/*%26s%3D |
| Disallow | /forum/index.php?app=core&module=global§ion=login&do=deleteCookies |
| Disallow | /forum/index.php?app=forums&module=extras§ion=rating |
| Disallow | /forum/index.php?app=forums&module=forums§ion=markasread |
| Disallow | /forum/*%26do%3Dwho |
| Disallow | /forum/*%26section%3Ddname |
| Disallow | /user/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /forum/admin/ |
| Disallow | /forum/cache/ |
| Disallow | /forum/converge_local/ |
| Disallow | /forum/hooks/ |
| Disallow | /forum/ips_kernel/ |
| Disallow | /forum/retail/ |
| Disallow | /forum/public/style_captcha/ |
| Disallow | /forum/index.php?app=core&module=task |
| Disallow | /forum/index.php?app=forums&module=moderate§ion=moderate |
| Disallow | /forum/index.php?app=forums&module=extras§ion=forward |
| Disallow | /forum/index.php?app=members&module=chat |
| Disallow | /forum/index.php?&unlockUserAgent=1 |
| Disallow | /forum/*%26module%3Dsearch |
| Allow | /forum/*%26search_tags%3D |
| Disallow | /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation |
| Disallow | /forum/*app%3Dcore%26module%3Dusercp |
| Disallow | /forum/*app%3Dmembers%26module%3Dmessaging |
| Disallow | /index.php?app=members* |
| Disallow | /forum/*%26p%3D |
| Disallow | /forum/*%26pid%3D |
| Disallow | /forum/*%26hl%3D |
| Disallow | /forum/*%26start%3D |
| Disallow | /forum/*view__getnewpost$ |
| Disallow | /forum/*view__getlastpost$ |
| Disallow | /forum/*view__old$ |
| Disallow | /forum/*view__new$ |
| Disallow | /forum/*view__getfirst$ |
| Disallow | /forum/*view__getprevious$ |
| Disallow | /forum/*view__getnext$ |
| Disallow | /forum/*view__getlast$ |
| Disallow | /forum/*%26view%3Dgetnewpost$ |
| Disallow | /forum/*%26view%3Dgetlastpost$ |
| Disallow | /forum/*%26view%3Dold$ |
| Disallow | /forum/*%26view%3Dnew$ |
| Disallow | /forum/*%26view%3Dgetfirst$ |
| Disallow | /forum/*%26view%3Dgetprevious$ |
| Disallow | /forum/*%26view%3Dgetnext$ |
| Disallow | /forum/*%26view%3Dgetlast$ |
| Disallow | /forum/*?s= |
| Disallow | /forum/*%26s%3D |
| Disallow | /forum/index.php?app=core&module=global§ion=login&do=deleteCookies |
| Disallow | /forum/index.php?app=forums&module=extras§ion=rating |
| Disallow | /forum/index.php?app=forums&module=forums§ion=markasread |
| Disallow | /forum/*%26do%3Dwho |
| Disallow | /forum/*%26section%3Ddname |
| Disallow | /user/ |
google
| Rule | Path |
|---|---|
| Disallow | /index.php?app=members* |
| Disallow | /forum/admin/ |
| Disallow | /forum/cache/ |
| Disallow | /forum/converge_local/ |
| Disallow | /forum/hooks/ |
| Disallow | /forum/ips_kernel/ |
| Disallow | /forum/retail/ |
| Disallow | /forum/public/style_captcha/ |
| Disallow | /forum/index.php?app=core&module=task |
| Disallow | /forum/index.php?app=forums&module=moderate§ion=moderate |
| Disallow | /forum/index.php?app=forums&module=extras§ion=forward |
| Disallow | /forum/index.php?app=members&module=chat |
| Disallow | /forum/index.php?&unlockUserAgent=1 |
| Disallow | /forum/*%26module%3Dsearch |
| Allow | /forum/*%26search_tags%3D |
| Disallow | /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation |
| Disallow | /forum/*app%3Dcore%26module%3Dusercp |
| Disallow | /forum/*app%3Dmembers%26module%3Dmessaging |
| Disallow | /forum/*%26p%3D |
| Disallow | /forum/*%26pid%3D |
| Disallow | /forum/*%26hl%3D |
| Disallow | /forum/*%26start%3D |
| Disallow | /forum/*view__getnewpost$ |
| Disallow | /forum/*view__getlastpost$ |
| Disallow | /forum/*view__old$ |
| Disallow | /forum/*view__new$ |
| Disallow | /forum/*view__getfirst$ |
| Disallow | /forum/*view__getprevious$ |
| Disallow | /forum/*view__getnext$ |
| Disallow | /forum/*view__getlast$ |
| Disallow | /forum/*%26view%3Dgetnewpost$ |
| Disallow | /forum/*%26view%3Dgetlastpost$ |
| Disallow | /forum/*%26view%3Dold$ |
| Disallow | /forum/*%26view%3Dnew$ |
| Disallow | /forum/*%26view%3Dgetfirst$ |
| Disallow | /forum/*%26view%3Dgetprevious$ |
| Disallow | /forum/*%26view%3Dgetnext$ |
| Disallow | /forum/*%26view%3Dgetlast$ |
| Disallow | /forum/*?s= |
| Disallow | /forum/*%26s%3D |
| Disallow | /forum/index.php?app=core&module=global§ion=login&do=deleteCookies |
| Disallow | /forum/index.php?app=forums&module=extras§ion=rating |
| Disallow | /forum/index.php?app=forums&module=forums§ion=markasread |
| Disallow | /forum/*%26do%3Dwho |
| Disallow | /forum/*%26section%3Ddname |
| Disallow | /user/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /index.php?app=members* |
| Disallow | /forum/admin/ |
| Disallow | /forum/cache/ |
| Disallow | /forum/converge_local/ |
| Disallow | /forum/hooks/ |
| Disallow | /forum/ips_kernel/ |
| Disallow | /forum/retail/ |
| Disallow | /forum/public/style_captcha/ |
| Disallow | /forum/index.php?app=core&module=task |
| Disallow | /forum/index.php?app=forums&module=moderate§ion=moderate |
| Disallow | /forum/index.php?app=forums&module=extras§ion=forward |
| Disallow | /forum/index.php?app=members&module=chat |
| Disallow | /forum/index.php?&unlockUserAgent=1 |
| Disallow | /forum/*%26module%3Dsearch |
| Allow | /forum/*%26search_tags%3D |
| Disallow | /forum/*app%3Dcore%26module%3Dglobal%26section%3Dreputation |
| Disallow | /forum/*app%3Dcore%26module%3Dusercp |
| Disallow | /forum/*app%3Dmembers%26module%3Dmessaging |
| Disallow | /forum/*%26p%3D |
| Disallow | /forum/*%26pid%3D |
| Disallow | /forum/*%26hl%3D |
| Disallow | /forum/*%26start%3D |
| Disallow | /forum/*view__getnewpost$ |
| Disallow | /forum/*view__getlastpost$ |
| Disallow | /forum/*view__old$ |
| Disallow | /forum/*view__new$ |
| Disallow | /forum/*view__getfirst$ |
| Disallow | /forum/*view__getprevious$ |
| Disallow | /forum/*view__getnext$ |
| Disallow | /forum/*view__getlast$ |
| Disallow | /forum/*%26view%3Dgetnewpost$ |
| Disallow | /forum/*%26view%3Dgetlastpost$ |
| Disallow | /forum/*%26view%3Dold$ |
| Disallow | /forum/*%26view%3Dnew$ |
| Disallow | /forum/*%26view%3Dgetfirst$ |
| Disallow | /forum/*%26view%3Dgetprevious$ |
| Disallow | /forum/*%26view%3Dgetnext$ |
| Disallow | /forum/*%26view%3Dgetlast$ |
| Disallow | /forum/*?s= |
| Disallow | /forum/*%26s%3D |
| Disallow | /forum/index.php?app=core&module=global§ion=login&do=deleteCookies |
| Disallow | /forum/index.php?app=forums&module=extras§ion=rating |
| Disallow | /forum/index.php?app=forums&module=forums§ion=markasread |
| Disallow | /forum/*%26do%3Dwho |
| Disallow | /forum/*%26section%3Ddname |
| Disallow | /user/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://darkcrime.pm/sitemap.xml |
Warnings
- `host` is not a known field.