devilcrafty.net
robots.txt
Robots Exclusion Standard data for devilcrafty.net
Resource Scan
Scan Details
| Site Domain | devilcrafty.net |
| Base Domain | devilcrafty.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-05-31T11:00:03+00:00 |
| Next Scan | 2024-07-30T11:00:03+00:00 |
Last Successful Scan
| Scanned | 2024-03-10T10:58:21+00:00 |
| URL | https://devilcrafty.net/robots.txt |
| Domain IPs | 172.66.40.56, 172.66.43.200, 2606:4700:3108::ac42:2838, 2606:4700:3108::ac42:2bc8 |
| Response IP | 172.66.40.56 |
| Found | Yes |
| Hash | c3037d8c9b874d86676d25f32af84c49c40a9458df0c5f856271f4aeffe1cf89 |
| SimHash | 2d0d03680afa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /applications/ |
| Disallow | /cgi-bin/ |
| Disallow | /datastore/ |
| Disallow | /plugins/ |
| Disallow | /system/ |
| Disallow | /403error.php |
| Disallow | /404error.php |
| Disallow | /500error.php |
| Disallow | /Credits.txt |
| Disallow | /error.php |
| Disallow | /upgrading.html |
| Disallow | /?tab=* |
| Disallow | /index.php?* |
| Disallow | /*?app=* |
| Disallow | /*sortby%3D* |
| Disallow | /*/?do=download |
| Disallow | /profile/*/?do=* |
| Disallow | /profile/*/content/ |
| Disallow | /*?do=add |
| Disallow | /*?do=email |
| Disallow | /*?do=getNewComment |
| Disallow | /*?do=getLastComment |
| Disallow | /*?do=getLastComment |
| Disallow | /*?do=findComment* |
| Allow | /applications/core/interface/imageproxy/imageproxy.php?img=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://devilcrafty.net/sitemap.php |
Warnings
- 1 invalid line.
Comments