arhprom.com
robots.txt
Robots Exclusion Standard data for arhprom.com
Resource Scan
Scan Details
| Site Domain | arhprom.com |
| Base Domain | arhprom.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-11-06T03:30:12+00:00 |
| Next Scan | 2024-11-20T03:30:12+00:00 |
Last Successful Scan
| Scanned | 2024-09-29T03:29:30+00:00 |
| URL | https://arhprom.com/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:1:27ec, 2a00:15f8:a000:5:1:12:1:27ec, 2a00:15f8:a000:5:1:13:1:27ec, 2a00:15f8:a000:5:1:14:1:27ec, 90.156.201.101, 90.156.201.106, 90.156.201.12, 90.156.201.37 |
| Response IP | 90.156.201.12 |
| Found | Yes |
| Hash | 935d596dd0670036778d21ab155839a369fad053ca402583461923e0b8e17e3d |
| SimHash | cc0cf91ae7b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | */uploads |
| Disallow | /cgi-bin |
| Disallow | /wp- |
| Disallow | /category/ |
| Disallow | /author/ |
| Disallow | /page/ |
| Disallow | /*page*/ |
| Disallow | /tag/ |
| Disallow | /feed/ |
| Disallow | /*feed |
| Disallow | /trackback |
| Disallow | /comments |
| Disallow | /comment |
| Disallow | /*? |
| Disallow | /*?* |
| Disallow | /date/ |
| Disallow | /sts-cat/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://arhprom.com/sitemap.xml |
Warnings
- `host` is not a known field.