pf1.ru
robots.txt
Robots Exclusion Standard data for pf1.ru
Resource Scan
Scan Details
| Site Domain | pf1.ru |
| Base Domain | pf1.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-25T14:41:22+00:00 |
| Next Scan | 2024-10-02T14:41:22+00:00 |
Last Scan
| Scanned | 2024-09-25T14:41:22+00:00 |
| URL | https://pf1.ru/robots.txt |
| Domain IPs | 31.31.196.163 |
| Response IP | 31.31.196.163 |
| Found | Yes |
| Hash | a68274106668daff069d395bb1e4d080cbaee62e221a8488c4a83c1ec892754c |
| SimHash | 4305c6614f31 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *?st= |
| Disallow | /lofiversion |
| Disallow | /ips_kernel |
| Disallow | /ptopic |
| Disallow | /retail |
| Disallow | /cache |
| Disallow | /user |
| Disallow | /file |
| Disallow | *s0 |
| Disallow | *? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pf1.ru/sitemap.xml |
Warnings
- `host` is not a known field.