списокфирм.рф
robots.txt
Robots Exclusion Standard data for списокфирм.рф
Resource Scan
Scan Details
| Site Domain | списокфирм.рф |
| Base Domain | списокфирм.рф |
| Scan Status | Ok |
| Last Scan | 2025-10-12T14:31:46+00:00 |
| Next Scan | 2025-10-19T14:31:46+00:00 |
Last Scan
| Scanned | 2025-10-12T14:31:46+00:00 |
| URL | https://списокфирм.рф/robots.txt |
| Redirect | https://xn--h1aafjhelcc6a.xn--p1ai/robots.txt |
| Domain IPs | 193.168.131.40 |
| Response IP | 193.168.131.40 |
| Found | Yes |
| Hash | 043ae1cd91df6c5116444a2de4814fa3c61bc673af24905203c42574c976be40 |
| SimHash | 2310fc5e0593 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /red.php |
| Disallow | /img/mail/ |
| Disallow | /admin/ |
| Disallow | /cost1/ |
| Disallow | /add_org.php |
| Disallow | /search.php |
| Disallow | /block.php |
| Disallow | /edit_firm/ |
| Disallow | /login.php |
| Disallow | /conf.php |
| Disallow | /company-verification-search.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 7 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/sitemap.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/sitemap-cat.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/sitemap-podcat.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-0.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-1.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-2.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-3.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-4.xml |
| sitemap | https://xn--h1aafjhelcc6a.xn--p1ai/mapsite/all-company/sitemap-company-5.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.