pravavse-online.ru
robots.txt
Robots Exclusion Standard data for pravavse-online.ru
Resource Scan
Scan Details
| Site Domain | pravavse-online.ru |
| Base Domain | pravavse-online.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-06-15T23:20:54+00:00 |
| Next Scan | 2024-06-22T23:20:54+00:00 |
Last Successful Scan
| Scanned | 2024-05-15T23:20:17+00:00 |
| URL | https://www.pravavse-online.ru/robots.txt |
| Domain IPs | 104.21.49.94, 172.67.143.157, 2606:4700:3031::ac43:8f9d, 2606:4700:3037::6815:315e |
| Response IP | 104.21.49.94 |
| Found | Yes |
| Hash | 7b3093258ac0d019de927e936962d4ffd2fcb8591a741dfdc39d8a45ba2dd2ed |
| SimHash | 0d015e6fc590 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /city |
| Disallow | /faq |
| Disallow | /zvonok_ok |
| Disallow | /oplata_i_dostavka |
| Disallow | /documenty |
| Disallow | /otzivy |
| Disallow | /contacts |
| Disallow | /?admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pravavse-online.ru/sitemap.php |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.