vsegoroskopy.ru
robots.txt
Robots Exclusion Standard data for vsegoroskopy.ru
Resource Scan
Scan Details
Site Domain | vsegoroskopy.ru |
Base Domain | vsegoroskopy.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-03-01T15:08:19+00:00 |
Next Scan | 2025-03-15T15:08:19+00:00 |
Last Successful Scan
Scanned | 2025-02-14T15:07:26+00:00 |
URL | https://vsegoroskopy.ru/robots.txt |
Domain IPs | 77.222.40.34 |
Response IP | 77.222.40.34 |
Found | Yes |
Hash | 685cbf98169a8e6935d9bbb7d6d34a17d3caa49b2ee5622fbdefdf2881000542 |
SimHash | c0082a710730 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /agreement.php |
Disallow | /confidentiality.php |
Disallow | /contact.php |
Disallow | /den/ |
Disallow | /denm/ |
Disallow | /fin/ |
Disallow | /finm/ |
Disallow | /lovely/ |
Disallow | /lovelym/ |
Disallow | /ezhednevnyi-goroskop/ |
Other Records
Field | Value |
---|---|
sitemap | https://vsegoroskopy.ru/sitemap.xml |
Warnings
- `host` is not a known field.