reshator.com
robots.txt
Robots Exclusion Standard data for reshator.com
Resource Scan
Scan Details
Site Domain | reshator.com |
Base Domain | reshator.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-26T06:52:37+00:00 |
Next Scan | 2024-12-25T06:52:37+00:00 |
Last Successful Scan
Scanned | 2024-03-01T06:49:26+00:00 |
URL | https://reshator.com/robots.txt |
Domain IPs | 104.21.65.237, 172.67.152.198, 2606:4700:3035::ac43:98c6, 2606:4700:3036::6815:41ed |
Response IP | 172.67.152.198 |
Found | Yes |
Hash | 310f9ce03c346d40738d6acbda9f6dd2a895e9788bf76582d6c4e5fbf0990964 |
SimHash | ed3c6ed185ba |
Groups
*
Rule | Path |
---|---|
Disallow | /modules/ |
Disallow | /shop/ |
Disallow | /search/ |
Disallow | */dir/ |
Disallow | /poisk/ |
Disallow | /task/page-* |
Disallow | /copyright-notice/ |
Disallow | /? |
Disallow | /*?* |
Disallow | */page-* |
Disallow | /captcha.php? |
Disallow | /www/ |
Other Records
Field | Value |
---|---|
sitemap | https://reshator.com/sitemap.xml |
Warnings
- `host` is not a known field.