trader-otzyv.ru
robots.txt
Robots Exclusion Standard data for trader-otzyv.ru
Resource Scan
Scan Details
Site Domain | trader-otzyv.ru |
Base Domain | trader-otzyv.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-08-19T10:19:55+00:00 |
Next Scan | 2025-11-17T10:19:55+00:00 |
Last Successful Scan
Scanned | 2025-03-30T07:40:09+00:00 |
URL | https://trader-otzyv.ru/robots.txt |
Redirect | https://trader-otzivi.ru/robots.txt |
Redirect Domain | trader-otzivi.ru |
Redirect Base | trader-otzivi.ru |
Domain IPs | 104.21.10.245, 172.67.164.212, 2606:4700:3032::6815:af5, 2606:4700:3037::ac43:a4d4 |
Redirect IPs | 104.21.53.192, 172.67.217.242, 2606:4700:3030::6815:35c0, 2606:4700:3033::ac43:d9f2 |
Response IP | 172.67.217.242 |
Found | Yes |
Hash | 446dd38fa13960c26cac31770cceecaf5bc77850b961043148cb258e376114fc |
SimHash | 4f359c749796 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-content/cache |
Disallow | /*wp-json/ |
Disallow | */feed/ |
Disallow | /author/ |
Disallow | /trader/ |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | /search |
Disallow | /? |
Disallow | /glavnaya/ |
Disallow | /traders/ |
Disallow | /trader/ |
Disallow | /stati/2/ |
Disallow | *svg%2Bxml* |
yandex
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-content/cache |
Disallow | /*wp-json/ |
Disallow | */feed/ |
Disallow | /author/ |
Disallow | /trader/ |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | /search |
Disallow | /? |
Disallow | /glavnaya/ |
Disallow | /traders/ |
Disallow | /trader/ |
Disallow | /stati/2/ |
Disallow | *svg%2Bxml* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | https://treyder-otzyvy.ru/sitemap_index.xml |
Warnings
- `host` is not a known field.