web-online24.ru
robots.txt
Robots Exclusion Standard data for web-online24.ru
Resource Scan
Scan Details
| Site Domain | web-online24.ru |
| Base Domain | web-online24.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-21T19:53:33+00:00 |
| Next Scan | 2024-09-28T19:53:33+00:00 |
Last Scan
| Scanned | 2024-09-21T19:53:33+00:00 |
| URL | http://web-online24.ru/robots.txt |
| Domain IPs | 93.189.149.81 |
| Response IP | 93.189.149.81 |
| Found | Yes |
| Hash | 8edf139c9ad62ca3f04723fab4ba721b3d93a4923cd8c874905a79c6f6dffa5b |
| SimHash | 0569d57703b4 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /?feed= |
| Allow | /taganrog |
| Disallow | /tag |
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /?feed= |
| Allow | /taganrog |
| Disallow | /tag |
Other Records
| Field | Value |
|---|---|
| sitemap | http://web-online24.ru/sitemap.xml |
Warnings
- `host` is not a known field.