deti-karusel.ru
robots.txt
Robots Exclusion Standard data for deti-karusel.ru
Resource Scan
Scan Details
| Site Domain | deti-karusel.ru |
| Base Domain | deti-karusel.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-13T07:06:14+00:00 |
| Next Scan | 2024-07-13T07:06:14+00:00 |
Last Scan
| Scanned | 2024-06-13T07:06:14+00:00 |
| URL | https://www.deti-karusel.ru/robots.txt |
| Domain IPs | 104.21.23.128, 172.67.211.71, 2606:4700:3032::6815:1780, 2606:4700:3037::ac43:d347 |
| Response IP | 104.21.23.128 |
| Found | Yes |
| Hash | a398ff6981583b02ee5ce303edb62cb3a689fd8e26c7a984b7ee75114a5a8cf3 |
| SimHash | 2f605fe58058 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /search |
| Disallow | */trackback |
| Disallow | */comments/ |
| Disallow | /?feed= |
| Disallow | /?s= |
| Disallow | */page/* |
| Disallow | /?wp-subscription-manager* |
| Disallow | */comment |
| Disallow | */tag/* |
| Disallow | */attachment/* |
| Disallow | /general |
| Allow | /wp-content/uploads/ |
| Disallow | /noindex/* |
| Disallow | /noindex |
| Disallow | /wp-json/oembed/1.0/embed* |
| Disallow | /poisk?searchid* |
| Disallow | */feed/ |
| Disallow | */feed |
| Disallow | */amp |
| Disallow | *?* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |