generator-market.ru
robots.txt
Robots Exclusion Standard data for generator-market.ru
Resource Scan
Scan Details
| Site Domain | generator-market.ru |
| Base Domain | generator-market.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-21T23:50:47+00:00 |
| Next Scan | 2024-10-21T23:50:47+00:00 |
Last Scan
| Scanned | 2024-09-21T23:50:47+00:00 |
| URL | https://generator-market.ru/robots.txt |
| Domain IPs | 141.8.193.61, 2a0a:2b43:59:d5a8:: |
| Response IP | 141.8.193.61 |
| Found | Yes |
| Hash | fb4b4aa3e65b7b63111aeb0505d6efe8d7643cf44943ea3e7a818cc2c8d14939 |
| SimHash | 290db770439d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /images/ |
| Disallow | /administrator/ |
| Disallow | /cache/ |
| Allow | /components/com_jshopping/files/img_products/ |
| Disallow | /components/ |
| Disallow | /includes/ |
| Disallow | /installation/ |
| Disallow | /language/ |
| Disallow | /libraries/ |
| Disallow | /modules/ |
| Disallow | /plugins/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /xmlrpc/ |
| Disallow | /*index2.php? |
| Disallow | /*stats |
| Disallow | /*help |
| Disallow | /*login |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.generator-market.ru/index.php?option=com_xmap&view=xml&tmpl=component&id=1 |
Warnings
- `host` is not a known field.