arenda.best
robots.txt
Robots Exclusion Standard data for arenda.best
Resource Scan
Scan Details
| Site Domain | arenda.best |
| Base Domain | arenda.best |
| Scan Status | Ok |
| Last Scan | 2024-11-08T14:20:29+00:00 |
| Next Scan | 2024-11-15T14:20:29+00:00 |
Last Scan
| Scanned | 2024-11-08T14:20:29+00:00 |
| URL | https://arenda.best/robots.txt |
| Domain IPs | 2a03:6f00:1::5c35:60a5, 92.53.96.165 |
| Response IP | 92.53.96.165 |
| Found | Yes |
| Hash | e79de4b6dd31dfd0f712fade7e2cdd4e4303630ffc6d9085a2250c9bad876d54 |
| SimHash | 49049b42e6fb |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /search/map.php |
| Disallow | /bitrix/ |
| Disallow | /search/ |
| Disallow | /upload/ |
| Disallow | /auth/ |
| Disallow | /auth.php |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /*index.php |
| Disallow | /*?SHOWALL_1=1 |
| Disallow | /*clear_cache%3D |
| Disallow | /1.php |
| Disallow | /symlink.php |
| Disallow | /*?bitrix* |
| Disallow | /*?etext=* |
| Disallow | /*?clear_cache=* |
| Disallow | /*?back_url* |
| Disallow | /*?ID=* |
| Disallow | /news/undefined/* |
| Disallow | /*undefined* |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /local/*.js |
| Allow | /local/*.css |
| Allow | /local/*.jpg |
| Allow | /local/*.jpeg |
| Allow | /local/*.png |
| Allow | /local/*.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | https://arenda.best/sitemap.xml |
Warnings
- `host` is not a known field.