techinsider.ru
robots.txt
Robots Exclusion Standard data for techinsider.ru
Resource Scan
Scan Details
| Site Domain | techinsider.ru |
| Base Domain | techinsider.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-29T05:45:47+00:00 |
| Next Scan | 2024-07-06T05:45:47+00:00 |
Last Scan
| Scanned | 2024-06-29T05:45:47+00:00 |
| URL | https://techinsider.ru/robots.txt |
| Redirect | https://www.techinsider.ru/robots.txt |
| Redirect Domain | www.techinsider.ru |
| Redirect Base | techinsider.ru |
| Domain IPs | 51.250.102.195 |
| Redirect IPs | 193.17.93.93, 2a11:27c0::93 |
| Response IP | 193.17.93.93 |
| Found | Yes |
| Hash | ab90df728ffa3e678283394b7d5be23c5b19838591401a5abf078ead5f80be30 |
| SimHash | 65b54e4f0383 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /auth/ |
| Disallow | /profile/ |
| Disallow | /search/ |
| Disallow | /options/ |
| Disallow | /draft/ |
| Disallow | /email/confirm/ |
| Disallow | /changepassword/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.techinsider.ru/sitemap.xml |
| sitemap | https://www.techinsider.ru/sitemap/foto1-utf8.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.