unidownloader.com
robots.txt
Robots Exclusion Standard data for unidownloader.com
Resource Scan
Scan Details
| Site Domain | unidownloader.com |
| Base Domain | unidownloader.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T09:55:55+00:00 |
| Next Scan | 2024-11-20T09:55:55+00:00 |
Last Scan
| Scanned | 2024-11-13T09:55:55+00:00 |
| URL | https://unidownloader.com/robots.txt |
| Redirect | https://unidownloader.ru/robots.txt |
| Redirect Domain | unidownloader.ru |
| Redirect Base | unidownloader.ru |
| Domain IPs | 104.21.24.27, 172.67.216.125, 2606:4700:3035::6815:181b, 2606:4700:3035::ac43:d87d |
| Redirect IPs | 104.21.37.62, 172.67.205.6, 2606:4700:3030::6815:253e, 2606:4700:3032::ac43:cd06 |
| Response IP | 104.21.37.62 |
| Found | Yes |
| Hash | 912d98fad3f8c9be03496aa48a58c6ff7b277f2232362e7b352d696240ba4eaf |
| SimHash | 63df2455a8d1 |
Groups
yandex
yandexmobilebot
yandexaccessibilitybot
yandexrenderresourcesbot
yandexuserproxy
*
| Rule | Path |
|---|---|
| Disallow | *?wu=* |
| Disallow | /_next/data |
| Disallow | /_next/image |
| Disallow | /api |
| Disallow | /user |
| Disallow | /_captcha |
| Disallow | /download-video-from-youtube |
| Disallow | /error |
| Disallow | /eula |
| Disallow | /eula-helper |
| Disallow | /eula-screenshoter |
| Disallow | /offline |
| Disallow | /outdated-browser |
| Disallow | /post-remove-client |
| Disallow | /post-remove-helper |
| Disallow | /privacy |
| Disallow | /privacy-helper |
| Disallow | /privacy-screenshoter |
| Disallow | /pwa |
| Disallow | /pwa-instruction-ubuntu |
| Disallow | /store |
| Disallow | /vid-adult |
| Disallow | /vid-error |
| Disallow | /vid-ssr |
| Disallow | /welcome-ext-installed |
| Disallow | /welcome-exts-installed |
Other Records
| Field | Value |
|---|---|
| sitemap | https://unidownloader.ru/sitemap-index.xml |
Warnings
- `clean-param` is not a known field.