uniloader.pro
robots.txt
Robots Exclusion Standard data for uniloader.pro
Resource Scan
Scan Details
Site Domain | uniloader.pro |
Base Domain | uniloader.pro |
Scan Status | Ok |
Last Scan | 2024-11-07T23:55:34+00:00 |
Next Scan | 2024-11-14T23:55:34+00:00 |
Last Scan
Scanned | 2024-11-07T23:55:34+00:00 |
URL | https://uniloader.pro/robots.txt |
Domain IPs | 104.21.5.155, 172.67.133.135, 2606:4700:3030::ac43:8587, 2606:4700:3037::6815:59b |
Response IP | 104.21.5.155 |
Found | Yes |
Hash | 17a6f2f664cca8b3eabb3942d39ae4f28df4b3c929e792c3633fb68fb53fc00a |
SimHash | c30ddcd5a151 |
Groups
*
Rule | Path |
---|---|
Disallow | *?wu=* |
Disallow | /_next/data |
Disallow | /_next/image |
Disallow | /api |
Disallow | /user |
Disallow | /_captcha |
Disallow | /download-video-from-youtube |
Disallow | /error |
Disallow | /eula |
Disallow | /eula-helper |
Disallow | /eula-screenshoter |
Disallow | /offline |
Disallow | /outdated-browser |
Disallow | /post-remove-client |
Disallow | /post-remove-helper |
Disallow | /privacy |
Disallow | /privacy-helper |
Disallow | /privacy-screenshoter |
Disallow | /pwa |
Disallow | /pwa-instruction-ubuntu |
Disallow | /store |
Disallow | /vid-adult |
Disallow | /vid-error |
Disallow | /vid-ssr |
Disallow | /welcome-ext-installed |
Disallow | /welcome-exts-installed |
Other Records
Field | Value |
---|---|
sitemap | https://uniloader.pro/sitemap-index.xml |