youtube.com.by
robots.txt
Robots Exclusion Standard data for youtube.com.by
Resource Scan
Scan Details
| Site Domain | youtube.com.by |
| Base Domain | youtube.com.by |
| Scan Status | Ok |
| Last Scan | 2024-11-12T18:30:49+00:00 |
| Next Scan | 2024-11-19T18:30:49+00:00 |
Last Scan
| Scanned | 2024-11-12T18:30:49+00:00 |
| URL | https://youtube.com.by/robots.txt |
| Redirect | https://www.youtube.com/robots.txt?gl=BY |
| Redirect Domain | www.youtube.com |
| Redirect Base | youtube.com |
| Domain IPs | 2404:6800:4003:c00::5b, 2404:6800:4003:c00::5d, 2404:6800:4003:c00::88, 2404:6800:4003:c00::be, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93 |
| Redirect IPs | 142.251.175.136, 142.251.175.190, 142.251.175.91, 142.251.175.93, 2404:6800:4003:c00::88, 2404:6800:4003:c00::be, 2404:6800:4003:c05::5b, 2404:6800:4003:c05::5d, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93, 74.125.130.136, 74.125.130.91, 74.125.130.93, 74.125.24.93, 74.125.68.136, 74.125.68.190, 74.125.68.91, 74.125.68.93 |
| Response IP | 172.253.118.190 |
| Found | Yes |
| Hash | 604d020df2b902e1cfb66a242043cadf464c0e540d654402b10508a2c663e8bc |
| SimHash | 64255701ed12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /comment |
| Disallow | /feeds/videos.xml |
| Disallow | /get_video |
| Disallow | /get_video_info |
| Disallow | /get_midroll_info |
| Disallow | /live_chat |
| Disallow | /login |
| Disallow | /qr |
| Disallow | /results |
| Disallow | /signup |
| Disallow | /t/terms |
| Disallow | /timedtext_video |
| Disallow | /verify_age |
| Disallow | /watch_ajax |
| Disallow | /watch_fragments_ajax |
| Disallow | /watch_popup |
| Disallow | /watch_queue_ajax |
| Disallow | /youtubei/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
| sitemap | https://www.youtube.com/product/sitemap.xml |
Comments