youtube.pr
robots.txt
Robots Exclusion Standard data for youtube.pr
Resource Scan
Scan Details
Site Domain | youtube.pr |
Base Domain | youtube.pr |
Scan Status | Ok |
Last Scan | 2024-05-13T01:56:13+00:00 |
Next Scan | 2024-05-20T01:56:13+00:00 |
Last Scan
Scanned | 2024-05-13T01:56:13+00:00 |
URL | https://youtube.pr/robots.txt |
Redirect | https://www.youtube.com/robots.txt?gl=PR |
Redirect Domain | www.youtube.com |
Redirect Base | youtube.com |
Domain IPs | 2404:6800:4003:c03::5b, 2404:6800:4003:c03::5d, 2404:6800:4003:c03::88, 2404:6800:4003:c03::be, 74.125.68.136, 74.125.68.190, 74.125.68.91, 74.125.68.93 |
Redirect IPs | 142.251.175.136, 142.251.175.190, 142.251.175.91, 142.251.175.93, 2404:6800:4003:c02::5b, 2404:6800:4003:c02::5d, 2404:6800:4003:c02::be, 2404:6800:4003:c1a::5d, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93, 74.125.24.136, 74.125.24.190, 74.125.24.91, 74.125.24.93, 74.125.68.136, 74.125.68.190, 74.125.68.91, 74.125.68.93 |
Response IP | 142.251.10.190 |
Found | Yes |
Hash | a17a3f9a55a88f8b811b32a4219f101b7ded8ab4f407585aafdd8cd548089b4c |
SimHash | 66255741ed12 |
Groups
*
Rule | Path |
---|---|
Disallow | /comment |
Disallow | /feeds/videos.xml |
Disallow | /get_video |
Disallow | /get_video_info |
Disallow | /get_midroll_info |
Disallow | /live_chat |
Disallow | /login |
Disallow | /qr |
Disallow | /results |
Disallow | /signup |
Disallow | /t/terms |
Disallow | /timedtext_video |
Disallow | /verify_age |
Disallow | /watch_ajax |
Disallow | /watch_fragments_ajax |
Disallow | /watch_popup |
Disallow | /watch_queue_ajax |
Other Records
Field | Value |
---|---|
sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
sitemap | https://www.youtube.com/product/sitemap.xml |
Comments