youtube.com.br
robots.txt
Robots Exclusion Standard data for youtube.com.br
Resource Scan
Scan Details
Site Domain | youtube.com.br |
Base Domain | youtube.com.br |
Scan Status | Ok |
Last Scan | 2024-05-03T20:31:51+00:00 |
Next Scan | 2024-05-10T20:31:51+00:00 |
Last Scan
Scanned | 2024-05-03T20:31:51+00:00 |
URL | https://youtube.com.br/robots.txt |
Redirect | https://www.youtube.com/robots.txt?gl=BR |
Redirect Domain | www.youtube.com |
Redirect Base | youtube.com |
Domain IPs | 2404:6800:4003:c04::5b, 2404:6800:4003:c04::5d, 2404:6800:4003:c04::88, 2404:6800:4003:c04::be, 74.125.24.136, 74.125.24.190, 74.125.24.91, 74.125.24.93 |
Redirect IPs | 142.250.4.190, 142.250.4.91, 142.251.12.190, 142.251.12.91, 142.251.12.93, 172.217.194.136, 172.217.194.190, 172.217.194.91, 172.217.194.93, 172.253.118.136, 172.253.118.190, 172.253.118.91, 172.253.118.93, 2404:6800:4003:c05::5b, 2404:6800:4003:c05::5d, 2404:6800:4003:c06::88, 2404:6800:4003:c06::be, 74.125.200.190, 74.125.200.91, 74.125.200.93 |
Response IP | 64.233.170.136 |
Found | Yes |
Hash | a17a3f9a55a88f8b811b32a4219f101b7ded8ab4f407585aafdd8cd548089b4c |
SimHash | 66255741ed12 |
Groups
*
Rule | Path |
---|---|
Disallow | /comment |
Disallow | /feeds/videos.xml |
Disallow | /get_video |
Disallow | /get_video_info |
Disallow | /get_midroll_info |
Disallow | /live_chat |
Disallow | /login |
Disallow | /qr |
Disallow | /results |
Disallow | /signup |
Disallow | /t/terms |
Disallow | /timedtext_video |
Disallow | /verify_age |
Disallow | /watch_ajax |
Disallow | /watch_fragments_ajax |
Disallow | /watch_popup |
Disallow | /watch_queue_ajax |
Other Records
Field | Value |
---|---|
sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
sitemap | https://www.youtube.com/product/sitemap.xml |
Comments