Log In Sign Up

il.youtube.com
robots.txt

Robots Exclusion Standard data for il.youtube.com

Resource Scan

Scan Details

Site Domain il.youtube.com
Base Domain youtube.com
Scan Status Ok
Last Scan2024-04-22T19:14:10+00:00
Next Scan 2024-05-06T19:14:10+00:00

Last Scan

Scanned2024-04-22T19:14:10+00:00
URL https://il.youtube.com/robots.txt
Redirect https://www.youtube.com/robots.txt?gl=IL
Redirect Domain www.youtube.com
Redirect Base youtube.com
Domain IPs 142.251.175.136, 142.251.175.190, 142.251.175.91, 142.251.175.93, 2404:6800:4003:c01::5b, 2404:6800:4003:c01::5d, 2404:6800:4003:c01::88, 2404:6800:4003:c01::be, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93, 74.125.68.136, 74.125.68.190, 74.125.68.91, 74.125.68.93
Redirect IPs 142.250.4.136, 142.250.4.91, 142.251.10.136, 142.251.10.190, 142.251.10.91, 142.251.10.93, 142.251.175.136, 142.251.175.190, 142.251.175.91, 142.251.175.93, 172.217.194.91, 2404:6800:4003:c05::5d, 2404:6800:4003:c05::be, 2404:6800:4003:c11::5b, 2404:6800:4003:c11::be, 64.233.170.93, 74.125.24.136, 74.125.24.190, 74.125.24.91, 74.125.24.93
Response IP 74.125.24.91
Found Yes
Hash a17a3f9a55a88f8b811b32a4219f101b7ded8ab4f407585aafdd8cd548089b4c
SimHash 66255741ed12

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /comment
Disallow /feeds/videos.xml
Disallow /get_video
Disallow /get_video_info
Disallow /get_midroll_info
Disallow /live_chat
Disallow /login
Disallow /qr
Disallow /results
Disallow /signup
Disallow /t/terms
Disallow /timedtext_video
Disallow /verify_age
Disallow /watch_ajax
Disallow /watch_fragments_ajax
Disallow /watch_popup
Disallow /watch_queue_ajax
Back to top

Other Records

Field Value
sitemap https://www.youtube.com/sitemaps/sitemap.xml
sitemap https://www.youtube.com/product/sitemap.xml
Back to top

Comments

  • robots.txt file for YouTube
  • Created in the distant future (the year 2000) after
  • the robotic uprising of the mid 90's which wiped out all humans.
Back to top