youtube.com.kw
robots.txt

Robots Exclusion Standard data for youtube.com.kw

Resource Scan

Scan Details

Site Domain youtube.com.kw
Base Domain youtube.com.kw
Scan Status Ok
Last Scan2024-11-09T01:35:48+00:00
Next Scan 2024-11-16T01:35:48+00:00

Last Scan

Scanned2024-11-09T01:35:48+00:00
URL https://youtube.com.kw/robots.txt
Redirect https://www.youtube.com/robots.txt?gl=KW
Redirect Domain www.youtube.com
Redirect Base youtube.com
Domain IPs 2404:6800:4003:c11::5b, 2404:6800:4003:c11::5d, 2404:6800:4003:c11::88, 2404:6800:4003:c11::be, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93
Redirect IPs 142.250.4.190, 172.253.118.136, 172.253.118.190, 172.253.118.91, 172.253.118.93, 2404:6800:4003:c03::5b, 2404:6800:4003:c03::5d, 2404:6800:4003:c03::88, 2404:6800:4003:c03::be, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93, 74.125.68.136, 74.125.68.190, 74.125.68.91
Response IP 74.125.200.91
Found Yes
Hash 604d020df2b902e1cfb66a242043cadf464c0e540d654402b10508a2c663e8bc
SimHash 64255701ed12

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /api/
Disallow /comment
Disallow /feeds/videos.xml
Disallow /get_video
Disallow /get_video_info
Disallow /get_midroll_info
Disallow /live_chat
Disallow /login
Disallow /qr
Disallow /results
Disallow /signup
Disallow /t/terms
Disallow /timedtext_video
Disallow /verify_age
Disallow /watch_ajax
Disallow /watch_fragments_ajax
Disallow /watch_popup
Disallow /watch_queue_ajax
Disallow /youtubei/

Other Records

Field Value
sitemap https://www.youtube.com/sitemaps/sitemap.xml
sitemap https://www.youtube.com/product/sitemap.xml

Comments

  • robots.txt file for YouTube
  • Created in the distant future (the year 2000) after
  • the robotic uprising of the mid 90's which wiped out all humans.