youtube.com.kw
robots.txt
Robots Exclusion Standard data for youtube.com.kw
Resource Scan
Scan Details
Site Domain | youtube.com.kw |
Base Domain | youtube.com.kw |
Scan Status | Ok |
Last Scan | 2024-11-09T01:35:48+00:00 |
Next Scan | 2024-11-16T01:35:48+00:00 |
Last Scan
Scanned | 2024-11-09T01:35:48+00:00 |
URL | https://youtube.com.kw/robots.txt |
Redirect | https://www.youtube.com/robots.txt?gl=KW |
Redirect Domain | www.youtube.com |
Redirect Base | youtube.com |
Domain IPs | 2404:6800:4003:c11::5b, 2404:6800:4003:c11::5d, 2404:6800:4003:c11::88, 2404:6800:4003:c11::be, 64.233.170.136, 64.233.170.190, 64.233.170.91, 64.233.170.93 |
Redirect IPs | 142.250.4.190, 172.253.118.136, 172.253.118.190, 172.253.118.91, 172.253.118.93, 2404:6800:4003:c03::5b, 2404:6800:4003:c03::5d, 2404:6800:4003:c03::88, 2404:6800:4003:c03::be, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93, 74.125.68.136, 74.125.68.190, 74.125.68.91 |
Response IP | 74.125.200.91 |
Found | Yes |
Hash | 604d020df2b902e1cfb66a242043cadf464c0e540d654402b10508a2c663e8bc |
SimHash | 64255701ed12 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /comment |
Disallow | /feeds/videos.xml |
Disallow | /get_video |
Disallow | /get_video_info |
Disallow | /get_midroll_info |
Disallow | /live_chat |
Disallow | /login |
Disallow | /qr |
Disallow | /results |
Disallow | /signup |
Disallow | /t/terms |
Disallow | /timedtext_video |
Disallow | /verify_age |
Disallow | /watch_ajax |
Disallow | /watch_fragments_ajax |
Disallow | /watch_popup |
Disallow | /watch_queue_ajax |
Disallow | /youtubei/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
sitemap | https://www.youtube.com/product/sitemap.xml |
Comments