youtube.si
robots.txt
Robots Exclusion Standard data for youtube.si
Resource Scan
Scan Details
Site Domain | youtube.si |
Base Domain | youtube.si |
Scan Status | Ok |
Last Scan | 2024-11-13T20:06:50+00:00 |
Next Scan | 2024-11-20T20:06:50+00:00 |
Last Scan
Scanned | 2024-11-13T20:06:50+00:00 |
URL | https://youtube.si/robots.txt |
Redirect | https://www.youtube.com/robots.txt?gl=SI |
Redirect Domain | www.youtube.com |
Redirect Base | youtube.com |
Domain IPs | 2404:6800:4003:c04::5b, 2404:6800:4003:c04::5d, 2404:6800:4003:c04::88, 2404:6800:4003:c04::be, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93 |
Redirect IPs | 142.250.4.136, 142.250.4.91, 142.250.4.93, 172.217.194.91, 172.253.118.136, 172.253.118.190, 172.253.118.91, 172.253.118.93, 2404:6800:4003:c05::5b, 2404:6800:4003:c05::5d, 2404:6800:4003:c05::88, 2404:6800:4003:c06::5b, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93 |
Response IP | 74.125.130.93 |
Found | Yes |
Hash | 604d020df2b902e1cfb66a242043cadf464c0e540d654402b10508a2c663e8bc |
SimHash | 64255701ed12 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /comment |
Disallow | /feeds/videos.xml |
Disallow | /get_video |
Disallow | /get_video_info |
Disallow | /get_midroll_info |
Disallow | /live_chat |
Disallow | /login |
Disallow | /qr |
Disallow | /results |
Disallow | /signup |
Disallow | /t/terms |
Disallow | /timedtext_video |
Disallow | /verify_age |
Disallow | /watch_ajax |
Disallow | /watch_fragments_ajax |
Disallow | /watch_popup |
Disallow | /watch_queue_ajax |
Disallow | /youtubei/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.youtube.com/sitemaps/sitemap.xml |
sitemap | https://www.youtube.com/product/sitemap.xml |
Comments