youtu.be
robots.txt
Robots Exclusion Standard data for youtu.be
Resource Scan
Scan Details
| Site Domain | youtu.be |
| Base Domain | youtu.be |
| Scan Status | Ok |
| Last Scan | 2024-11-12T05:06:30+00:00 |
| Next Scan | 2024-11-26T05:06:30+00:00 |
Last Scan
| Scanned | 2024-11-12T05:06:30+00:00 |
| URL | https://youtu.be/robots.txt |
| Domain IPs | 2404:6800:4003:c05::5b, 2404:6800:4003:c05::5d, 2404:6800:4003:c05::88, 2404:6800:4003:c05::be, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93 |
| Response IP | 142.251.175.91 |
| Found | Yes |
| Hash | c290485c8002c51c24c95765948dbcec9ec88c1f181638d245418a36194fd1a0 |
| SimHash | a681d324dd12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /comment |
| Disallow | /feeds/videos.xml |
| Disallow | /get_video |
| Disallow | /get_video_info |
| Disallow | /get_midroll_info |
| Disallow | /live_chat |
| Disallow | /login |
| Disallow | /results |
| Disallow | /signup |
| Disallow | /t/terms |
| Disallow | /timedtext_video |
| Disallow | /verify_age |
| Disallow | /watch_ajax |
| Disallow | /watch_fragments_ajax |
| Disallow | /watch_popup |
| Disallow | /watch_queue_ajax |
| Disallow | /youtubei/ |
| Allow | /apple-app-site-association |
| Allow | /.well-known/* |
Comments