m.youtube.com
robots.txt
Robots Exclusion Standard data for m.youtube.com
Resource Scan
Scan Details
| Site Domain | m.youtube.com |
| Base Domain | youtube.com |
| Scan Status | Ok |
| Last Scan | 2024-04-24T16:27:17+00:00 |
| Next Scan | 2024-05-08T16:27:17+00:00 |
Last Scan
| Scanned | 2024-04-24T16:27:17+00:00 |
| URL | https://m.youtube.com/robots.txt |
| Domain IPs | 172.217.194.100, 172.217.194.101, 172.217.194.102, 172.217.194.113, 172.217.194.138, 172.217.194.139, 2404:6800:4003:c0f::64, 2404:6800:4003:c0f::66, 2404:6800:4003:c0f::71, 2404:6800:4003:c0f::8b |
| Response IP | 172.217.194.101 |
| Found | Yes |
| Hash | f9fc4411486455caa20e2fd7abcd774d6a671596b51ae40be189103c3856f35e |
| SimHash | 063ddd02c4d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /add_favorite |
| Disallow | /videos |
| Disallow | /comment |
| Disallow | /inbox |
| Disallow | /flag |
| Disallow | /forgot |
| Disallow | /get_video |
| Disallow | /manage_playlist |
| Disallow | /mobile_login |
| Disallow | /my_account |
| Disallow | /my_favorites |
| Disallow | /my_playlists |
| Disallow | /my_videos |
| Disallow | /my_videos_upload |
| Disallow | /post_comment |
| Disallow | /profile |
| Disallow | /rating |
| Disallow | /results |
| Disallow | /search_history |
| Disallow | /signup |
| Disallow | /t/privacy |
| Disallow | /t/terms |
| Disallow | /verify_age |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.5 |
Comments