Log In Sign Up

youtube.is
robots.txt

Robots Exclusion Standard data for youtube.is

Resource Scan

Scan Details

Site Domain youtube.is
Base Domain youtube.is
Scan Status Ok
Last Scan2024-11-11T01:59:01+00:00
Next Scan 2024-11-18T01:59:01+00:00

Last Scan

Scanned2024-11-11T01:59:01+00:00
URL https://youtube.is/robots.txt
Redirect https://www.youtube.com/robots.txt?gl=IS
Redirect Domain www.youtube.com
Redirect Base youtube.com
Domain IPs 172.217.194.136, 172.217.194.190, 172.217.194.91, 172.217.194.93, 2404:6800:4003:c1a::5b, 2404:6800:4003:c1a::5d, 2404:6800:4003:c1a::88, 2404:6800:4003:c1a::be
Redirect IPs 142.250.4.91, 142.250.4.93, 172.253.118.136, 172.253.118.190, 172.253.118.91, 172.253.118.93, 2404:6800:4003:c04::5b, 2404:6800:4003:c11::5b, 2404:6800:4003:c11::88, 2404:6800:4003:c11::be, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93, 74.125.200.136, 74.125.200.190, 74.125.200.91, 74.125.200.93, 74.125.68.136, 74.125.68.190
Response IP 64.233.170.93
Found Yes
Hash 604d020df2b902e1cfb66a242043cadf464c0e540d654402b10508a2c663e8bc
SimHash 64255701ed12

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /api/
Disallow /comment
Disallow /feeds/videos.xml
Disallow /get_video
Disallow /get_video_info
Disallow /get_midroll_info
Disallow /live_chat
Disallow /login
Disallow /qr
Disallow /results
Disallow /signup
Disallow /t/terms
Disallow /timedtext_video
Disallow /verify_age
Disallow /watch_ajax
Disallow /watch_fragments_ajax
Disallow /watch_popup
Disallow /watch_queue_ajax
Disallow /youtubei/
Back to top

Other Records

Field Value
sitemap https://www.youtube.com/sitemaps/sitemap.xml
sitemap https://www.youtube.com/product/sitemap.xml
Back to top

Comments

  • robots.txt file for YouTube
  • Created in the distant future (the year 2000) after
  • the robotic uprising of the mid 90's which wiped out all humans.
Back to top