youtu.be
robots.txt

Robots Exclusion Standard data for youtu.be

Resource Scan

Scan Details

Site Domain youtu.be
Base Domain youtu.be
Scan Status Ok
Last Scan2024-05-02T16:30:27+00:00
Next Scan 2024-05-16T16:30:27+00:00

Last Scan

Scanned2024-05-02T16:30:27+00:00
URL https://youtu.be/robots.txt
Domain IPs 2404:6800:4003:c1a::5b, 2404:6800:4003:c1a::5d, 2404:6800:4003:c1a::88, 2404:6800:4003:c1a::be, 74.125.130.136, 74.125.130.190, 74.125.130.91, 74.125.130.93
Response IP 74.125.24.91
Found Yes
Hash 4d9a2d48439a53a807c4f94b3610fe9ffb28e1a903d2a9b4e295c20388e9a79c
SimHash 82009bc16ff2

Groups

*

Rule Path
Disallow /
Allow /apple-app-site-association
Allow /.well-known/*

Comments

  • robots.txt file for youtu.be