usicbrand.shop
robots.txt

Robots Exclusion Standard data for usicbrand.shop

Resource Scan

Scan Details

Site Domain usicbrand.shop
Base Domain usicbrand.shop
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-05-18T09:39:41+00:00
Next Scan 2024-08-16T09:39:41+00:00

Last Successful Scan

Scanned2023-10-21T19:12:56+00:00
URL https://usicbrand.shop/robots.txt
Domain IPs 104.21.64.87, 172.67.179.116, 2606:4700:3030::ac43:b374, 2606:4700:3037::6815:4057
Response IP 172.67.179.116
Found Yes
Hash a17a3f9a55a88f8b811b32a4219f101b7ded8ab4f407585aafdd8cd548089b4c
SimHash 66255741ed12

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /comment
Disallow /feeds/videos.xml
Disallow /get_video
Disallow /get_video_info
Disallow /get_midroll_info
Disallow /live_chat
Disallow /login
Disallow /qr
Disallow /results
Disallow /signup
Disallow /t/terms
Disallow /timedtext_video
Disallow /verify_age
Disallow /watch_ajax
Disallow /watch_fragments_ajax
Disallow /watch_popup
Disallow /watch_queue_ajax

Other Records

Field Value
sitemap https://www.youtube.com/sitemaps/sitemap.xml
sitemap https://www.youtube.com/product/sitemap.xml

Comments

  • robots.txt file for YouTube
  • Created in the distant future (the year 2000) after
  • the robotic uprising of the mid 90's which wiped out all humans.