cf.yidio.com
robots.txt

Robots Exclusion Standard data for cf.yidio.com

Resource Scan

Scan Details

Site Domain cf.yidio.com
Base Domain yidio.com
Scan Status Ok
Last Scan2024-10-29T16:39:28+00:00
Next Scan 2024-11-05T16:39:28+00:00

Last Scan

Scanned2024-10-29T16:39:28+00:00
URL https://cf.yidio.com/robots.txt
Domain IPs 104.22.48.193, 104.22.49.193, 172.67.24.252, 2606:4700:10::6816:30c1, 2606:4700:10::6816:31c1, 2606:4700:10::ac43:18fc
Response IP 104.22.48.193
Found Yes
Hash 36293716d873f6e87dbbad26446f0deeec621c8abad5cd8c36df53a03bf973f3
SimHash eeafd57461b0

Groups

*

Rule Path
Disallow /search*
Disallow /signup_p*
Disallow */watch/*
Disallow /api/WatchNowWidget*
Disallow /epguideadto*
Disallow /outgoing/*
Disallow /user_*
Disallow /epguide*
Disallow /article_admin/*
Disallow /sub_onboard*
Disallow /mobile-onboarding*
Disallow /iframe*
Disallow /combine_*
Disallow /xd_*
Disallow /actions/*
Disallow /get_gall*
Disallow /optout*
Disallow /*/*/*/rating*
Disallow /*/*/rating*
Disallow /*/*/filter/*
Disallow /*/*/*/filter/*
Disallow /*/filter/*/*/*
Disallow /se_*
Disallow /like*
Disallow /queue*
Disallow /reply*
Disallow /net*
Disallow /invite_*
Disallow /ads/*
Disallow /pixels/*

mediapartners-google

Rule Path
Disallow

Comments

  • www-robots.txt
  • Disallow: /login*
  • Disallow: /ajax_*
  • Disallow: /get_ajax*
  • Disallow: /news/*
  • Disallow: /show/*/season-*/episode-*/*