lightcast.com
robots.txt

Robots Exclusion Standard data for lightcast.com

Resource Scan

Scan Details

Site Domain lightcast.com
Base Domain lightcast.com
Scan Status Ok
Last Scan2024-11-08T21:15:05+00:00
Next Scan 2024-11-15T21:15:05+00:00

Last Scan

Scanned2024-11-08T21:15:05+00:00
URL https://lightcast.com/robots.txt
Domain IPs 5.254.43.90
Response IP 5.254.43.90
Found Yes
Hash c1fcdde2725d7b2c3f83ada9550aee738c728583d246d094561dc0bbf15d3da3
SimHash a85cafd7ef65

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /p/
Disallow /googletv/
Disallow /site/
Disallow /terms/
Disallow /login/
Disallow /roku-channel-costs/
Disallow /static/clients/
Disallow /user/
Allow /site/css/
Allow /site/images/
Allow /site/js/
Allow /site/content/
Disallow /embed/

googlebot

Rule Path
Allow /
Disallow /api/
Disallow /p/
Disallow /googletv/
Disallow /site/
Disallow /terms/
Disallow /login/
Disallow /roku-channel-costs/
Disallow /static/clients/
Disallow /user/
Allow /site/css/
Allow /site/images/
Allow /site/js/
Allow /site/content/
Disallow /embed/
Allow /*?action=podcast&*
Allow /*?action=googleplay_podcast&*
Allow /*?action=itunes_feed&*

Comments

  • Add the same rule but for Googlebot because there are some different exceptions for it
  • Allow Googlebot to access Podcasts feeds