Log In Sign Up

cbshw.net
robots.txt

Robots Exclusion Standard data for cbshw.net

Resource Scan

Scan Details

Site Domain cbshw.net
Base Domain cbshw.net
Scan Status Ok
Last Scan2024-05-10T22:43:05+00:00
Next Scan 2024-05-17T22:43:05+00:00

Last Scan

Scanned2024-05-10T22:43:05+00:00
URL http://cbshw.net/robots.txt
Redirect https://www.cbsnews.com/robots.txt
Redirect Domain www.cbsnews.com
Redirect Base cbsnews.com
Domain IPs 18.235.102.54, 34.239.33.24, 52.203.57.63
Redirect IPs 151.101.41.188
Response IP 151.101.41.188
Found Yes
Hash f3789c37e990cd9977eaaa7c393f2431dbd7a23e6a710fee346829b4662a2deb
SimHash e4e7891bc5bc

Groups

*

Rule Path
Disallow */search/*
Disallow /index.php/*
Disallow /election-results-data/*
Disallow /common
Disallow /htdocs/*
Disallow /1318
Disallow /1319
Disallow /1328
Disallow /1344
Disallow /1770
Disallow /2240
Disallow /2303
Disallow /2304
Disallow /2305
Disallow /2306
Disallow /2307
Disallow /2308
Disallow /2332
Disallow /2741
Disallow /2994
Disallow /8324
Disallow /8601
Disallow /8614
Disallow /8618
Disallow /9742
Disallow /9744

gptbot

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

proximic

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.cbsnews.com/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-US
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-NY
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-LA
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-BOS
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-SF
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-MIN
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-PIT
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-PHI
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-SAC
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DEN
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DAL
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-CHI
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-BAL
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-MIA
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DET
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-Nature
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-CAR
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • PER CBS-N ENG FINAL ROUTES DOC
Back to top