Log In Sign Up

cbsnews.com
robots.txt

Robots Exclusion Standard data for cbsnews.com

Resource Scan

Scan Details

Site Domain cbsnews.com
Base Domain cbsnews.com
Scan Status Ok
Last Scan2024-11-16T20:49:25+00:00
Next Scan 2024-11-23T20:49:25+00:00

Last Scan

Scanned2024-11-16T20:49:25+00:00
URL https://cbsnews.com/robots.txt
Redirect https://www.cbsnews.com/robots.txt
Redirect Domain www.cbsnews.com
Redirect Base cbsnews.com
Domain IPs 151.101.1.188, 151.101.129.188, 151.101.193.188, 151.101.65.188
Redirect IPs 146.75.93.188
Response IP 151.101.41.188
Found Yes
Hash 6ad5d1f47f922ce438f7217e01f65129f1e52a6b1512af5832e211a93362dcc5
SimHash e4e7890bc1bc

Groups

*

Rule Path
Disallow */search/*
Disallow /index.php/*
Disallow /election-results-data/*
Disallow /common
Disallow /htdocs/*
Disallow /user/login*
Disallow /app/?*
Disallow /1318
Disallow /1319
Disallow /1328
Disallow /1344
Disallow /1770
Disallow /2240
Disallow /2303
Disallow /2304
Disallow /2305
Disallow /2306
Disallow /2307
Disallow /2308
Disallow /2332
Disallow /2741
Disallow /2994
Disallow /8324
Disallow /8601
Disallow /8614
Disallow /8618
Disallow /9742
Disallow /9744

gptbot

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

proximic

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.cbsnews.com/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/baltimore/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/boston/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/chicago/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/colorado/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/gooddaysacramento/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/detroit/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/texas/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/losangeles/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/cbslocal/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/miami/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/minnesota/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/newyork/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/philadelphia/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/pittsburgh/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/sacramento/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/sanfrancisco/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/general.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/image.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/news.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/video.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/index/collection.xml
sitemap https://www.cbsnews.com/brandstudio/xml-sitemap/video-news.xml
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-US
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-NY
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-LA
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-BOS
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-SF
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-MIN
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-PIT
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-PHI
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-SAC
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DEN
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DAL
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-CHI
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-BAL
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-MIA
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-DET
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-Nature
sitemap https://www.cbsnews.com/live/sitemap.xml?fusionEdition=CBSN-CAR
sitemap https://www.cbsnews.com/xml-sitemap/cbs-essentials.xml
Back to top

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • PER CBS-N ENG FINAL ROUTES DOC
Back to top