Log In Sign Up

picks.cbssports.com
robots.txt

Robots Exclusion Standard data for picks.cbssports.com

Resource Scan

Scan Details

Site Domain picks.cbssports.com
Base Domain cbssports.com
Scan Status Ok
Last Scan2024-09-11T08:40:26+00:00
Next Scan 2024-10-11T08:40:26+00:00

Last Scan

Scanned2024-09-11T08:40:26+00:00
URL https://picks.cbssports.com/robots.txt
Domain IPs 151.101.1.188, 151.101.129.188, 151.101.193.188, 151.101.65.188
Response IP 151.101.1.188
Found Yes
Hash e50406bb976eadfcdb6c786f4516738432de222447210dd938c902f4d96c58b1
SimHash 44051854d791

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /
Allow /college-basketball/*/bracket/*

twitterbot

Rule Path
Disallow /
Allow /college-basketball/*/bracket/*
Allow /static/game-assets/*

facebookexternalhit/1.1

Rule Path
Disallow /
Allow /college-basketball/*/bracket/*
Allow /static/game-assets/*

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow /
Allow /college-basketball/*/bracket/*
Allow /static/game-assets/*

facebookcatalog/1.0

Rule Path
Disallow /
Allow /college-basketball/*/bracket/*
Allow /static/game-assets/*
Back to top

Other Records

Field Value
sitemap https://picks.cbssports.com/sitemap.xml
Back to top