thebaseballcube.com
robots.txt

Robots Exclusion Standard data for thebaseballcube.com

Resource Scan

Scan Details

Site Domain thebaseballcube.com
Base Domain thebaseballcube.com
Scan Status Ok
Last Scan2024-11-17T10:42:59+00:00
Next Scan 2024-11-24T10:42:59+00:00

Last Scan

Scanned2024-11-17T10:42:59+00:00
URL https://thebaseballcube.com/robots.txt
Domain IPs 76.12.157.26
Response IP 76.12.157.26
Found Yes
Hash 022d032fdc8ea1c433ffbd2d60513d211caccdaf9ed57a5d6a0cb1c80c4bfa8b
SimHash 4359cc504774

Groups

*

Rule Path
Allow /

bingbot

Rule Path
Disallow /content/search/
Disallow /content2/
Disallow /content2_test/
Disallow /content/player_test/
Disallow /admin/
Disallow /daily_baseball/
Disallow /accounts/
Disallow /premium/
Disallow /tracker/
Disallow /content/tracker/
Disallow /actions/
Disallow /softball/
Disallow /content/actions/
Disallow /ftp_tbc/
Disallow /TBC_OLD/
Disallow /data/
Disallow /sim/
Disallow /mobile/
Disallow /playground/
Disallow /account/

Other Records

Field Value
crawl-delay 10