thebaseballcube.com
robots.txt
Robots Exclusion Standard data for thebaseballcube.com
Resource Scan
Scan Details
Site Domain | thebaseballcube.com |
Base Domain | thebaseballcube.com |
Scan Status | Ok |
Last Scan | 2024-06-15T01:13:50+00:00 |
Next Scan | 2024-06-22T01:13:50+00:00 |
Last Scan
Scanned | 2024-06-15T01:13:50+00:00 |
URL | https://thebaseballcube.com/robots.txt |
Domain IPs | 76.12.157.26 |
Response IP | 76.12.157.26 |
Found | Yes |
Hash | 2fb01055edb217abd3a9c2aba1dde6c1bd43bf54b7492d04b2cb1a98f18ca4d0 |
SimHash | 4318cc60c37c |
Groups
*
Rule | Path |
---|---|
Allow | / |
bingbot
Rule | Path |
---|---|
Disallow | /content/search/ |
Disallow | /content/research/ |
Disallow | /content/player_test/ |
Disallow | /admin/ |
Disallow | /daily_baseball/ |
Disallow | /accounts/ |
Disallow | /premium/ |
Disallow | /reference/ |
Disallow | /sections/ |
Disallow | /tracker/ |
Disallow | /content/tracker/ |
Disallow | /actions/ |
Disallow | /softball/ |
Disallow | /content/actions/ |
Disallow | /ftp_tbc/ |
Disallow | /TBC_OLD/ |
Disallow | /data/ |
Disallow | /sim/ |
Disallow | /tbc19/ |
Disallow | /24/ |
Disallow | /tbc_2021/ |
Disallow | /football/ |
Disallow | /mobile/ |
Disallow | /playground/ |
Disallow | /account/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |