thebaseballcube.com
robots.txt
Robots Exclusion Standard data for thebaseballcube.com
Resource Scan
Scan Details
Site Domain | thebaseballcube.com |
Base Domain | thebaseballcube.com |
Scan Status | Ok |
Last Scan | 2024-11-17T10:42:59+00:00 |
Next Scan | 2024-11-24T10:42:59+00:00 |
Last Scan
Scanned | 2024-11-17T10:42:59+00:00 |
URL | https://thebaseballcube.com/robots.txt |
Domain IPs | 76.12.157.26 |
Response IP | 76.12.157.26 |
Found | Yes |
Hash | 022d032fdc8ea1c433ffbd2d60513d211caccdaf9ed57a5d6a0cb1c80c4bfa8b |
SimHash | 4359cc504774 |
Groups
*
Rule | Path |
---|---|
Allow | / |
bingbot
Rule | Path |
---|---|
Disallow | /content/search/ |
Disallow | /content2/ |
Disallow | /content2_test/ |
Disallow | /content/player_test/ |
Disallow | /admin/ |
Disallow | /daily_baseball/ |
Disallow | /accounts/ |
Disallow | /premium/ |
Disallow | /tracker/ |
Disallow | /content/tracker/ |
Disallow | /actions/ |
Disallow | /softball/ |
Disallow | /content/actions/ |
Disallow | /ftp_tbc/ |
Disallow | /TBC_OLD/ |
Disallow | /data/ |
Disallow | /sim/ |
Disallow | /mobile/ |
Disallow | /playground/ |
Disallow | /account/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |