mlbfancave.mlb.com
robots.txt
Robots Exclusion Standard data for mlbfancave.mlb.com
Resource Scan
Scan Details
| Site Domain | mlbfancave.mlb.com |
| Base Domain | mlb.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-11-07T01:10:45+00:00 |
| Next Scan | 2025-02-05T01:10:45+00:00 |
Last Successful Scan
| Scanned | 2024-06-18T01:05:45+00:00 |
| URL | http://mlbfancave.mlb.com/robots.txt |
| Domain IPs | 23.44.5.200, 23.44.5.243 |
| Response IP | 42.99.140.160 |
| Found | Yes |
| Hash | 9a8eeeaff47bbb7aa3ba6dc6757f79876b25ef272c77d9b807e76e53967a2eb1 |
| SimHash | ed4e45014691 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mlb/gameday/ |
| Disallow | /team/player_career.jsp |
| Disallow | /team/player_news.jsp |
| Disallow | /lookup/ |
| Disallow | /hou/fan_forum/mascot_appearance_form.jsp |
| Disallow | /ws/search/ |
| Disallow | /ana/ |
| Disallow | /ari/ |
| Disallow | /atl/ |
| Disallow | /bal/ |
| Disallow | /bos/ |
| Disallow | /chc/ |
| Disallow | /cin/ |
| Disallow | /cle/ |
| Disallow | /col/ |
| Disallow | /cws/ |
| Disallow | /det/ |
| Disallow | /hou/ |
| Disallow | /kc/ |
| Disallow | /la/ |
| Disallow | /mia/ |
| Disallow | /mil/ |
| Disallow | /min/ |
| Disallow | /nym/ |
| Disallow | /nyy/ |
| Disallow | /oak/ |
| Disallow | /phi/ |
| Disallow | /pit/ |
| Disallow | /sd/ |
| Disallow | /sea/ |
| Disallow | /sf/ |
| Disallow | /stl/ |
| Disallow | /tb/ |
| Disallow | /tex/ |
| Disallow | /tor/ |
| Disallow | /was/ |
| Disallow | /es/ana/ |
| Disallow | /es/ari/ |
| Disallow | /es/atl/ |
| Disallow | /es/bal/ |
| Disallow | /es/bos/ |
| Disallow | /es/chc/ |
| Disallow | /es/cin/ |
| Disallow | /es/cle/ |
| Disallow | /es/col/ |
| Disallow | /es/cws/ |
| Disallow | /es/det/ |
| Disallow | /es/hou/ |
| Disallow | /es/kc/ |
| Disallow | /es/la/ |
| Disallow | /es/mia/ |
| Disallow | /es/mil/ |
| Disallow | /es/min/ |
| Disallow | /es/nym/ |
| Disallow | /es/nyy/ |
| Disallow | /es/oak/ |
| Disallow | /es/phi/ |
| Disallow | /es/pit/ |
| Disallow | /es/sd/ |
| Disallow | /es/sea/ |
| Disallow | /es/sf/ |
| Disallow | /es/stl/ |
| Disallow | /es/tb/ |
| Disallow | /es/tex/ |
| Disallow | /es/tor/ |
| Disallow | /es/was/ |
| Disallow | /scripts/ |
| Disallow | /shared/scripts/ |