pressbox.mlb.com
robots.txt
Robots Exclusion Standard data for pressbox.mlb.com
Resource Scan
Scan Details
Site Domain | pressbox.mlb.com |
Base Domain | mlb.com |
Scan Status | Ok |
Last Scan | 2024-11-12T21:49:17+00:00 |
Next Scan | 2024-11-19T21:49:17+00:00 |
Last Scan
Scanned | 2024-11-12T21:49:17+00:00 |
URL | https://pressbox.mlb.com/robots.txt |
Domain IPs | 146.75.41.60 |
Response IP | 151.101.41.60 |
Found | Yes |
Hash | 9308642df0875f6b84506fce3688491d9f2861c8e50ff34b1517054bbddcafbb |
SimHash | 5100462ca113 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /app/ |
Disallow | /embed/ |
Disallow | /en/ |
Disallow | /mlb/ |
Disallow | /share/ |
Disallow | /tokens/ |
Disallow | /tv/ |
Disallow | /web/ |
Disallow | /legacy |
Disallow | /beta |
Disallow | /admin |