dodgers.mlblogs.com
robots.txt
Robots Exclusion Standard data for dodgers.mlblogs.com
Resource Scan
Scan Details
Site Domain | dodgers.mlblogs.com |
Base Domain | mlblogs.com |
Scan Status | Ok |
Last Scan | 2025-07-01T05:57:17+00:00 |
Next Scan | 2025-07-15T05:57:17+00:00 |
Last Scan
Scanned | 2025-07-01T05:57:17+00:00 |
URL | https://dodgers.mlblogs.com/robots.txt |
Redirect | https://dodgers.mlblogs.com/robots.txt?gi=38646e332355 |
Domain IPs | 162.159.152.4, 162.159.153.4 |
Response IP | 162.159.153.4 |
Found | Yes |
Hash | b39e9b06e2d87a457095e9c3b86084af472fb0c44b697bc8e5b679f8da47bdb9 |
SimHash | 6930bbc44372 |
Groups
*
Rule | Path |
---|---|
Disallow | /m/ |
Disallow | /me/ |
Disallow | /%40me$ |
Disallow | /%40me/ |
Disallow | /*/edit$ |
Disallow | /*/*/edit$ |
Disallow | /media/ |
Disallow | /p/*/share |
Disallow | /r/ |
Disallow | /trending |
Disallow | /search?q$ |
Disallow | /search?q= |
Disallow | /*/search?q= |
Disallow | /*/search/*?q= |
Disallow | /*/*source%3D |
Allow | /_/ |
Allow | /_/api/users/*/meta |
Allow | /_/api/users/*/profile/stream |
Allow | /_/api/posts/*/responses |
Allow | /_/api/posts/*/responsesStream |
Allow | /_/api/posts/*/related |
Other Records
Field | Value |
---|---|
sitemap | https://dodgers.mlblogs.com/sitemap/sitemap.xml |
Warnings
- `license` is not a known field.