justfantasybaseball.com
robots.txt
Robots Exclusion Standard data for justfantasybaseball.com
Resource Scan
Scan Details
| Site Domain | justfantasybaseball.com |
| Base Domain | justfantasybaseball.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T14:17:46+00:00 |
| Next Scan | 2024-11-20T14:17:46+00:00 |
Last Scan
| Scanned | 2024-11-13T14:17:46+00:00 |
| URL | https://justfantasybaseball.com/robots.txt |
| Redirect | https://fansided.com/robots.txt |
| Redirect Domain | fansided.com |
| Redirect Base | fansided.com |
| Domain IPs | 104.21.37.155, 172.67.210.81, 2606:4700:3033::6815:259b, 2606:4700:3033::ac43:d251 |
| Redirect IPs | 13.33.88.2, 13.33.88.43, 13.33.88.88, 13.33.88.96, 2600:9000:223b:2c00:1d:fd0d:38c0:93a1, 2600:9000:223b:3400:1d:fd0d:38c0:93a1, 2600:9000:223b:4400:1d:fd0d:38c0:93a1, 2600:9000:223b:6a00:1d:fd0d:38c0:93a1, 2600:9000:223b:8e00:1d:fd0d:38c0:93a1, 2600:9000:223b:c200:1d:fd0d:38c0:93a1, 2600:9000:223b:ec00:1d:fd0d:38c0:93a1, 2600:9000:223b:f000:1d:fd0d:38c0:93a1 |
| Response IP | 13.33.88.88 |
| Found | Yes |
| Hash | 9731a87258916dbab9b8058f7680f4babb523c8bd94904f54eb6370a742099c0 |
| SimHash | 6c254a0a0de2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | */?*utm_source=* |
| Disallow | */?*utm_campaign=* |
| Disallow | */?*utm_medium=* |
| Disallow | /*?source=* |
| Disallow | */?*utm_newsbreak=* |
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
*
| Rule | Path |
|---|---|
| Disallow | *?embed* |
*
| Rule | Path |
|---|---|
| Disallow | */*a_aid%3D* |
| Disallow | /*?partner=* |
*
| Rule | Path |
|---|---|
| Disallow | */*?mm-experiments=* |
*
| Rule | Path |
|---|---|
| Disallow | /*?*s=* |
*
| Rule | Path |
|---|---|
| Disallow | *?app=* |
*
| Rule | Path |
|---|---|
| Disallow | *?fbclid=* |
*
| Rule | Path |
|---|---|
| Disallow | /*?setLocale=* |
| Disallow | *?georedirect=* |
*
| Rule | Path |
|---|---|
| Disallow | /*?term=* |
| Disallow | *?ref=* |
| Disallow | /*?view_source=* |
| Disallow | /*?view_medium=* |
| Disallow | /*?initialLeagueId=* |
*
| Rule | Path |
|---|---|
| Disallow | *_ga_* |
| Disallow | */?_gl=* |
*
| Rule | Path |
|---|---|
| Disallow | */api/* |
*
| Rule | Path |
|---|---|
| Disallow | */videos/undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined |
| Disallow | */teams/mainNavigationChevron_icon.svg?* |
| Disallow | */leagues/mainNavigationChevron_icon.svg?* |
| Disallow | */undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined |
*
| Rule | Path |
|---|---|
| Disallow | */files/* |
| Disallow | */wp-admin/* |
| Disallow | */?*utm_newsbreak=* |
| Disallow | */wp-content/* |
| Disallow | */wp-includes/* |
| Disallow | */app/* |
| Disallow | */embed_code* |
| Disallow | */%7B%7Burl/* |
| Disallow | */v2/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fansided.com/news-sitemap.xml |
| sitemap | https://fansided.com/feed-sitemap.xml |
| sitemap | https://fansided.com/sitemap.xml |
| sitemap | https://fansided.com/es/news-sitemap.xml |
| sitemap | https://fansided.com/es/feed-sitemap.xml |
| sitemap | https://fansided.com/es/sitemap.xml |
| sitemap | https://fansided.com/betsided/news-sitemap.xml |
| sitemap | https://fansided.com/betsided/feed-sitemap.xml |
| sitemap | https://fansided.com/betsided/sitemap.xml |
Warnings
- 2 invalid lines.
Comments