thepodiumgame.com
robots.txt

Robots Exclusion Standard data for thepodiumgame.com

Resource Scan

Scan Details

Site Domain thepodiumgame.com
Base Domain thepodiumgame.com
Scan Status Ok
Last Scan2024-11-11T15:15:55+00:00
Next Scan 2024-11-18T15:15:55+00:00

Last Scan

Scanned2024-11-11T15:15:55+00:00
URL https://thepodiumgame.com/robots.txt
Redirect https://fansided.com/robots.txt
Redirect Domain fansided.com
Redirect Base fansided.com
Domain IPs 104.21.30.63, 172.67.172.51, 2606:4700:3036::6815:1e3f, 2606:4700:3036::ac43:ac33
Redirect IPs 13.33.88.2, 13.33.88.43, 13.33.88.88, 13.33.88.96, 2600:9000:21d1:0:1d:fd0d:38c0:93a1, 2600:9000:21d1:2600:1d:fd0d:38c0:93a1, 2600:9000:21d1:2800:1d:fd0d:38c0:93a1, 2600:9000:21d1:5600:1d:fd0d:38c0:93a1, 2600:9000:21d1:6a00:1d:fd0d:38c0:93a1, 2600:9000:21d1:6c00:1d:fd0d:38c0:93a1, 2600:9000:21d1:9e00:1d:fd0d:38c0:93a1, 2600:9000:21d1:e600:1d:fd0d:38c0:93a1
Response IP 13.226.61.16
Found Yes
Hash 9731a87258916dbab9b8058f7680f4babb523c8bd94904f54eb6370a742099c0
SimHash 6c254a0a0de2

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow */?*utm_source=*
Disallow */?*utm_campaign=*
Disallow */?*utm_medium=*
Disallow /*?source=*
Disallow */?*utm_newsbreak=*

*

Rule Path
Allow /ads.txt

*

Rule Path
Disallow *?embed*

*

Rule Path
Disallow */*a_aid%3D*
Disallow /*?partner=*

*

Rule Path
Disallow */*?mm-experiments=*

*

Rule Path
Disallow /*?*s=*

*

Rule Path
Disallow *?app=*

*

Rule Path
Disallow *?fbclid=*

*

Rule Path
Disallow /*?setLocale=*
Disallow *?georedirect=*

*

Rule Path
Disallow /*?term=*
Disallow *?ref=*
Disallow /*?view_source=*
Disallow /*?view_medium=*
Disallow /*?initialLeagueId=*

*

Rule Path
Disallow *_ga_*
Disallow */?_gl=*

*

Rule Path
Disallow */api/*

*

Rule Path
Disallow */videos/undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined
Disallow */teams/mainNavigationChevron_icon.svg?*
Disallow */leagues/mainNavigationChevron_icon.svg?*
Disallow */undefinedc_fill%2Cw_360%2Car_16%3A9%2Cf_auto%2Cq_auto%2Cg_auto/undefined

*

Rule Path
Disallow */files/*
Disallow */wp-admin/*
Disallow */?*utm_newsbreak=*
Disallow */wp-content/*
Disallow */wp-includes/*
Disallow */app/*
Disallow */embed_code*
Disallow */%7B%7Burl/*
Disallow */v2/*

twitterbot

Rule Path
Allow *

facebookbot

Rule Path
Allow *

Other Records

Field Value
sitemap https://fansided.com/news-sitemap.xml
sitemap https://fansided.com/feed-sitemap.xml
sitemap https://fansided.com/sitemap.xml
sitemap https://fansided.com/es/news-sitemap.xml
sitemap https://fansided.com/es/feed-sitemap.xml
sitemap https://fansided.com/es/sitemap.xml
sitemap https://fansided.com/betsided/news-sitemap.xml
sitemap https://fansided.com/betsided/feed-sitemap.xml
sitemap https://fansided.com/betsided/sitemap.xml

Comments

  • Allow all search engines to crawl
  • Disallow Parameters
  • GA traffic source parameters
  • Allow crawling ads
  • Embedded widget parameters
  • Influencers/Affiliate Links parameters
  • Experiments testing team
  • Search box param
  • Apps param
  • FB campaigns
  • GEO targeting:
  • Unknown Parameters
  • GA parameters - Generated from Google caching
  • Generated from Voltax API url
  • Voltax HTML Unknown crawled urls
  • Generated from Fansided WP
  • Social Media Robots
  • Sitemap XML

Warnings

  • 2 invalid lines.