sportskeeda.com
robots.txt

Robots Exclusion Standard data for sportskeeda.com

Resource Scan

Scan Details

Site Domain sportskeeda.com
Base Domain sportskeeda.com
Scan Status Ok
Last Scan2024-11-10T17:12:51+00:00
Next Scan 2024-11-17T17:12:51+00:00

Last Scan

Scanned2024-11-10T17:12:51+00:00
URL https://sportskeeda.com/robots.txt
Redirect https://www.sportskeeda.com/robots.txt
Redirect Domain www.sportskeeda.com
Redirect Base sportskeeda.com
Domain IPs 13.251.200.105, 18.140.18.240
Redirect IPs 104.18.24.195, 104.18.25.195, 2606:4700::6812:18c3, 2606:4700::6812:19c3
Response IP 104.18.24.195
Found Yes
Hash bc0774ccd638a8f6ec915e23f3be36a16ccacc7825e2fef558e29ceef362e78f
SimHash a9f64b65985f

Groups

mediapartners-google

Rule Path
Disallow

duggmirror

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

googlebot

Rule Path
Allow *key%3Dskmainfb*
Allow *key4%3Dskwfb*
Allow *key4%3Dskcolbasketfb*
Allow *key4%3Dskaewfb*
Allow *key4%3Dskbaseballfb*
Allow *key4%3Dskcfb*
Allow *key4%3Dskchefb*
Allow *key4%3Dskf1fb*
Allow *key4%3Dskmaincfb*
Allow *key4%3Dskcfb*
Allow *key4%3Dskfootballfb*
Allow *key4%3Dskgolffb*
Allow *key4%3Dskmmafb*
Allow *key4%3Dsknascarfb*
Allow *key4%3Dsknbamemesfb*
Allow *key4%3Dskpffb*
Allow *key4%3Dsktenfb*
Allow *key4%3Dskufcfb*
Disallow /001/
Disallow /amp/feedback
Disallow /profile/*/following
Disallow /profile/*/followers
Disallow /football-match-preview/
Disallow /olympics-page-2/
Disallow /apc/
Disallow /cgi-bin
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /readme.html
Disallow /license.txt
Disallow /search/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /members
Disallow /archives
Disallow /?s=
Disallow /?p=
Disallow /wp-content/uploads/
Disallow /?attachment_id=
Disallow /?author=
Disallow /uc/
Disallow /quiz/
Disallow /redirect
Disallow /viral-picks/*
Disallow /taxonomy
Disallow /comments/count/*
Disallow /*/load-more
Disallow /*/load_more
Disallow /*/ajax/archive
Disallow /*/ajax/related
Disallow /*/ajax/trending
Disallow /cricket/ajax/teams/related/*
Disallow /admin/notification-center
Disallow /admin/mapping-dashboard
Disallow /*/ajax/archive?page
Disallow /login?after-login*
Disallow /login?*
Disallow /third-party/*
Disallow /version
Disallow *?key1=*
Disallow *%26key1%3D*
Disallow *?key2=*
Disallow *%26key2%3D*
Disallow *?key3=*
Disallow *%26key3%3D*
Disallow *?key4=*
Disallow *%26key4%3D*
Disallow *?givingPlayers=*
Disallow *%26givingPlayers%3D*
Disallow *?gettingPlayers=*
Disallow *%26gettingPlayers%3D*
Disallow *?ref=*
Disallow *%26ref%3D*
Disallow *?article-trending=*
Disallow *%26article-trending%3D*
Disallow *?page=*
Disallow *%26page%3D*
Disallow *?date=*
Disallow *%26date%3D*
Disallow *?comment-popup=*
Disallow *%26comment-popup%3D*
Disallow *?comment-meta-id=*
Disallow *%26comment-meta-id%3D*
Disallow *?key=*
Disallow *%26key%3D*
Disallow *?Key2=*
Disallow *%26Key2%3D*
Disallow *?Key4=*
Disallow *%26Key4%3D*
Disallow *?tab=*
Disallow *%26tab%3D*
Disallow *?related=*
Disallow *%26related%3D*
Disallow *?view=*
Disallow *%26view%3D*
Disallow *?traffic=*
Disallow *%26traffic%3D*
Disallow *?after-login=*
Disallow *%26after-login%3D*
Disallow /edit-profile
Disallow *?team_stats_event_type=*
Disallow *%26team_stats_event_type%3D*
Disallow *?player_stats_event_type=*
Disallow *%26player_stats_event_type%3D*
Allow /creator/getting-started
Disallow /creator/*

Other Records

Field Value
sitemap https://www.sportskeeda.com/news-sitemap.xml
sitemap https://www.sportskeeda.com/us-news-sitemap.xml
sitemap https://www.sportskeeda.com/video-sitemap.xml
sitemap https://www.sportskeeda.com/sitemap.xml

Comments

  • allow adsense bot to parse no-index content
  • disallow folders
  • These query params appear from the links getting indexed/crawled from the Facebook