espn.in
robots.txt

Robots Exclusion Standard data for espn.in

Resource Scan

Scan Details

Site Domain espn.in
Base Domain espn.in
Scan Status Ok
Last Scan2024-05-11T06:08:37+00:00
Next Scan 2024-05-18T06:08:37+00:00

Last Scan

Scanned2024-05-11T06:08:37+00:00
URL https://espn.in/robots.txt
Redirect http://www.espn.in/robots.txt
Redirect Domain www.espn.in
Redirect Base espn.in
Domain IPs 13.35.18.11, 13.35.18.116, 13.35.18.37, 13.35.18.52
Redirect IPs 54.192.18.19, 54.192.18.20, 54.192.18.30, 54.192.18.76
Response IP 13.33.88.56
Found Yes
Hash 2d15a2a02e7becacfcefd5a821ec5f26b39657d4562b0a956f6e8cc29507f419
SimHash 128ccd412677

Groups

claritybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow */admin/
Disallow */boxscore?
Disallow */calendar/
Disallow */cat/
Disallow */conversation?
Disallow */conversation/
Disallow */conversations?
Disallow */conversations/
Disallow */databaseresults/
Disallow */date/
Disallow */deportes/
Disallow */flash/
Disallow */login?
Disallow */login/
Disallow */order/
Disallow */photoId/
Disallow */playbyplay?
Disallow /watch/*?*lang=
Disallow /watch/*?*rb=
Disallow /watch/*?*country=
Disallow /watch/*?*search=
Disallow /watch/*?*device=
Disallow /watch/*?*partner=
Disallow /watch/*?*redirected=
Disallow /watch/_/redirected/*
Disallow /watch/*?*om-navmethod=
Disallow */print?id
Disallow */printschedule/
Disallow */season/200
Disallow */split/
Disallow */start/
Disallow */swf/
Disallow */util/
Disallow */webslices/
Disallow */year/200
Disallow /*?ex_cid=
Disallow /*?innings=
Disallow /*?user=
Disallow /*%26action%3Dlogin
Disallow /*%26full%3D
Disallow /*%26order%3D
Disallow /*%26photoId%3D
Disallow /*%26sort%3D*
Disallow /ad/
Disallow /broadband/
Disallow /cgi
Disallow /community/
Disallow /composer/
Disallow /contests/
Disallow /espn/now
Disallow /espnradio/podcast/feeds/easports/
Disallow /index?sport=*&topId=*
Disallow /index?sport=*&type=replay
Disallow /members/
Disallow /personalization/
Disallow /sports*/index?topId=*
Disallow /travel/passport/
Disallow /video/clipDeportes
Disallow /video/search
Disallow /nba/tradeMachine/?tradeId=*
Disallow */wire?
Disallow /load_video_player/*
Disallow /football/conversation?gameId=*
Disallow */channels/*
Disallow */crossdomain/*
Disallow */makecorsrequest/*
Disallow */utils/*
Disallow */strategies/*
Disallow */child/*
Disallow */message/*
Disallow */units/*
Disallow */om-navmethod/*
Disallow */null
Disallow */null/*
Disallow */undefined
Disallow */undefined/*
Disallow *ESPNPlusAdobeTracking/
Disallow */modifier/*
Disallow /*%26xhr%3D1
Disallow /*%26wsVar%3D*
Disallow /*%26_slug_%3D*
Disallow /*.com
Disallow /*.net
Disallow /*.org
Disallow /*.co.uk
Disallow */platform/*
Disallow /*%26platform%3D
Disallow /*?platform=
Disallow /football/matchstats
Disallow /football/lineups
Disallow /football/commentary
Disallow /soccer/matchstats
Disallow /football/video
Disallow /soccer/lineups
Disallow /soccer/commentary
Disallow /soccer/video
Disallow /*?*%3A%3A*
Disallow /rugby?*
Allow */platform/amp*
Allow /*%26platform%3Damp
Allow /*?platform=amp

Other Records

Field Value
sitemap https://www.espn.in/sitemap.xml

Comments

  • robots.txt for www.espn.in

Warnings

  • 1 invalid line.