espn.go.com
robots.txt
Robots Exclusion Standard data for espn.go.com
Resource Scan
Scan Details
| Site Domain | espn.go.com |
| Base Domain | go.com |
| Scan Status | Ok |
| Last Scan | 2024-04-24T01:13:07+00:00 |
| Next Scan | 2024-05-01T01:13:07+00:00 |
Last Scan
| Scanned | 2024-04-24T01:13:07+00:00 |
| URL | https://espn.go.com/robots.txt |
| Redirect | https://www.espn.com/robots.txt |
| Redirect Domain | www.espn.com |
| Redirect Base | espn.com |
| Domain IPs | 13.35.18.11, 13.35.18.116, 13.35.18.37, 13.35.18.52 |
| Redirect IPs | 2600:9000:2077:5400:e:fe33:5580:93a1, 2600:9000:2077:6600:e:fe33:5580:93a1, 2600:9000:2077:8200:e:fe33:5580:93a1, 2600:9000:2077:b800:e:fe33:5580:93a1, 2600:9000:2077:c400:e:fe33:5580:93a1, 2600:9000:2077:d000:e:fe33:5580:93a1, 2600:9000:2077:d200:e:fe33:5580:93a1, 2600:9000:2077:f400:e:fe33:5580:93a1, 52.84.150.36, 52.84.150.45, 52.84.150.51, 52.84.150.57 |
| Response IP | 52.84.150.51 |
| Found | Yes |
| Hash | 00e06c82bfe9fd58ed87d07ee23e029a62931c8b49020c1464619de7c5cd18b7 |
| SimHash | 128dc5412ef5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */admin/ |
| Disallow | */boxscore? |
| Disallow | */calendar/ |
| Disallow | */cat/ |
| Disallow | */conversation? |
| Disallow | */conversation/ |
| Disallow | */conversations? |
| Disallow | */conversations/ |
| Disallow | */databaseresults/ |
| Disallow | */date/ |
| Disallow | */deportes/ |
| Disallow | */flash/ |
| Disallow | */login? |
| Disallow | */login/ |
| Disallow | */order/ |
| Disallow | */photoId/ |
| Disallow | */playbyplay? |
| Disallow | /watch/*?*lang= |
| Disallow | /watch/*?*rb= |
| Disallow | /watch/*?*country= |
| Disallow | /watch/*?*search= |
| Disallow | /watch/*?*device= |
| Disallow | /watch/*?*partner= |
| Disallow | /watch/*?*redirected= |
| Disallow | /watch/_/redirected/* |
| Disallow | /watch/*?*om-navmethod= |
| Disallow | */print?id |
| Disallow | */printschedule/ |
| Disallow | */season/200 |
| Disallow | */split/ |
| Disallow | */start/ |
| Disallow | */swf/ |
| Disallow | */util/ |
| Disallow | */webslices/ |
| Disallow | */year/200 |
| Disallow | /*?ex_cid= |
| Disallow | /*?innings= |
| Disallow | /*?user= |
| Disallow | /*%26action%3Dlogin |
| Disallow | /*%26full%3D |
| Disallow | /*%26order%3D |
| Disallow | /*%26photoId%3D |
| Disallow | /*%26sort%3D* |
| Disallow | /ad/ |
| Disallow | /broadband/ |
| Disallow | /cgi |
| Disallow | /community/ |
| Disallow | /composer/ |
| Disallow | /contests/ |
| Disallow | /espn/now |
| Disallow | /espnradio/podcast/feeds/easports/ |
| Disallow | /index?sport=*&topId=* |
| Disallow | /index?sport=*&type=replay |
| Disallow | /members/ |
| Disallow | /personalization/ |
| Disallow | /sports*/index?topId=* |
| Disallow | /travel/passport/ |
| Disallow | /video/clipDeportes |
| Disallow | /video/search |
| Disallow | /nba/tradeMachine/?tradeId=* |
| Disallow | */wire? |
| Disallow | /load_video_player/* |
| Disallow | /football/conversation?gameId=* |
| Disallow | */channels/* |
| Disallow | */crossdomain/* |
| Disallow | */makecorsrequest/* |
| Disallow | */utils/* |
| Disallow | */strategies/* |
| Disallow | */child/* |
| Disallow | */message/* |
| Disallow | */units/* |
| Disallow | */om-navmethod/* |
| Disallow | */null |
| Disallow | */null/* |
| Disallow | */undefined |
| Disallow | */undefined/* |
| Disallow | *ESPNPlusAdobeTracking/ |
| Disallow | */modifier/* |
| Disallow | /*%26xhr%3D1 |
| Disallow | /*%26wsVar%3D* |
| Disallow | /*%26_slug_%3D* |
| Disallow | /*.com |
| Disallow | /*.net |
| Disallow | /*.org |
| Disallow | /*.co.uk |
| Disallow | */platform/* |
| Disallow | /*%26platform%3D |
| Disallow | /*?platform= |
| Disallow | /football/matchstats |
| Disallow | /football/lineups |
| Disallow | /football/commentary |
| Disallow | /soccer/matchstats |
| Disallow | /football/video |
| Disallow | /soccer/lineups |
| Disallow | /soccer/commentary |
| Disallow | /soccer/video |
| Disallow | /*?*%3A%3A* |
| Disallow | /rugby?* |
| Disallow | /jayski/tracks/archive/story/_/id/*/*/* |
| Allow | */platform/amp* |
| Allow | /*%26platform%3Damp |
| Allow | /*?platform=amp |
| Allow | /.well-known/amphtml/apikey.pub |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.espn.com/sitemap.xml |
Warnings
- 1 invalid line.
Comments