api.espn.com
robots.txt
Robots Exclusion Standard data for api.espn.com
Resource Scan
Scan Details
Site Domain | api.espn.com |
Base Domain | espn.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-10T15:32:01+00:00 |
Next Scan | 2024-10-08T15:32:01+00:00 |
Last Successful Scan
Scanned | 2023-08-19T00:16:50+00:00 |
URL | https://api.espn.com/robots.txt |
Domain IPs | 34.210.124.61, 35.165.23.141, 44.241.164.35, 52.25.2.227, 52.33.25.28, 52.38.68.42, 54.187.221.230, 54.201.82.227 |
Response IP | 35.165.23.141 |
Found | Yes |
Hash | dc2d439e070ee0f794b1f2e6ee0a0b9d68ec03c49ac7ca74548144db308ac773 |
SimHash | 007b20816cb0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*admin/ |
Disallow | /*conversation/ |
Disallow | /*conversations/ |
Disallow | /*deportes/ |
Disallow | /*flash/ |
Disallow | /*format/ |
Disallow | /*order/ |
Disallow | /*search? |
Disallow | /*search/ |
Disallow | /*sort/ |
Disallow | /*util/ |
Disallow | /*webslices/ |
Disallow | /*print?id |
Disallow | /ad/ |
Disallow | /cgi |
Disallow | /community/ |
Disallow | /composer/ |
Disallow | /contests/ |
Disallow | /espn/now |
Disallow | /espnradio/podcast/feeds/easports/ |
Disallow | /index?sport=*&topId=* |
Disallow | /index?sport=*&type=replay |
Disallow | /sports/*/index?topId=* |
Disallow | /members/ |
Disallow | /personalization/ |
Disallow | /travel/passport/activity |
Disallow | /travel/passport/add |
Disallow | /travel/passport/event |
Disallow | /travel/passport/events |
Disallow | /travel/passport/invite |
Disallow | /travel/passport/map |
Disallow | /travel/passport/photos |
Disallow | /travel/passport/rankings |
Disallow | /travel/passport/stats |
Disallow | /travel/passport/venues |
Disallow | /video/search |
Disallow | /video/clipDeportes |
Disallow | /*.com |
Disallow | /*.net |
Disallow | /*.org |
Disallow | /*.co.uk |
Disallow | /*.com.au |
Disallow | /*.es |
Disallow | /*.me |
Disallow | /*.ly |
Disallow | /*.me |
Disallow | /*view/ |
Disallow | /*start/ |
Disallow | /*photoId/ |
Disallow | /*type/ |
Disallow | /*cat/ |
Disallow | /*split/ |
Disallow | /*calendar/ |
Disallow | /*date/ |
Disallow | /*seasontype/ |
Disallow | /*season/200 |
Disallow | /*year/200 |
Disallow | /*_/year/20 |
Disallow | /*_/group/ |
Disallow | /*_/scoreboard/ |
Disallow | /*_/week/ |
Disallow | /*?ex_cid=espnapi_public |
Disallow | /*%26photoId%3D |
Disallow | /*%26full%3D |
Disallow | /*playbyplay? |
Disallow | /*boxscore? |
Disallow | /*conversation? |
Disallow | /*recap? |
Disallow | /*preview? |
Disallow | /*databaseresults/ |
Disallow | /mlb/stats/*?*minage=* |
Disallow | /mlb/stats/*?*split=* |
Comments