espn.nl
robots.txt
Robots Exclusion Standard data for espn.nl
Resource Scan
Scan Details
| Site Domain | espn.nl |
| Base Domain | espn.nl |
| Scan Status | Ok |
| Last Scan | 2024-06-06T09:03:52+00:00 |
| Next Scan | 2024-06-13T09:03:52+00:00 |
Last Scan
| Scanned | 2024-06-06T09:03:52+00:00 |
| URL | https://espn.nl/robots.txt |
| Redirect | http://www.espn.nl/robots.txt |
| Redirect Domain | www.espn.nl |
| Redirect Base | espn.nl |
| Domain IPs | 13.35.18.11, 13.35.18.116, 13.35.18.37, 13.35.18.52 |
| Redirect IPs | 108.157.254.127, 108.157.254.14, 108.157.254.66, 108.157.254.7 |
| Response IP | 108.157.254.14 |
| Found | Yes |
| Hash | d63471aeb07face6e98cd7d3aae999388f9e955e2831419d666492210c2ead22 |
| SimHash | 1298cd4026f7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */_/scoreboard/ |
| Disallow | */_/week/ |
| Disallow | */_/*/year/ |
| Disallow | */admin/ |
| Disallow | */boxscore? |
| Disallow | */calendar/ |
| Disallow | */cat/ |
| Disallow | */conversation? |
| Disallow | */conversation/ |
| Disallow | */conversations? |
| Disallow | */conversations/ |
| Disallow | */databaseresults/ |
| Disallow | */date/ |
| Disallow | */deportes/ |
| Disallow | */flash/ |
| Disallow | */login? |
| Disallow | */login/ |
| Disallow | */order/ |
| Disallow | */photoId/ |
| Disallow | */playbyplay? |
| Disallow | /watch/*?*lang= |
| Disallow | /watch/*?*rb= |
| Disallow | /watch/*?*country= |
| Disallow | /watch/*?*search= |
| Disallow | /watch/*?*device= |
| Disallow | /watch/*?*partner= |
| Disallow | /watch/*?*redirected= |
| Disallow | /watch/_/redirected/* |
| Disallow | /watch/*?*om-navmethod= |
| Disallow | */player/advancedstats |
| Disallow | */player/batvspitch |
| Disallow | */player/hollinger |
| Disallow | */player/matches |
| Disallow | */player/news |
| Disallow | */player/splits |
| Disallow | */player/stats |
| Disallow | */fighter/history |
| Disallow | */fighter/stats |
| Disallow | */print?id |
| Disallow | */printschedule/ |
| Disallow | */season/200 |
| Disallow | */seasontype/ |
| Disallow | */sort/* |
| Disallow | */split/ |
| Disallow | */start/ |
| Disallow | */swf/ |
| Disallow | */util/ |
| Disallow | */view/ |
| Disallow | */webslices/ |
| Disallow | */year/200 |
| Disallow | /*?ex_cid= |
| Disallow | /*?innings= |
| Disallow | /*?user= |
| Disallow | /*%26action%3Dlogin |
| Disallow | /*%26full%3D |
| Disallow | /*%26order%3D |
| Disallow | /*%26photoId%3D |
| Disallow | /*%26sort%3D* |
| Disallow | /ad/ |
| Disallow | /broadband/ |
| Disallow | /cgi |
| Disallow | /community/ |
| Disallow | /composer/ |
| Disallow | /contests/ |
| Disallow | /espn/now |
| Disallow | /espnradio/podcast/feeds/easports/ |
| Disallow | /index?sport=*&topId=* |
| Disallow | /index?sport=*&type=replay |
| Disallow | /members/ |
| Disallow | /personalization/ |
| Disallow | /sports*/index?topId=* |
| Disallow | /travel/passport/ |
| Disallow | /video/clipDeportes |
| Disallow | /video/search |
| Disallow | /nba/tradeMachine/?tradeId=* |
| Disallow | */wire? |
| Disallow | /load_video_player/* |
| Disallow | /football/conversation?gameId=* |
| Disallow | */channels/* |
| Disallow | */crossdomain/* |
| Disallow | */makecorsrequest/* |
| Disallow | */utils/* |
| Disallow | */strategies/* |
| Disallow | */child/* |
| Disallow | */message/* |
| Disallow | */units/* |
| Disallow | */om-navmethod/* |
| Disallow | */null |
| Disallow | */null/* |
| Disallow | */undefined |
| Disallow | */undefined/* |
| Disallow | *ESPNPlusAdobeTracking/ |
| Disallow | */modifier/* |
| Disallow | /*%26xhr%3D1 |
| Disallow | /*%26wsVar%3D* |
| Disallow | /*%26_slug_%3D* |
| Disallow | /*.com |
| Disallow | /*.net |
| Disallow | /*.org |
| Disallow | /*.co.uk |
| Disallow | */platform/* |
| Disallow | /*%26platform%3D |
| Disallow | /*?platform= |
| Disallow | /football/matchstats |
| Disallow | /football/lineups |
| Disallow | /football/commentary |
| Disallow | /soccer/matchstats |
| Disallow | /football/video |
| Disallow | /soccer/lineups |
| Disallow | /soccer/commentary |
| Disallow | /soccer/video |
| Disallow | /*?*%3A%3A* |
| Disallow | /rugby?* |
| Allow | */platform/amp* |
| Allow | /*%26platform%3Damp |
| Allow | /*?platform=amp |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.espn.nl/sitemap.xml |
Warnings
- 1 invalid line.
Comments