games.examiner.net
robots.txt

Robots Exclusion Standard data for games.examiner.net

Resource Scan

Scan Details

Site Domain games.examiner.net
Base Domain examiner.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-19T17:34:48+00:00
Next Scan 2024-10-19T17:34:48+00:00

Last Successful Scan

Scanned2024-08-21T08:12:54+00:00
URL http://games.examiner.net/robots.txt
Redirect https://games.usatoday.com/robots.txt?arkpromo=decomissioned_games_examiner
Redirect Domain games.usatoday.com
Redirect Base usatoday.com
Domain IPs 174.143.223.9
Redirect IPs 2001:c38:500a::3d13:c1d, 2001:c38:500a::3d13:c2a, 23.213.43.211, 23.213.43.221
Response IP 23.52.40.170
Found Yes
Hash f0d2deb47276778f89997503f1733f70026a821fc92e376281d5bb95def5107f
SimHash 42335420bdaa

Groups

*

Rule Path
Disallow /todays-hurdle
Disallow /hurdle
Disallow /games/hurdle
Disallow /games/todays-hurdle
Disallow /es/juegos/todays-hurdle
Disallow /fr/jeux/todays-hurdle
Disallow /it/giochi/todays-hurdle
Disallow /de/spiele/todays-hurdle
Disallow /en-us/games/todays-hurdle
Disallow /en-gb/games/todays-hurdle
Disallow /en-au/games/todays-hurdle
Disallow /en-nz/games/todays-hurdle

Other Records

Field Value
sitemap https://games.usatoday.com/sitemap.xml