games.the-dispatch.com
robots.txt

Robots Exclusion Standard data for games.the-dispatch.com

Resource Scan

Scan Details

Site Domain games.the-dispatch.com
Base Domain the-dispatch.com
Scan Status Ok
Last Scan2024-06-05T14:25:09+00:00
Next Scan 2024-06-12T14:25:09+00:00

Last Scan

Scanned2024-06-05T14:25:09+00:00
URL http://games.the-dispatch.com/robots.txt
Redirect https://games.usatoday.com/robots.txt?arkpromo=decomissioned_games_the-dispatch
Redirect Domain games.usatoday.com
Redirect Base usatoday.com
Domain IPs 174.143.223.9
Redirect IPs 23.213.43.211, 23.213.43.221, 2600:1413:b000:d::6011:600b, 2600:1413:b000:d::6011:6013
Response IP 23.52.40.168
Found Yes
Hash f0d2deb47276778f89997503f1733f70026a821fc92e376281d5bb95def5107f
SimHash 42335420bdaa

Groups

*

Rule Path
Disallow /todays-hurdle
Disallow /hurdle
Disallow /games/hurdle
Disallow /games/todays-hurdle
Disallow /es/juegos/todays-hurdle
Disallow /fr/jeux/todays-hurdle
Disallow /it/giochi/todays-hurdle
Disallow /de/spiele/todays-hurdle
Disallow /en-us/games/todays-hurdle
Disallow /en-gb/games/todays-hurdle
Disallow /en-au/games/todays-hurdle
Disallow /en-nz/games/todays-hurdle

Other Records

Field Value
sitemap https://games.usatoday.com/sitemap.xml