games.news-journalonline.com
robots.txt

Robots Exclusion Standard data for games.news-journalonline.com

Resource Scan

Scan Details

Site Domain games.news-journalonline.com
Base Domain news-journalonline.com
Scan Status Ok
Last Scan2024-05-11T00:13:53+00:00
Next Scan 2024-05-18T00:13:53+00:00

Last Scan

Scanned2024-05-11T00:13:53+00:00
URL http://games.news-journalonline.com/robots.txt
Redirect https://games.usatoday.com/robots.txt?arkpromo=decomissioned_games_news-journalonline
Redirect Domain games.usatoday.com
Redirect Base usatoday.com
Domain IPs 174.143.223.9
Redirect IPs 125.56.219.2, 23.32.29.91, 2600:1413:1::1720:1d5b, 2600:1413:1::7d38:db02
Response IP 23.52.40.59
Found Yes
Hash f0d2deb47276778f89997503f1733f70026a821fc92e376281d5bb95def5107f
SimHash 42335420bdaa

Groups

*

Rule Path
Disallow /todays-hurdle
Disallow /hurdle
Disallow /games/hurdle
Disallow /games/todays-hurdle
Disallow /es/juegos/todays-hurdle
Disallow /fr/jeux/todays-hurdle
Disallow /it/giochi/todays-hurdle
Disallow /de/spiele/todays-hurdle
Disallow /en-us/games/todays-hurdle
Disallow /en-gb/games/todays-hurdle
Disallow /en-au/games/todays-hurdle
Disallow /en-nz/games/todays-hurdle

Other Records

Field Value
sitemap https://games.usatoday.com/sitemap.xml