racingyears.com
robots.txt

Robots Exclusion Standard data for racingyears.com

Resource Scan

Scan Details

Site Domain racingyears.com
Base Domain racingyears.com
Scan Status Ok
Last Scan2025-04-03T15:53:03+00:00
Next Scan 2025-04-10T15:53:03+00:00

Last Scan

Scanned2025-04-03T15:53:03+00:00
URL https://racingyears.com/robots.txt
Redirect https://www.racingyears.com/robots.txt
Redirect Domain www.racingyears.com
Redirect Base racingyears.com
Domain IPs 104.21.12.70, 172.67.193.188, 2606:4700:3032::6815:c46, 2606:4700:3036::ac43:c1bc
Redirect IPs 104.21.12.70, 172.67.193.188, 2606:4700:3032::6815:c46, 2606:4700:3036::ac43:c1bc
Response IP 104.21.12.70
Found Yes
Hash 792876dfdab22431c36fd5ae1e52dfdb4ff05439c0ff05981aa94df2b3daed82
SimHash 2b48980387b3

Groups

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /ads.txt

*

Rule Path
Disallow /*.gif$
Disallow /*.Gif$
Disallow /*.GIF$
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$

Other Records

Field Value
sitemap https://www.racingyears.com/sitemap.xml