soccergames-today.com
robots.txt

Robots Exclusion Standard data for soccergames-today.com

Resource Scan

Scan Details

Site Domain soccergames-today.com
Base Domain soccergames-today.com
Scan Status Ok
Last Scan2025-03-13T01:14:19+00:00
Next Scan 2025-03-20T01:14:19+00:00

Last Scan

Scanned2025-03-13T01:14:19+00:00
URL https://soccergames-today.com/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.64.1
Found Yes
Hash 39b6cc90a289548cd4ce5ad3508e901303f01265930b80b7dc5469cef053e036
SimHash 770d55e0d610

Groups

*

Rule Path
Allow /
Disallow */partial*
Disallow /external/
Disallow /str/
Disallow /spieler/
Disallow /speler/
Disallow /jugador/
Disallow /player/
Disallow /joueur/
Disallow /calciatore/
Disallow /spelare/
Disallow /spiele/
Disallow /es/P
Disallow /en/
Disallow /nl/
Disallow /be/
Disallow /stream/
Disallow /*-2000/*
Disallow /*-2001/*
Disallow /*-2002/*
Disallow /*-2003/*
Disallow /*-2004/*
Disallow /*-2005/*
Disallow /*-2006/*
Disallow /*-2007/*
Disallow /*-2008/*
Disallow /*-2009/*
Disallow /*-2010/*
Disallow /*-2011/*
Disallow /*-2012/*
Disallow /*-2013/*
Disallow /*-2014/*
Disallow /*-2015/*
Disallow /*-2016/*
Disallow /*-2017/*
Disallow /*-2018/*
Disallow /*-2019/*
Disallow /*-2020/*
Disallow /*-2021/*

dotbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

qualys

Rule Path
Disallow /

synthetic bot

Rule Path
Disallow /

detectify

Rule Path
Disallow /

new relic

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

sendgrid

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://soccergames-today.com/sitemap.xml