sevilla.besoccer.com
robots.txt

Robots Exclusion Standard data for sevilla.besoccer.com

Resource Scan

Scan Details

Site Domain sevilla.besoccer.com
Base Domain besoccer.com
Scan Status Ok
Last Scan2024-11-13T16:55:23+00:00
Next Scan 2024-11-20T16:55:23+00:00

Last Scan

Scanned2024-11-13T16:55:23+00:00
URL https://sevilla.besoccer.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 5f1061bab83cb965f84b2921cbf864a17045abeb765d92f247cf0558df37e3b3
SimHash 8d507193c677

Groups

*

Rule Path
Allow /
Allow /livescore/*/en-directo$
Allow /livescore/*/live$
Disallow /livescore/*/*
Allow /risultati/*/in-diretta$
Disallow /risultati/*/*
Allow /resultats/*/direct$
Disallow /resultats/*/*
Allow /resultados/*/direto$
Disallow /resultados/*/*

googlebot
mediapartners-google
googlebot-image
adsbot-google
msnbot
msnbot-media
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /scripts*

*

Rule Path
Disallow /ajax*

cncdialer
doc
download ninja
fetch
grub-client
httrack
ia_archiver
k2spider
larbin
libwww
linko
maxthon
microsoft.url.control
msiecrawler
npbot

Rule Path
Disallow /

offline explorer
orthogaffe
sitecheck.internetseer.com
sitesnagger
slurp
teleport
teleportpro
ubicrawler
webcopier
webreaper
webstripper
webzip
xenu
zao
zealbot
zyborg

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sevilla.besoccer.com/sitemaps/es/sevilla.xml.gz
sitemap https://sevilla.besoccer.com/sitemaps/es/sevilla_latest_news.xml.gz

Comments

  • GENERAL SETTINGS
  • Allow
  • Directivas
  • I Disallow
  • II Disallow