Log In Sign Up

betis.besoccer.com
robots.txt

Robots Exclusion Standard data for betis.besoccer.com

Resource Scan

Scan Details

Site Domain betis.besoccer.com
Base Domain besoccer.com
Scan Status Ok
Last Scan2024-11-10T17:22:47+00:00
Next Scan 2024-11-17T17:22:47+00:00

Last Scan

Scanned2024-11-10T17:22:47+00:00
URL https://betis.besoccer.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash a5e0382bb6734312b09d9361f7d0c0e972c796a93936149044c294e8a9c7af5b
SimHash 8d507993c637

Groups

*

Rule Path
Allow /
Allow /livescore/*/en-directo$
Allow /livescore/*/live$
Disallow /livescore/*/*
Allow /risultati/*/in-diretta$
Disallow /risultati/*/*
Allow /resultats/*/direct$
Disallow /resultats/*/*
Allow /resultados/*/direto$
Disallow /resultados/*/*

googlebot
mediapartners-google
googlebot-image
adsbot-google
msnbot
msnbot-media
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /scripts*

*

Rule Path
Disallow /ajax*

cncdialer
doc
download ninja
fetch
grub-client
httrack
ia_archiver
k2spider
larbin
libwww
linko
maxthon
microsoft.url.control
msiecrawler
npbot

Rule Path
Disallow /

offline explorer
orthogaffe
sitecheck.internetseer.com
sitesnagger
slurp
teleport
teleportpro
ubicrawler
webcopier
webreaper
webstripper
webzip
xenu
zao
zealbot
zyborg

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://betis.besoccer.com/sitemaps/es/betis.xml.gz
sitemap https://betis.besoccer.com/sitemaps/es/betis_latest_news.xml.gz
Back to top

Comments

  • GENERAL SETTINGS
  • Allow
  • Directivas
  • I Disallow
  • II Disallow
Back to top