Log In Sign Up

malaga.besoccer.com
robots.txt

Robots Exclusion Standard data for malaga.besoccer.com

Resource Scan

Scan Details

Site Domain malaga.besoccer.com
Base Domain besoccer.com
Scan Status Ok
Last Scan2024-11-09T07:56:11+00:00
Next Scan 2024-11-16T07:56:11+00:00

Last Scan

Scanned2024-11-09T07:56:11+00:00
URL https://malaga.besoccer.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash ce4a176909ed0ea34e40ba5d7ff1f996190bedff3677edc1e484c62989b78188
SimHash 8d507993c677

Groups

*

Rule Path
Allow /
Allow /livescore/*/en-directo$
Allow /livescore/*/live$
Disallow /livescore/*/*
Allow /risultati/*/in-diretta$
Disallow /risultati/*/*
Allow /resultats/*/direct$
Disallow /resultats/*/*
Allow /resultados/*/direto$
Disallow /resultados/*/*

googlebot
mediapartners-google
googlebot-image
adsbot-google
msnbot
msnbot-media
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /scripts*

*

Rule Path
Disallow /ajax*

cncdialer
doc
download ninja
fetch
grub-client
httrack
ia_archiver
k2spider
larbin
libwww
linko
maxthon
microsoft.url.control
msiecrawler
npbot

Rule Path
Disallow /

offline explorer
orthogaffe
sitecheck.internetseer.com
sitesnagger
slurp
teleport
teleportpro
ubicrawler
webcopier
webreaper
webstripper
webzip
xenu
zao
zealbot
zyborg

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://malaga.besoccer.com/sitemaps/es/malaga.xml.gz
sitemap https://malaga.besoccer.com/sitemaps/es/malaga_latest_news.xml.gz
Back to top

Comments

  • GENERAL SETTINGS
  • Allow
  • Directivas
  • I Disallow
  • II Disallow
Back to top