Log In Sign Up

it.besoccer.com
robots.txt

Robots Exclusion Standard data for it.besoccer.com

Resource Scan

Scan Details

Site Domain it.besoccer.com
Base Domain besoccer.com
Scan Status Ok
Last Scan2024-11-10T01:02:08+00:00
Next Scan 2024-11-17T01:02:08+00:00

Last Scan

Scanned2024-11-10T01:02:08+00:00
URL https://it.besoccer.com/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 24e1c3df8e091432b6cedc9837b19c0593911020e6e5178dba1ac8080260dac8
SimHash ad507b0386b3

Groups

*

Rule Path
Allow /
Allow /livescore/*/en-directo$
Allow /livescore/*/live$
Disallow /livescore/*/*
Allow /risultati/*/in-diretta$
Disallow /risultati/*/*
Allow /resultats/*/direct$
Disallow /resultats/*/*
Allow /resultados/*/direto$
Disallow /resultados/*/*

googlebot
mediapartners-google
googlebot-image
adsbot-google
msnbot
msnbot-media
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /scripts*

*

Rule Path
Disallow /ajax*

cncdialer
doc
download ninja
fetch
grub-client
httrack
ia_archiver
k2spider
larbin
libwww
linko
maxthon
microsoft.url.control
msiecrawler
npbot

Rule Path
Disallow /

offline explorer
orthogaffe
sitecheck.internetseer.com
sitesnagger
slurp
teleport
teleportpro
ubicrawler
webcopier
webreaper
webstripper
webzip
xenu
zao
zealbot
zyborg

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://it.besoccer.com/sitemaps/it/competitions.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_table.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_ranking_goalscorers.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_ranking_assists.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_ranking_goalkeepers.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_news.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/competition_rankings.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/teams.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/teams_news.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/teams_squads.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/teams_matches.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/players_0.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/players_1.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/news.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/latest_news.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/transfers.xml.gz
sitemap https://it.besoccer.com/sitemaps/it/livescore.xml.gz
Back to top

Comments

  • GENERAL SETTINGS
  • Allow
  • Directivas
  • I Disallow
  • II Disallow
Back to top