sport.sky.it
robots.txt

Robots Exclusion Standard data for sport.sky.it

Resource Scan

Scan Details

Site Domain sport.sky.it
Base Domain sky.it
Scan Status Ok
Last Scan2024-09-20T01:23:42+00:00
Next Scan 2024-09-27T01:23:42+00:00

Last Scan

Scanned2024-09-20T01:23:42+00:00
URL https://sport.sky.it/robots.txt
Domain IPs 125.56.219.17, 23.32.29.106
Response IP 125.56.219.17
Found Yes
Hash db5a5efe04cf83d688e7ecc9e78696bd9553111d9bb5de3eaad105e2868693e1
SimHash 4d04d57025b9

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Allow /content/skysport/it/configurazioni/spalle/new/articoli/default/jcr%3Acontent/shoulder-up/parsely
Disallow /AdvTest/*
Disallow /video/test/*
Disallow /content/*
Disallow /*jcr_content*/
Disallow /appuntamenti-visione/
Disallow /calcio_italiano/
Disallow /calcio_estero/
Disallow /VoteService/
Disallow /champions_league/
Disallow /Meteo24Backend/
Disallow /altri_sport/
Disallow /search.html
Disallow /*.print.html$
Disallow /*/null$
Disallow /configurazioni/*
Disallow /insider-registrazione
Allow /content/dam/static/contentimages/

Other Records

Field Value
sitemap https://sport.sky.it/sitemap-index.xml
sitemap https://sport.sky.it/sitemap-static.index.xml
sitemap https://sport.sky.it/sitemap-lmp.xml