skysport.it
robots.txt

Robots Exclusion Standard data for skysport.it

Resource Scan

Scan Details

Site Domain skysport.it
Base Domain skysport.it
Scan Status Ok
Last Scan2024-11-16T14:11:51+00:00
Next Scan 2024-11-23T14:11:51+00:00

Last Scan

Scanned2024-11-16T14:11:51+00:00
URL https://skysport.it/robots.txt
Redirect https://sport.sky.it/robots.txt
Redirect Domain sport.sky.it
Redirect Base sky.it
Domain IPs 185.26.140.72, 185.26.143.172
Redirect IPs 23.215.7.25, 23.215.7.29
Response IP 125.56.219.3
Found Yes
Hash db5a5efe04cf83d688e7ecc9e78696bd9553111d9bb5de3eaad105e2868693e1
SimHash 4d04d57025b9

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Allow /content/skysport/it/configurazioni/spalle/new/articoli/default/jcr%3Acontent/shoulder-up/parsely
Disallow /AdvTest/*
Disallow /video/test/*
Disallow /content/*
Disallow /*jcr_content*/
Disallow /appuntamenti-visione/
Disallow /calcio_italiano/
Disallow /calcio_estero/
Disallow /VoteService/
Disallow /champions_league/
Disallow /Meteo24Backend/
Disallow /altri_sport/
Disallow /search.html
Disallow /*.print.html$
Disallow /*/null$
Disallow /configurazioni/*
Disallow /insider-registrazione
Allow /content/dam/static/contentimages/

Other Records

Field Value
sitemap https://sport.sky.it/sitemap-index.xml
sitemap https://sport.sky.it/sitemap-static.index.xml
sitemap https://sport.sky.it/sitemap-lmp.xml