skysport.it
robots.txt

Robots Exclusion Standard data for skysport.it

Resource Scan

Scan Details

Site Domain skysport.it
Base Domain skysport.it
Scan Status Ok
Last Scan2024-06-28T14:00:48+00:00
Next Scan 2024-07-05T14:00:48+00:00

Last Scan

Scanned2024-06-28T14:00:48+00:00
URL https://skysport.it/robots.txt
Redirect https://sport.sky.it/robots.txt
Redirect Domain sport.sky.it
Redirect Base sky.it
Domain IPs 185.26.140.72, 185.26.143.172
Redirect IPs 23.215.7.25, 23.215.7.29
Response IP 125.56.219.17
Found Yes
Hash 6cda0151f9fe6f6fabcccb9ae5ccd5256a5e6f32b7928bf2c33669bc8f542f6c
SimHash 4d04d57225b9

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Allow /content/skysport/it/configurazioni/spalle/new/articoli/default/jcr%3Acontent/shoulder-up/parsely
Disallow /AdvTest/*
Disallow /video/test/*
Disallow /content/*
Disallow /*jcr_content*/
Disallow /appuntamenti-visione/
Disallow /calcio_italiano/
Disallow /calcio_estero/
Disallow /VoteService/
Disallow /champions_league/
Disallow /Meteo24Backend/
Disallow /altri_sport/
Disallow /search.html
Disallow /*.print.html$
Disallow /*/null$
Disallow /configurazioni/*
Allow /content/dam/static/contentimages/

Other Records

Field Value
sitemap https://sport.sky.it/sitemap-index.xml
sitemap https://sport.sky.it/sitemap-static.index.xml
sitemap https://sport.sky.it/sitemap-lmp.xml