skysporthd.it
robots.txt

Robots Exclusion Standard data for skysporthd.it

Resource Scan

Scan Details

Site Domain skysporthd.it
Base Domain skysporthd.it
Scan Status Ok
Last Scan2024-05-30T01:42:12+00:00
Next Scan 2024-06-06T01:42:12+00:00

Last Scan

Scanned2024-05-30T01:42:12+00:00
URL https://skysporthd.it/robots.txt
Redirect https://sport.sky.it/robots.txt
Redirect Domain sport.sky.it
Redirect Base sky.it
Domain IPs 185.26.140.72, 185.26.143.172
Redirect IPs 65.9.112.113, 65.9.112.71, 65.9.112.80, 65.9.112.90
Response IP 108.157.60.15
Found Yes
Hash 6cda0151f9fe6f6fabcccb9ae5ccd5256a5e6f32b7928bf2c33669bc8f542f6c
SimHash 4d04d57225b9

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Allow /content/skysport/it/configurazioni/spalle/new/articoli/default/jcr%3Acontent/shoulder-up/parsely
Disallow /AdvTest/*
Disallow /video/test/*
Disallow /content/*
Disallow /*jcr_content*/
Disallow /appuntamenti-visione/
Disallow /calcio_italiano/
Disallow /calcio_estero/
Disallow /VoteService/
Disallow /champions_league/
Disallow /Meteo24Backend/
Disallow /altri_sport/
Disallow /search.html
Disallow /*.print.html$
Disallow /*/null$
Disallow /configurazioni/*
Allow /content/dam/static/contentimages/

Other Records

Field Value
sitemap https://sport.sky.it/sitemap-index.xml
sitemap https://sport.sky.it/sitemap-static.index.xml
sitemap https://sport.sky.it/sitemap-lmp.xml