stileitaliaedizioni.it
robots.txt

Robots Exclusion Standard data for stileitaliaedizioni.it

Resource Scan

Scan Details

Site Domain stileitaliaedizioni.it
Base Domain stileitaliaedizioni.it
Scan Status Ok
Last Scan2024-08-30T06:39:52+00:00
Next Scan 2024-09-29T06:39:52+00:00

Last Scan

Scanned2024-08-30T06:39:52+00:00
URL https://stileitaliaedizioni.it/robots.txt
Domain IPs 46.37.24.203
Response IP 46.37.24.203
Found Yes
Hash da498cd328d25135480fefe626efe8c9aacd6ffd9ab604cf0a2a69ac5e392df5
SimHash 453c8cb3c09b

Groups

domaincrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /*.jpg
Disallow /*.JPG
Disallow /*.png
Disallow /*.PDF
Disallow /*.pdf
Disallow /*.mp3
Disallow /*.MOV
Disallow /*.mov
Disallow /*.AVI
Disallow /*.avi
Disallow /*.csv
Disallow /*.data

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /riviste/
Disallow /infografiche/
Disallow /provaa/
Disallow /panorama/
Disallow /extrapanorama/
Disallow /__unzipped__/
Disallow /tmp/
Disallow /newsletter/