annunciindustriali.it
robots.txt
Robots Exclusion Standard data for annunciindustriali.it
Resource Scan
Scan Details
| Site Domain | annunciindustriali.it |
| Base Domain | annunciindustriali.it |
| Scan Status | Ok |
| Last Scan | 2024-11-05T06:01:21+00:00 |
| Next Scan | 2024-12-05T06:01:21+00:00 |
Last Scan
| Scanned | 2024-11-05T06:01:21+00:00 |
| URL | https://annunciindustriali.it/robots.txt |
| Redirect | https://www.annunciindustriali.it/robots.txt |
| Redirect Domain | www.annunciindustriali.it |
| Redirect Base | annunciindustriali.it |
| Domain IPs | 65.9.112.45, 65.9.112.58, 65.9.112.59, 65.9.112.7 |
| Redirect IPs | 107.154.77.118 |
| Response IP | 107.154.77.118 |
| Found | Yes |
| Hash | c1801793e8a26cf231617ceff7e86ca51cfeb4ff230e798fdb04559c486675f1 |
| SimHash | 7a070b10e133 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /login |
| Disallow | /*.php$ |
| Disallow | /*.pdf$ |
yandex
yandexturbo
yandexbot
yandexbot/3.0
baiduspider
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
moget
ichiro
naverbot
yeti
| Rule | Path |
|---|---|
| Disallow | / |
dotbot
dotbot/1.1
mj12bot
ahrefsbot
rogerbot/1.0
yandexmetrika
yandexmetrika/2.0
xenu's
xenu's link sleuth 1.1c
sistrix
ahrefsbot/5.2
ahrefsbot
seokicks
seokicks-robot
yisouspider
| Rule | Path |
|---|---|
| Disallow | / |
bingbot
msnbot
slurp
semrushbot
semrushbot-sa
semrushbot-ba
deepcrawl
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.annunciindustriali.it/sitemap-it-indice.xml |
Comments