fallimenti.it
robots.txt
Robots Exclusion Standard data for fallimenti.it
Resource Scan
Scan Details
| Site Domain | fallimenti.it |
| Base Domain | fallimenti.it |
| Scan Status | Ok |
| Last Scan | 2024-06-29T16:44:24+00:00 |
| Next Scan | 2024-07-06T16:44:24+00:00 |
Last Scan
| Scanned | 2024-06-29T16:44:24+00:00 |
| URL | https://fallimenti.it/robots.txt |
| Redirect | https://www.fallimenti.it/robots.txt |
| Redirect Domain | www.fallimenti.it |
| Redirect Base | fallimenti.it |
| Domain IPs | 13.226.2.100, 13.226.2.24, 13.226.2.67, 13.226.2.91 |
| Redirect IPs | 107.154.77.118 |
| Response IP | 107.154.77.118 |
| Found | Yes |
| Hash | 50e897ac6be738813d3860bf570be0cf20513a2bb27ed9f1363c1bc710fa1a2c |
| SimHash | eb061f13c123 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /*.php$ |
| Disallow | *totalRows_procedure |
| Disallow | *s_d |
| Disallow | /*.pdf$ |
yandex
yandexturbo
yandexbot
yandexbot/3.0
baiduspider
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot
moget
ichiro
naverbot
yeti
| Rule | Path |
|---|---|
| Disallow | / |
dotbot
dotbot/1.1
mj12bot
ahrefsbot
rogerbot/1.0
yandexmetrika
yandexmetrika/2.0
xenu's
xenu's link sleuth 1.1c
sistrix
ahrefsbot/5.2
ahrefsbot
seokicks
seokicks-robot
yisouspider
| Rule | Path |
|---|---|
| Disallow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.fallimenti.it/sitemap-it-indice.xml |
| sitemap | https://www.fallimenti.it/sitemap-it-news.xml |
Comments