fallimentodeiulemarcdn.it
robots.txt

Robots Exclusion Standard data for fallimentodeiulemarcdn.it

Resource Scan

Scan Details

Site Domain fallimentodeiulemarcdn.it
Base Domain fallimentodeiulemarcdn.it
Scan Status Ok
Last Scan2025-08-07T16:42:40+00:00
Next Scan 2025-09-06T16:42:40+00:00

Last Scan

Scanned2025-08-07T16:42:40+00:00
URL https://fallimentodeiulemarcdn.it/robots.txt
Domain IPs 104.21.21.197, 172.67.200.19, 2606:4700:3033::ac43:c813, 2606:4700:3035::6815:15c5
Response IP 104.21.21.197
Found Yes
Hash 676ee92d62d44913dd6ba0795240d72ad2f4f8396fd551bc35cb42b3fe60b8ad
SimHash ad46dc2ac3a3

Groups

*

Rule Path
Disallow /?where=documenti
Disallow /?where=stream_list
Disallow /download*
Disallow /dataroom_download*

Other Records

Field Value
crawl-delay 20

Warnings

  • `request-rate` is not a known field.
  • `visit-time` is not a known field.