crowdbase.it
robots.txt

Robots Exclusion Standard data for crowdbase.it

Resource Scan

Scan Details

Site Domain crowdbase.it
Base Domain crowdbase.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-04T15:20:55+00:00
Next Scan 2026-01-02T15:20:55+00:00

Last Successful Scan

Scanned2025-02-14T09:59:14+00:00
URL https://crowdbase.it/robots.txt
Domain IPs 20.16.10.123
Response IP 20.16.10.123
Found Yes
Hash c7757a1b9dae8ea237d06a4c2a375dea62127cebb2315262221d8987c1038563
SimHash 6d414044e591

Groups

*

Rule Path
Disallow /OLD