lexit.it
robots.txt

Robots Exclusion Standard data for lexit.it

Resource Scan

Scan Details

Site Domain lexit.it
Base Domain lexit.it
Scan Status Ok
Last Scan2026-01-02T18:28:26+00:00
Next Scan 2026-02-01T18:28:26+00:00

Last Scan

Scanned2026-01-02T18:28:26+00:00
URL https://lexit.it/robots.txt
Domain IPs 80.66.213.233
Response IP 80.66.213.233
Found Yes
Hash a6a5a5d5b0776fef54b7e5a5da3be45e1d2ebabaabccae2b2b1547e3cbb7ec2a
SimHash 60008b126731

Groups

scrapy

Rule Path
Allow /

*

No rules defined. All paths allowed.