darwa.lt
robots.txt

Robots Exclusion Standard data for darwa.lt

Resource Scan

Scan Details

Site Domain darwa.lt
Base Domain darwa.lt
Scan Status Ok
Last Scan2025-09-27T00:09:23+00:00
Next Scan 2025-10-27T00:09:23+00:00

Last Scan

Scanned2025-09-27T00:09:23+00:00
URL https://darwa.lt/robots.txt
Domain IPs 104.26.0.186, 104.26.1.186, 172.67.68.119, 2606:4700:20::681a:1ba, 2606:4700:20::681a:ba, 2606:4700:20::ac43:4477
Response IP 104.26.0.186
Found Yes
Hash dc2f08337f914b83104b1cc09a2e273eec7d4003cc6fd7046411db9500c6056f
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10