agata.lt
robots.txt

Robots Exclusion Standard data for agata.lt

Resource Scan

Scan Details

Site Domain agata.lt
Base Domain agata.lt
Scan Status Ok
Last Scan2025-05-22T11:14:14+00:00
Next Scan 2025-06-21T11:14:14+00:00

Last Scan

Scanned2025-05-22T11:14:14+00:00
URL https://agata.lt/robots.txt
Redirect https://www.agata.lt/robots.txt
Redirect Domain www.agata.lt
Redirect Base agata.lt
Domain IPs 92.61.37.121
Redirect IPs 92.61.37.121
Response IP 92.61.37.121
Found Yes
Hash 85d00e991cf787ca574514a57c1fca47ef1c3744eba1dd4d3f8226f33a9d5053
SimHash 6118d8e0cbb0

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

Comments

  • Robots crowl-delay