pst.lt
robots.txt

Robots Exclusion Standard data for pst.lt

Resource Scan

Scan Details

Site Domain pst.lt
Base Domain pst.lt
Scan Status Ok
Last Scan2025-10-17T08:15:55+00:00
Next Scan 2025-11-16T08:15:55+00:00

Last Scan

Scanned2025-10-17T08:15:55+00:00
URL https://pst.lt/robots.txt
Redirect https://www.pst.lt/robots.txt
Redirect Domain www.pst.lt
Redirect Base pst.lt
Domain IPs 82.135.169.168
Redirect IPs 82.135.169.168
Response IP 82.135.169.168
Found Yes
Hash b75b96d71c34460d01eeecbe67a64195f352c3f38bd6c74d5087613bb1d69120
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10