technologijos.lt
robots.txt

Robots Exclusion Standard data for technologijos.lt

Resource Scan

Scan Details

Site Domain technologijos.lt
Base Domain technologijos.lt
Scan Status Ok
Last Scan2024-09-20T12:43:35+00:00
Next Scan 2024-09-27T12:43:35+00:00

Last Scan

Scanned2024-09-20T12:43:35+00:00
URL http://technologijos.lt/robots.txt
Domain IPs 185.58.65.36
Response IP 185.58.65.36
Found Yes
Hash 91d25a2994414a96424d5a11b72a2b960a3a9b5ea8e0fcdbc937eeb93e1995f6
SimHash 2d5ed8c041f4

Groups

google
google
googlebot
googlebot
mediapartners-google

Rule Path
Disallow

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /