zvejams.lt
robots.txt

Robots Exclusion Standard data for zvejams.lt

Resource Scan

Scan Details

Site Domain zvejams.lt
Base Domain zvejams.lt
Scan Status Ok
Last Scan2024-11-07T12:31:48+00:00
Next Scan 2024-11-14T12:31:48+00:00

Last Scan

Scanned2024-11-07T12:31:48+00:00
URL https://zvejams.lt/robots.txt
Redirect https://www.zvejams.lt/robots.txt
Redirect Domain www.zvejams.lt
Redirect Base zvejams.lt
Domain IPs 195.35.58.180, 2a02:4780:9:1265:0:10a4:e44a:b
Redirect IPs 195.35.58.180, 2a02:4780:9:1265:0:10a4:e44a:b
Response IP 195.35.58.180
Found Yes
Hash 8e47c555650cd55ce541fe3598a51384b100437570298d00ec4b7c94552ee271
SimHash a31cc4f06a98

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /xmlrpc/

bingbot

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /templates/
Disallow /tmp/
Disallow /xmlrpc/

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /