rockworld.lt
robots.txt

Robots Exclusion Standard data for rockworld.lt

Resource Scan

Scan Details

Site Domain rockworld.lt
Base Domain rockworld.lt
Scan Status Ok
Last Scan5/15/2025, 12:12:36 AM
Next Scan 6/14/2025, 12:12:36 AM

Last Scan

Scanned5/15/2025, 12:12:36 AM
URL https://rockworld.lt/robots.txt
Domain IPs 104.21.78.56, 172.67.217.52, 2606:4700:3034::6815:4e38, 2606:4700:3034::ac43:d934
Response IP 104.21.78.56
Found Yes
Hash 5b12f3420e23e771971fceb501ec200ac8e6cdc044c2ff540ba8c4be9614092c
SimHash ca4edc52ee93

Groups

*

Rule Path
Disallow /admin/trackonline.php

dotbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.rockworld.lt/static/sitemap-all.xml
sitemap https://www.rockworld.lt/static/sitemap-photos.xml
sitemap https://www.rockworld.lt/static/sitemap-prods.xml
sitemap https://www.rockworld.lt/static/sitemap-arts.xml