siuskpigiau.lt
robots.txt

Robots Exclusion Standard data for siuskpigiau.lt

Resource Scan

Scan Details

Site Domain siuskpigiau.lt
Base Domain siuskpigiau.lt
Scan Status Ok
Last Scan2025-05-23T08:16:05+00:00
Next Scan 2025-06-22T08:16:05+00:00

Last Scan

Scanned2025-05-23T08:16:05+00:00
URL https://siuskpigiau.lt/robots.txt
Redirect https://www.siuskpigiau.lt/robots.txt
Redirect Domain www.siuskpigiau.lt
Redirect Base siuskpigiau.lt
Domain IPs 104.21.3.124, 172.67.130.178, 2606:4700:3032::6815:37c, 2606:4700:3033::ac43:82b2
Redirect IPs 104.21.3.124, 172.67.130.178, 2606:4700:3032::6815:37c, 2606:4700:3033::ac43:82b2
Response IP 172.67.130.178
Found Yes
Hash cb1f7d4285ca2fe1a7f168df11820b35fe28ca678f9505235359f25484f32e1c
SimHash 631b1d64edb0

Groups

*

Rule Path
Disallow /admin*
Disallow /quote*
Disallow /order*
Disallow /acc_shop*
Disallow /address_book*
Disallow /acc_credits*
Disallow /acc_track*
Disallow /acc_account*
Disallow /acc_sf*
Disallow /acc_messages*
Disallow /acc_shop*
Disallow /acc_prepay*
Disallow /account*
Disallow /confirm-order*
Disallow /checkoutCart*
Disallow /payment*
Disallow /acc_cart*
Disallow /acc_orders*

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap https://www.siuskpigiau.lt/sitemap.xml

Warnings

  • `host` is not a known field.