inida.lt
robots.txt

Robots Exclusion Standard data for inida.lt

Resource Scan

Scan Details

Site Domain inida.lt
Base Domain inida.lt
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T14:46:34+00:00
Next Scan 2024-12-15T14:46:34+00:00

Last Successful Scan

Scanned2024-04-27T14:45:16+00:00
URL https://inida.lt/robots.txt
Redirect https://www.inida.lt/robots.txt
Redirect Domain www.inida.lt
Redirect Base inida.lt
Domain IPs 87.247.98.238
Redirect IPs 104.21.76.214, 172.67.201.64, 2606:4700:3031::ac43:c940, 2606:4700:3032::6815:4cd6
Response IP 172.67.201.64
Found Yes
Hash 7a0565d371414ed82146b78446f8c0ff1c500b1ce79be4889d55a7a5d82e0f70
SimHash ae1e89404a7c

Groups

ahrefsbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /Core/
Disallow /tmp/
Disallow /views/
Disallow /Setup/
Disallow /log/
Disallow /newsletter/
Disallow /en/newsletter/
Disallow /index.php?cl=newsletter
Disallow /agb/
Disallow /en/terms/
Disallow /warenkorb/
Disallow /en/cart/
Disallow /index.php?cl=basket
Disallow /mein-konto/
Disallow /en/my-account/
Disallow /index.php?cl=account
Disallow /mein-merkzettel/
Disallow /en/my-wishlist/
Disallow /index.php?cl=account_noticelist
Disallow /mein-wunschzettel/
Disallow /en/my-gift-registry/
Disallow /index.php?cl=account_wishlist
Disallow /konto-eroeffnen/
Disallow /en/open-account/
Disallow /index.php?cl=register
Disallow /passwort-vergessen/
Disallow /en/forgot-password/
Disallow /index.php?cl=forgotpwd
Disallow /index.php?cl=moredetails
Disallow /index.php?cl=review
Disallow /index.php?cl=search
Disallow /EXCEPTION_LOG.txt
Disallow /*?cl=newsletter
Disallow /*%26cl%3Dnewsletter
Disallow /*?cl=basket
Disallow /*%26cl%3Dbasket
Disallow /*?cl=account
Disallow /*%26cl%3Daccount
Disallow /*?cl=account_noticelist
Disallow /*%26cl%3Daccount_noticelist
Disallow /*?cl=account_wishlist
Disallow /*%26cl%3Daccount_wishlist
Disallow /*?cl=register
Disallow /*%26cl%3Dregister
Disallow /*?cl=forgotpwd
Disallow /*%26cl%3Dforgotpwd
Disallow /*?cl=moredetails
Disallow /*%26cl%3Dmoredetails
Disallow /*?cl=review
Disallow /*%26cl%3Dreview
Disallow /*?cl=search
Disallow /*%26cl%3Dsearch
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*?cur=
Disallow /*%26cur

Other Records

Field Value
sitemap https://www.inida.lt/sitemap.txt

Comments

  • wildcards at the end, because of some crawlers see it as errors