datika.me
robots.txt

Robots Exclusion Standard data for datika.me

Resource Scan

Scan Details

Site Domain datika.me
Base Domain datika.me
Scan Status Ok
Last Scan2025-10-20T09:50:44+00:00
Next Scan 2025-11-19T09:50:44+00:00

Last Scan

Scanned2025-10-20T09:50:44+00:00
URL https://datika.me/robots.txt
Domain IPs 104.21.72.8, 172.67.173.102, 2606:4700:3036::6815:4808, 2606:4700:3037::ac43:ad66
Response IP 172.67.173.102
Found Yes
Hash adf7e3c0ac8b8a4aa671f9c22e679104ec0fb3e9c83a58d07228070196920f03
SimHash e50d3675e77b

Groups

*

Rule Path
Disallow *%26sort%3D
Disallow */?sort=
Disallow /pickup/*/?
Disallow /pickup/
Disallow /category/*/?
Disallow /search/?query=
Disallow /compare/
Disallow /tag/
Disallow /cart/
Disallow /checkout/
Disallow /my/
Disallow /signup/
Disallow /login/
Disallow /forgotpassword/
Disallow /webasyst/
Disallow /ru/category/*/?
Disallow /ru/search/?query=
Disallow /ru/compare/
Disallow /ru/tag/
Disallow /ru/cart/
Disallow /ru/checkout/
Disallow /ru/my/
Disallow /ru/signup/
Disallow /ru/login/
Disallow /ru/forgotpassword/
Disallow /ru/webasyst/
Disallow /en/category/*/?
Disallow /en/search/?query=
Disallow /en/compare/
Disallow /en/tag/
Disallow /en/cart/
Disallow /en/checkout/
Disallow /en/my/
Disallow /en/signup/
Disallow /en/login/
Disallow /en/forgotpassword/
Disallow /en/webasyst/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /mailer/unsubscribe/

Other Records

Field Value
sitemap https://datika.me/sitemap.xml

Comments

  • wa mailer mailer/*
  • wa mailer