Log In Sign Up

indoteknik.com
robots.txt

Robots Exclusion Standard data for indoteknik.com

Resource Scan

Scan Details

Site Domain indoteknik.com
Base Domain indoteknik.com
Scan Status Ok
Last Scan2026-02-21T21:37:54+00:00
Next Scan 2026-03-23T21:37:54+00:00

Last Scan

Scanned2026-02-21T21:37:54+00:00
URL https://indoteknik.com/robots.txt
Domain IPs 104.21.74.92, 172.67.201.17, 2606:4700:3034::6815:4a5c, 2606:4700:3035::ac43:c911
Response IP 172.67.201.17
Found Yes
Hash ab70ba1890037d909963fbc3137eb7662b17fe8beb9887cdf6bdbdad602a340e
SimHash 44b1ab316794

Groups

*
googlebot
googlebot-mobile

Rule Path
Disallow /shop/product/pdf/*
Disallow /shop/product/wishlist/*
Disallow /shop/product/https%3A//*
Disallow /v1/*
Disallow /shop/search?*=*
Disallow /shop/cart
Disallow /shop/checkout
Disallow /my/*
Disallow /shop/search/*

adsbot-google

Rule Path
Allow /my/*
Allow /shop/search/*
Back to top

Other Records

Field Value
sitemap https://indoteknik.com/sitemap/products.xml
sitemap https://indoteknik.com/sitemap/brands.xml
sitemap https://indoteknik.com/sitemap/categories.xml
sitemap https://indoteknik.com/sitemap/videos.xml
Back to top

Comments

  • This says to apply these settings to ALL search engine spiders/crawlers
  • User-agent: *
  • Version 1.0
Back to top