Log In Sign Up

visilab.ch
robots.txt

Robots Exclusion Standard data for visilab.ch

Resource Scan

Scan Details

Site Domain visilab.ch
Base Domain visilab.ch
Scan Status Ok
Last Scan2025-05-15T08:43:43+00:00
Next Scan 2025-06-14T08:43:43+00:00

Last Scan

Scanned2025-05-15T08:43:43+00:00
URL https://visilab.ch/robots.txt
Redirect https://www.visilab.ch:443/robots.txt
Redirect Domain www.visilab.ch
Redirect Base visilab.ch
Domain IPs 52.213.166.124, 52.48.84.216
Redirect IPs 104.18.10.207, 104.18.11.207, 2606:4700::6812:acf, 2606:4700::6812:bcf
Response IP 104.18.11.207
Found Yes
Hash 09e3ed98bc82142c3296d2e54be001d8e0983b5602e49b0becb001ccc527dc8b
SimHash bb08033b64d0

Groups

*

Rule Path
Disallow /*.git$
Disallow /*.svn$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.log$
Disallow /*?childSku*
Disallow /*?sort*
Disallow /*?vg_
Disallow /*%26vg_
Disallow /*?price=
Disallow /*%26price%3D

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v*

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

mj12bot/v1.4.3

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.visilab.ch/sitemap.xml
Back to top

Comments

  • Crawlers Setup
  • Do not crawl development files and folders (GIT/SVN directories, dump files etc.)
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl sub system directories
  • Disallow: /api/
  • Do not crawl filtered categories
  • Disable agressive crawlers
Back to top