Log In Sign Up

mcoptic.ch
robots.txt

Robots Exclusion Standard data for mcoptic.ch

Resource Scan

Scan Details

Site Domain mcoptic.ch
Base Domain mcoptic.ch
Scan Status Ok
Last Scan2026-01-11T06:53:32+00:00
Next Scan 2026-02-10T06:53:32+00:00

Last Scan

Scanned2026-01-11T06:53:32+00:00
URL https://mcoptic.ch/robots.txt
Redirect https://www.mcoptic.ch:443/robots.txt
Redirect Domain www.mcoptic.ch
Redirect Base mcoptic.ch
Domain IPs 52.30.232.168, 54.155.117.247
Redirect IPs 104.18.10.207, 104.18.11.207, 2606:4700::6812:acf, 2606:4700::6812:bcf
Response IP 104.18.10.207
Found Yes
Hash e184efccf75151b643b56448c99f87c15ae2c2ddcea10673ed68f4bcc4486442
SimHash bb08933b64d0

Groups

*

Rule Path
Disallow /*.git$
Disallow /*.svn$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.log$
Disallow /*?childSku*
Disallow /*?sort*
Disallow /*?vg_
Disallow /*%26vg_
Disallow /*?price=
Disallow /*%26price%3D

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v*

Rule Path
Disallow /

mj12bot/v1.4.0

Rule Path
Disallow /

mj12bot/v1.4.3

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.mcoptic.ch/sitemap.xml
Back to top

Comments

  • Crawlers Setup
  • Do not crawl development files and folders (GIT/SVN directories, dump files etc.)
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl sub system directories
  • Disallow: /api/
  • Do not crawl filtered categories
  • Disable agressive crawlers
Back to top