opt-trading.ru
robots.txt

Robots Exclusion Standard data for opt-trading.ru

Resource Scan

Scan Details

Site Domain opt-trading.ru
Base Domain opt-trading.ru
Scan Status Ok
Last Scan2024-06-14T10:05:03+00:00
Next Scan 2024-07-14T10:05:03+00:00

Last Scan

Scanned2024-06-14T10:05:03+00:00
URL https://opt-trading.ru/robots.txt
Domain IPs 45.130.41.10
Response IP 45.130.41.10
Found Yes
Hash 0c6162291bfda2a021abff06a31b1d18ac79dde7a6913f3ffd6335a8044e7eb8
SimHash 4e78d043c3f0

Groups

*

Rule Path
Disallow /

Comments

  • wa shop *
  • Disallow: /my/
  • Disallow: /checkout/
  • Disallow: /*?cart=quick_full
  • Disallow: /search/*
  • wa shop
  • wa shop old/*
  • Disallow: /old/my/
  • Disallow: /old/checkout/
  • wa shop
  • Crawl-delay: 10
  • User-agent: GoogleBot
  • wa shop *
  • Disallow: /my/
  • Disallow: /checkout/
  • Disallow: /*?cart=quick_full
  • Disallow: /search/*
  • wa shop
  • wa shop old/*
  • Disallow: /old/my/
  • Disallow: /old/checkout/
  • wa shop
  • Crawl-delay: 10
  • User-agent: Yandex
  • wa shop *
  • Disallow: /my/
  • Disallow: /checkout/
  • Disallow: /*?cart=quick_full
  • Disallow: /search/*
  • wa shop
  • wa shop old/*
  • Disallow: /old/my/
  • Disallow: /old/checkout/
  • wa shop
  • Crawl-delay: 10

Warnings

  • `host` is not a known field.