belwest-katalog.com
robots.txt

Robots Exclusion Standard data for belwest-katalog.com

Resource Scan

Scan Details

Site Domain belwest-katalog.com
Base Domain belwest-katalog.com
Scan Status Ok
Last Scan2024-06-09T17:56:54+00:00
Next Scan 2024-06-16T17:56:54+00:00

Last Scan

Scanned2024-06-09T17:56:54+00:00
URL https://belwest-katalog.com/robots.txt
Domain IPs 104.21.91.18, 172.67.208.49, 2606:4700:3031::ac43:d031, 2606:4700:3037::6815:5b12
Response IP 172.67.208.49
Found Yes
Hash 2ac1a2ba6ace978f7b904c7aba6cb0ad5005b6f0b2fd84ff1e0b9515ac292801
SimHash 0b7543470014

Groups

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /wp-content/uploads/
Disallow /def
Disallow /wp-json*

googlebot

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /def
Disallow /wp-content/uploads/
Disallow /wp-json*

mail.ru

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /def
Disallow /wp-content/uploads/
Disallow /wp-json*

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /?s=*
Disallow /search*
Disallow */trackback/
Disallow */feed
Disallow */comments/
Disallow */comment
Disallow */attachment/*
Disallow */print/
Disallow *?print=*
Disallow */embed*
Disallow /def
Disallow /wp-content/uploads/
Disallow /wp-json*

googlebot-image

Rule Path
Disallow /wp-content/uploads/

yandeximages

Rule Path
Disallow /wp-content/uploads/

mediapartners-google

Rule Path
Disallow

yadirectbot

Rule Path
Disallow

Other Records

Field Value
sitemap https://belwest-katalog.com/sitemap.xml

Warnings

  • `host` is not a known field.