mebelsvetofor.ru
robots.txt

Robots Exclusion Standard data for mebelsvetofor.ru

Resource Scan

Scan Details

Site Domain mebelsvetofor.ru
Base Domain mebelsvetofor.ru
Scan Status Ok
Last Scan5/21/2025, 3:28:34 AM
Next Scan 6/20/2025, 3:28:34 AM

Last Scan

Scanned5/21/2025, 3:28:34 AM
URL https://mebelsvetofor.ru/robots.txt
Domain IPs 46.8.221.247
Response IP 46.8.221.247
Found Yes
Hash f6c3e8b1553cda38caca9c0b8552393ac7551ac60a320ea850a5902b8e52bc7e
SimHash 678c9c627fc1

Groups

*

Rule Path
Disallow /cart
Disallow /spasibo
Disallow /search
Disallow /cabinet
Disallow /statics/thumbnails

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

vedma

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

riddler

Rule Path
Disallow /

detectify

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mebelsvetofor.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.