mebel.by
robots.txt

Robots Exclusion Standard data for mebel.by

Resource Scan

Scan Details

Site Domain mebel.by
Base Domain mebel.by
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-27T13:37:20+00:00
Next Scan 2026-02-25T13:37:20+00:00

Last Successful Scan

Scanned2025-07-30T07:15:38+00:00
URL https://mebel.by/robots.txt
Domain IPs 93.125.99.79
Response IP 93.125.99.79
Found Yes
Hash 7d858423033c8e306c3b72dba8d5422d5cbb26cdefc2e8a863baa8e046f54507
SimHash a00ee86ef502

Groups

appengine-google

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

*

Rule Path
Disallow /*.asp*
Disallow /index.php*
Disallow /Resources/*
Disallow /sorting/*
Disallow /database*
Disallow /tist/*
Disallow /*page%3D*
Disallow /*FIRMS_ID%3D*
Disallow /mebelby/*
Disallow /mobile/*
Disallow /pc/mebelby/*
Disallow /search.php*
Disallow /garbage.php*
Disallow /pc/photoedit.php*
Disallow /PHP/translit.php*
Disallow /imgcreated.php*
Disallow /imgresize.php*
Disallow /info_goods_old.php*
Disallow /mailto.php*
Disallow /mailtosend.php*
Disallow /mebelbase.php*
Disallow /mobileDetect.php*
Disallow /parser.php*
Disallow /recaptchalib.php*
Disallow /testmobile.php*
Disallow /old_magaziny.php*
Disallow /STROBE/*
Disallow /stethoscope/*

Other Records

Field Value
sitemap https://mebel.by/sitemap.xml