laminat-fargo.ru
robots.txt

Robots Exclusion Standard data for laminat-fargo.ru

Resource Scan

Scan Details

Site Domain laminat-fargo.ru
Base Domain laminat-fargo.ru
Scan Status Ok
Last Scan2024-09-15T22:06:34+00:00
Next Scan 2024-10-15T22:06:34+00:00

Last Scan

Scanned2024-09-15T22:06:34+00:00
URL https://laminat-fargo.ru/robots.txt
Domain IPs 77.222.52.54
Response IP 77.222.52.54
Found Yes
Hash 6e5faa5b9bab8a06da65dca3050a26b8a522dfc29081973dedd46cae34b1f934
SimHash 4f48c8f74491

Groups

*

Rule Path
Disallow /bitrix/
Disallow /auth*
Disallow /personal/
Disallow /ajax/

Other Records

Field Value
crawl-delay 20

yandex

Rule Path
Allow /sitemap.xml
Disallow /bitrix/

yandexbot

Rule Path
Disallow /sitemap.xml
Disallow /bitrix/

yandexmedia

Rule Path
Disallow /sitemap.xml
Disallow /bitrix/

yandeximages

Rule Path
Allow /sitemap.xml
Disallow /bitrix/

yandexblogs

Rule Path
Disallow /bitrix/

googlebot

Rule Path
Allow /sitemap.xml
Disallow /bitrix/

googlebot-news

Rule Path
Allow /sitemap.xml
Disallow /bitrix/

googlebot-image

Rule Path
Allow /sitemap.xml
Disallow /bitrix/

Other Records

Field Value
sitemap https://laminat-fargo.ru/sitemap.xml

Warnings

  • `host` is not a known field.