brest.by
robots.txt

Robots Exclusion Standard data for brest.by

Resource Scan

Scan Details

Site Domain brest.by
Base Domain brest.by
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-06T06:46:19+00:00
Next Scan 2026-02-04T06:46:19+00:00

Last Successful Scan

Scanned2024-12-18T05:26:24+00:00
URL https://brest.by/robots.txt
Domain IPs 178.208.69.193
Response IP 178.208.69.193
Found Yes
Hash c6ffa66614c0037605c7a0fe78300e871d74ffb2db04e184efd9ba7cc1e21145
SimHash 554dc7b057f4

Groups

yandex

Rule Path
Disallow /Directory.wssp?
Disallow /Lists/*
Disallow /Session/*
Allow /news/*

googlebot

Rule Path
Disallow /Directory.wssp?
Disallow /Lists/*
Disallow /Session/*
Disallow /news/*

googlebot-news

Rule Path
Disallow /Directory.wssp?
Disallow /Lists/*
Disallow /Session/*
Disallow /news/*

Warnings

  • `host` is not a known field.