blizko.by
robots.txt

Robots Exclusion Standard data for blizko.by

Resource Scan

Scan Details

Site Domain blizko.by
Base Domain blizko.by
Scan Status Ok
Last Scan2024-11-13T23:23:20+00:00
Next Scan 2024-11-20T23:23:20+00:00

Last Scan

Scanned2024-11-13T23:23:20+00:00
URL https://blizko.by/robots.txt
Domain IPs 178.172.172.93
Response IP 178.172.172.93
Found Yes
Hash 625dc71cc04fcad8b04e1d0b08ff6a515e062fb318f5ea70c803cc889e8ffeed
SimHash 6a42ddd49213

Groups

*

Rule Path
Allow /
Disallow /users/
Disallow */edit$

yandexnews

Rule Path
Allow /feed.rss

yandex

Rule Path
Disallow *.amp

sebot-wa

Rule Path
Disallow /notes/
Disallow /sales/
Disallow /regions/
Disallow /metros/
Disallow /companies/
Disallow /topics/
Disallow /articles$

Other Records

Field Value
sitemap https://blizko.by/sitemap.xml.gz

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.