afn.by
robots.txt

Robots Exclusion Standard data for afn.by

Resource Scan

Scan Details

Site Domain afn.by
Base Domain afn.by
Scan Status Ok
Last Scan2025-04-10T16:32:56+00:00
Next Scan 2025-04-17T16:32:56+00:00

Last Scan

Scanned2025-04-10T16:32:56+00:00
URL https://afn.by/robots.txt
Domain IPs 62.173.140.157
Response IP 62.173.140.157
Found Yes
Hash 7d2a6ad2863b3101fc910349ee84c35f6dc48b06e9a77be7f3abf7323c6fa14d
SimHash d4089ca2ab30

Groups

*

Rule Path
Disallow /images
Disallow /styles
Disallow /scripts
Disallow /profile
Disallow /files

Other Records

Field Value
crawl-delay 2

yandex

Rule Path
Disallow /images
Disallow /styles
Disallow /scripts
Disallow /profile
Disallow /files

Other Records

Field Value
crawl-delay 2

semrushbot
ahrefsbot
petalbot

Rule Path
Disallow /

Warnings

  • `host` is not a known field.