diamant.ua
robots.txt

Robots Exclusion Standard data for diamant.ua

Resource Scan

Scan Details

Site Domain diamant.ua
Base Domain diamant.ua
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-05T14:39:57+00:00
Next Scan 2024-11-04T14:39:57+00:00

Last Successful Scan

Scanned2024-08-14T06:27:55+00:00
URL https://diamant.ua/robots.txt
Domain IPs 89.184.70.20
Response IP 89.184.70.20
Found Yes
Hash 909af25085f708cd765c111d8b35d346b8f34ed59e34ce26e0239518c272391a
SimHash c94dca43c533

Groups

*

Rule Path
Allow *.css
Allow *.js
Allow *.jpg
Allow *.webp
Allow *.jpeg
Allow *.png
Allow /uploads/
Disallow /assets
Disallow /*eshop
Disallow */order/*
Disallow /*user
Disallow /*search
Disallow /*sort%3D
Disallow */page-*
Disallow *?filter*
Disallow *%26filter*
Disallow */tsena-
Disallow */razmer-
Disallow /*utm_*
Disallow /*clid%3D*
Disallow /rest/
Disallow /graph/

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

vkrobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

stractbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://diamant.ua/sitemap.xml

Warnings

  • `host` is not a known field.