bigl.ua
robots.txt

Robots Exclusion Standard data for bigl.ua

Resource Scan

Scan Details

Site Domain bigl.ua
Base Domain bigl.ua
Scan Status Ok
Last Scan2024-06-05T09:30:33+00:00
Next Scan 2024-06-12T09:30:33+00:00

Last Scan

Scanned2024-06-05T09:30:33+00:00
URL https://bigl.ua/robots.txt
Domain IPs 193.34.169.35
Response IP 193.34.169.35
Found Yes
Hash e41c89e52478fab38a371eb439fda6a2d618654769344c37831208f9f42092a1
SimHash cb0d72b17ff2

Groups

*

Rule Path
Disallow /*?
Disallow /search
Disallow /redirect
Disallow /debug/
Disallow /iframe.html
Disallow /remote/
Disallow /catalog/
Disallow /js/ckeditor_latest/
Disallow /opensearch.xml
Disallow /R0lGODlhAQABAAAAACH5BAEKAAEALAAAAAABAAEAAAICTAEAOw%3D%3D

yadirectbot

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

obot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

wget

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

x11

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

rambler

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

trident

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bigl.ua/ua/sitemap.xml

Warnings

  • `host` is not a known field.