videnov.bg
robots.txt

Robots Exclusion Standard data for videnov.bg

Resource Scan

Scan Details

Site Domain videnov.bg
Base Domain videnov.bg
Scan Status Ok
Last Scan2024-05-25T11:34:56+00:00
Next Scan 2024-06-24T11:34:56+00:00

Last Scan

Scanned2024-05-25T11:34:56+00:00
URL https://videnov.bg/robots.txt
Domain IPs 104.26.4.105, 104.26.5.105, 172.67.68.141
Response IP 104.26.4.105
Found Yes
Hash cc338d1f745fb8bf5b9f7c4df89a139d74226fab16214ec6753952198ce9219c
SimHash 2450d8125023

Groups

*

Rule Path
Allow /
Allow /products
Allow /products/
Allow /tailored-kitchens/
Allow /page/
Disallow /admin/
Allow /themes/
Allow /css/
Allow /custom/
Allow /images/
Allow /js/
Allow /vendor/
Disallow /cart
Disallow /cart/
Disallow /checkout
Disallow /checkout/
Disallow /autocomplete/
Disallow /ajax/
Disallow /switchlang/
Disallow /oauth/
Disallow /facebook_export_feed
Disallow /*?page
Disallow /*?ajax
Disallow /*?vtm
Disallow /*.pdf$

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /
Allow /uploads/

Other Records

Field Value
sitemap https://videnov.bg/sitemap
sitemap https://videnov.bg/sitemap-images

Warnings

  • 2 invalid lines.
  • `host` is not a known field.