bevedo.ro
robots.txt

Robots Exclusion Standard data for bevedo.ro

Resource Scan

Scan Details

Site Domain bevedo.ro
Base Domain bevedo.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-16T11:57:42+00:00
Next Scan 2025-12-15T11:57:42+00:00

Last Successful Scan

Scanned2022-10-12T18:22:25+00:00
URL https://bevedo.ro/robots.txt
Redirect https://www.bevedo.ro/robots.txt
Redirect Domain www.bevedo.ro
Redirect Base bevedo.ro
Response IP 172.67.147.151, 104.21.28.210
Found Yes
Hash dab20d739aa54e2e068bbdbfb1a2127d1983fe506f0026ec57fa1e5829cc5013
SimHash 0a18d957d6f1

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow
Disallow /product/click-eshop/

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 16

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 18

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

spiderling

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71

Rule Path
Disallow /
Disallow /admin/
Disallow /auth/

Other Records

Field Value
sitemap https://www.bevedo.ro/sitemap_index.xml