bevedo.com
robots.txt

Robots Exclusion Standard data for bevedo.com

Resource Scan

Scan Details

Site Domain bevedo.com
Base Domain bevedo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-15T15:51:00+00:00
Next Scan 2025-12-14T15:51:00+00:00

Last Successful Scan

Scanned2022-10-10T00:52:05+00:00
URL https://bevedo.com/robots.txt
Redirect https://www.bevedo.com/robots.txt
Redirect Domain www.bevedo.com
Redirect Base bevedo.com
Response IP 104.21.43.240, 172.67.189.6
Found Yes
Hash ac68ba4dbc05666a5833c0a6dbdcfc4f93f412f779fcff34a95b9cc0fbeb2819
SimHash 0a189957d631

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow
Disallow /product/click-eshop/

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 2

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 16

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 18

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 20

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ccbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

spiderling

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

bubing

Rule Path
Disallow /

ltx71

Rule Path
Disallow /
Disallow /admin/
Disallow /auth/

Other Records

Field Value
sitemap https://www.bevedo.com/sitemap_index.xml