bakkalinternational.com
robots.txt

Robots Exclusion Standard data for bakkalinternational.com

Resource Scan

Scan Details

Site Domain bakkalinternational.com
Base Domain bakkalinternational.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T05:32:49+00:00
Next Scan 2024-12-18T05:32:49+00:00

Last Successful Scan

Scanned2024-04-29T18:25:08+00:00
URL https://bakkalinternational.com/robots.txt
Redirect https://www.bakkalinternational.com/robots.txt
Redirect Domain www.bakkalinternational.com
Redirect Base bakkalinternational.com
Domain IPs 208.117.87.225
Redirect IPs 208.117.87.225
Response IP 208.117.87.225
Found Yes
Hash f5053516efd84d89afe3e81d401a0ae434b506f3431114028ea77c15f40c2bb7
SimHash 483845c2469a

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /xmlrpc.php

a6-indexer

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

applebot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blackboard safeassign

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

qwant-news

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

Comments

  • Block bots
  • applebot