bayna.store
robots.txt

Robots Exclusion Standard data for bayna.store

Resource Scan

Scan Details

Site Domain bayna.store
Base Domain bayna.store
Scan Status Ok
Last Scan2024-09-24T03:03:27+00:00
Next Scan 2024-10-24T03:03:27+00:00

Last Scan

Scanned2024-09-24T03:03:27+00:00
URL https://bayna.store/robots.txt
Domain IPs 103.191.240.228
Response IP 103.191.240.228
Found Yes
Hash 297002f0cff64eba884239b4df1aeb7e4ec1e0576fbbfb6594e12fb9542e7c18
SimHash 6f324358c04d

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /index.php
Disallow /cgi-bin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.com
Disallow /wp-login.php
Disallow /wp-content/plugins/
Disallow /comments/feed/
Disallow /checkout/
Disallow /customer/
Disallow /cart/
Disallow /*index.scss
Disallow /*reqwest/index
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /php.ini
Disallow /https%3A//bayna.store/?login=true&type=forgot-password
Disallow /https%3A//bayna.store/cart/
Disallow /https%3A//bayna.store/checkout/
Disallow /https%3A//bayna.store/my-account/
Disallow /https%3A//bayna.store/wishlist/
Disallow /https%3A//bayna.store/wp-admin/edit-comments.php
Disallow /administrator/
Allow /wp-admin/admin-ajax.php

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot-sa

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot-si

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yahoo pipes 2.0

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

facebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingpreview

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

discordbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

ia_archiver

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

linkedinbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

naverbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

seznambot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

teoma

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

telegrambot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

yeti

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

etaospider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot-adidxbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

spinn3r

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

haosouspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

sogou web spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

sogou inst spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

sogou spider2

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

ninjabot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /public/uploads

Other Records

Field Value
crawl-delay 1

adsbot-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

appengine-google

Rule Path
Allow /
Allow /

Other Records

Field Value
crawl-delay 1
crawl-delay 1
crawl-delay 1

apls-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsense

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot-mobile-web-android

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot-mobile-web

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

adsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-news

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-video

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-desktop

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot-smartphone

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

mobile-adsense

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

mobile-apps-android

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

mobile-feedfetcher

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

google-read-aloud

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

duplex-on-the-web

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

google-favicon

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

web-light

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

google-storebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Warnings

  • 6 invalid lines.
  • `https` is not a known field.
  • `request-rate` is not a known field.