Log In Sign Up

andalus.com.kw
robots.txt

Robots Exclusion Standard data for andalus.com.kw

Resource Scan

Scan Details

Site Domain andalus.com.kw
Base Domain andalus.com.kw
Scan Status Ok
Last Scan4/2/2025, 6:14:06 PM
Next Scan 5/2/2025, 6:14:06 PM

Last Scan

Scanned4/2/2025, 6:14:06 PM
URL https://andalus.com.kw/robots.txt
Domain IPs 104.26.2.134, 104.26.3.134, 172.67.75.87, 2606:4700:20::681a:286, 2606:4700:20::681a:386, 2606:4700:20::ac43:4b57
Response IP 104.26.3.134
Found Yes
Hash 63eabdf5e654e9b694f7a20d20e2657b8758bdcd82c18d40dd9289e7a701c3dc
SimHash 6f5e5848cf48

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

bingbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

applebot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

yandexbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

google images

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

petalbot

Rule Path
Disallow /

moz dotbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

barkrowler

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

dataforseo bot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

semrush

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

botify

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

ahrefs site audit

Rule Path
Disallow /

blexbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

seekport

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

siteimprove crawl

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

baidu

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

siteauditbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

duckduckbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

zoominfo

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

sogou

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

cốc cốc

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

yeti by naver

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

cxense

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

coveo bot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

qwant

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

yahoo slurp

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

google videos

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

marginalia search

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

seznam

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

msn

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

mojeek

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

dataforseo

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

moz rogerbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

mars finder

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

duckassistbot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

marketgoo

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

google scholar

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

alexa site audit

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

notabot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

alexa archive

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

prerender

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

alexa

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

addthis

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

kagi bot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

pressengine bot

Rule Path
Disallow /en/catalogsearch/
Disallow /ar/catalogsearch/

blexbot

Rule Path
Disallow /
Back to top