klinq.com
robots.txt

Robots Exclusion Standard data for klinq.com

Resource Scan

Scan Details

Site Domain klinq.com
Base Domain klinq.com
Scan Status Ok
Last Scan2025-06-14T06:54:28+00:00
Next Scan 2025-06-28T06:54:28+00:00

Last Scan

Scanned2025-06-14T06:54:28+00:00
URL https://klinq.com/robots.txt
Domain IPs 104.26.4.211, 104.26.5.211, 172.67.73.19, 2606:4700:20::681a:4d3, 2606:4700:20::681a:5d3, 2606:4700:20::ac43:4913
Response IP 104.26.4.211
Found Yes
Hash 2bc3eeaa4444786e87a12d6c88598ff6292c894b891061c8461d41146fe355dd
SimHash 9c5f5ad1c4f7

Groups

*

Rule Path
Allow /
Disallow /en/customer/account/login/referer/
Disallow /ar/customer/account/login/referer/
Disallow /en/shop-all.html
Disallow /ar/shop-all.html
Disallow /en/oriental-fragrances/perfumes.html
Disallow /ar/oriental-fragrances/perfumes.html
Disallow /en/catalog/
Disallow /ar/catalog/
Disallow /en/catalogsearch/result/
Disallow /ar/catalogsearch/result/

mozilla

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://klinq.com/media/sitemap/sitemap.xml
sitemap https://klinq.com/media/sitemap/sitemap_ar.xml