lumories.ro
robots.txt

Robots Exclusion Standard data for lumories.ro

Resource Scan

Scan Details

Site Domain lumories.ro
Base Domain lumories.ro
Scan Status Ok
Last Scan2025-10-29T08:34:46+00:00
Next Scan 2025-11-28T08:34:46+00:00

Last Scan

Scanned2025-10-29T08:34:46+00:00
URL https://lumories.ro/robots.txt
Redirect https://www.lumories.ro/robots.txt
Redirect Domain www.lumories.ro
Redirect Base lumories.ro
Domain IPs 34.111.187.42
Redirect IPs 34.111.187.42
Response IP 34.111.187.42
Found Yes
Hash 9d9b68fa202e44bf8fd8c82c38d1ea9137941c8f81b469e85375c62c5c1bfac7
SimHash 4326f0684bdf

Groups

*
adidxbot

Product Comment
adidxbot explicit mentioning of bing ads bot. It does not adhere to the agent wildcard.
Rule Path Comment
Disallow /checkout/ -
Disallow /customer/ -
Disallow /wishlist/ -
Disallow /catalogsearch/ -
Disallow /app/ -
Disallow /lib/ -
Disallow /*.php$ -
Disallow /*SID%3D -
Disallow /index.php/ -
Disallow /banner/ajax -
Disallow /lw_related/ajax -
Disallow /documents/ -
Disallow */article/*nocache%3D -
Disallow /bloom/widget/* -
Disallow /*?*&* block irrelevant filter combinations
Disallow /*?*~* block irrelevant filter value combinations
Disallow /*?*~* block tilde
Disallow /*?*&*&*p=* block irrelevant filter combinations with pagination
Disallow /*?*~*&p=* block irrelevant filter value combinations with pagination
Disallow /*?*~*&p=* block tilde
Allow /*?*&p=* allow relevant filter with pagination
Disallow /*?*___* -
Disallow /*?*category=* -
Disallow /*?*light_bulb=* -
Disallow /*?SESSIONNAME=* -
Allow /*utm_* -
Allow /*lw_view%3Dnocontent* -
Allow /*display%3Dproducts* -
Allow /*lw_om_view%3Drecotop* -
Allow /*block_sku%3D* -

barkrowler
buck
velenpublicwebcrawler
imagesiftbot
blexbot
halobot
iboubot
keydrop
libredtail-http
pingdom.com_bot
pingdompagespeed
sansec security monitor
sebot-wa
semrushbot
serpstatbot
snapchat
sqlmap
thinkbot
timpibot
twitterbot
uptimerobot
zgrab

Rule Path
Disallow *

gptbot
applebot

Rule Path
Disallow /*?*p=*

adsbot-google-mobile

Rule Path
Disallow /bloom/widget/*

adsbot-google

Rule Path
Disallow /bloom/widget/*

mediapartners-google

Rule Path
Disallow /bloom/widget/*

googlebot-image

Rule Path
Disallow /bloom/widget/*

googlebot-video

Rule Path
Disallow /bloom/widget/*

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.lumories.ro/media/sitemap/sitemap_ro_ro.xml

Comments

  • Disallow not needed crawlers
  • Disallow pagination crawls where not needed
  • Disallow widget crawls