lensa.ro
robots.txt

Robots Exclusion Standard data for lensa.ro

Resource Scan

Scan Details

Site Domain lensa.ro
Base Domain lensa.ro
Scan Status Ok
Last Scan2025-03-05T14:15:07+00:00
Next Scan 2025-03-19T14:15:07+00:00

Last Scan

Scanned2025-03-05T14:15:07+00:00
URL https://lensa.ro/robots.txt
Domain IPs 104.26.0.64, 104.26.1.64, 172.67.71.205
Response IP 172.67.71.205
Found Yes
Hash be8ea6e9bd260677f744e08dbbe66d625ac78b41b0380be53cb7e05a63c45a34
SimHash 7b85fc7085d1

Groups

*

Rule Path
Allow /shopping/programare-consultatie/
Disallow /images/b$
Disallow /images/b/*
Disallow /*?print_version*
Disallow /*/pagina*/filtre/*
Disallow /wishlist$
Disallow /wishlist/*
Disallow /ajax$
Disallow /ajax/*
Disallow /alerta-*
Disallow /anunta-un-prieten$
Disallow /anunta-un-prieten/*
Disallow /asistenta-clienti$
Disallow /asistenta-clienti/*
Disallow /rating$
Disallow /rating/*
Disallow /click$
Disallow /click/*
Disallow /galerie-imagini$
Disallow /galerie-imagini/*
Disallow /incarca-foto$
Disallow /incarca-foto/*
Disallow /comentarii$
Disallow /comentarii/*
Disallow /data/feeds*
Disallow /compara$
Disallow /compara/*
Disallow /shopping$
Disallow /shopping/*
Disallow /payment$
Disallow /payment/*
Disallow /search$
Disallow /search/*
Disallow /logout$
Disallow /logout/*
Disallow /opinie-produs$
Disallow /opinie-produs/*
Disallow /package-tracking$
Disallow /package-tracking/*
Disallow /view-messages$
Disallow /view-messages/*
Disallow /fotografii-clienti$
Disallow /fotografii-clienti/*
Disallow /notifications$
Disallow /notifications/*
Disallow /*htaccess*
Disallow /admin$
Disallow /admin/*
Disallow /*/remote$
Disallow /*/remote/*
Disallow /runtime$
Disallow /runtime/*
Disallow /*/include$
Disallow /*/include/*
Disallow /*/utils$
Disallow /*/utils/*
Disallow /monitor$
Disallow /monitor/*
Disallow /*/parsers$
Disallow /*/parsers/*
Disallow /*/spiders$
Disallow /*/spiders/*
Disallow /*.php
Disallow /*.tpl
Disallow /*.csv
Disallow /*.parser
Disallow /*.svn*
Disallow /*.svn*
Disallow /*?hide_sensitive
Disallow /*?show_sensitive
Disallow /*2pau
Disallow /*2ptt
Disallow /*2ptu
Disallow /*2prp
Disallow /*2pdlst
Disallow /*%2C*

Other Records

Field Value
crawl-delay 1

riddler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lensa.ro/sitemap.xml

Comments

  • Disallow: /*/*,*/*
  • Disallow: /*/filtre/*/*/*
  • Disallow: /*/filtre/pret-*