lensa.ro
robots.txt
Robots Exclusion Standard data for lensa.ro
Resource Scan
Scan Details
Site Domain | lensa.ro |
Base Domain | lensa.ro |
Scan Status | Ok |
Last Scan | 2025-03-05T14:15:07+00:00 |
Next Scan | 2025-03-19T14:15:07+00:00 |
Last Scan
Scanned | 2025-03-05T14:15:07+00:00 |
URL | https://lensa.ro/robots.txt |
Domain IPs | 104.26.0.64, 104.26.1.64, 172.67.71.205 |
Response IP | 172.67.71.205 |
Found | Yes |
Hash | be8ea6e9bd260677f744e08dbbe66d625ac78b41b0380be53cb7e05a63c45a34 |
SimHash | 7b85fc7085d1 |
Groups
*
Rule | Path |
---|---|
Allow | /shopping/programare-consultatie/ |
Disallow | /images/b$ |
Disallow | /images/b/* |
Disallow | /*?print_version* |
Disallow | /*/pagina*/filtre/* |
Disallow | /wishlist$ |
Disallow | /wishlist/* |
Disallow | /ajax$ |
Disallow | /ajax/* |
Disallow | /alerta-* |
Disallow | /anunta-un-prieten$ |
Disallow | /anunta-un-prieten/* |
Disallow | /asistenta-clienti$ |
Disallow | /asistenta-clienti/* |
Disallow | /rating$ |
Disallow | /rating/* |
Disallow | /click$ |
Disallow | /click/* |
Disallow | /galerie-imagini$ |
Disallow | /galerie-imagini/* |
Disallow | /incarca-foto$ |
Disallow | /incarca-foto/* |
Disallow | /comentarii$ |
Disallow | /comentarii/* |
Disallow | /data/feeds* |
Disallow | /compara$ |
Disallow | /compara/* |
Disallow | /shopping$ |
Disallow | /shopping/* |
Disallow | /payment$ |
Disallow | /payment/* |
Disallow | /search$ |
Disallow | /search/* |
Disallow | /logout$ |
Disallow | /logout/* |
Disallow | /opinie-produs$ |
Disallow | /opinie-produs/* |
Disallow | /package-tracking$ |
Disallow | /package-tracking/* |
Disallow | /view-messages$ |
Disallow | /view-messages/* |
Disallow | /fotografii-clienti$ |
Disallow | /fotografii-clienti/* |
Disallow | /notifications$ |
Disallow | /notifications/* |
Disallow | /*htaccess* |
Disallow | /admin$ |
Disallow | /admin/* |
Disallow | /*/remote$ |
Disallow | /*/remote/* |
Disallow | /runtime$ |
Disallow | /runtime/* |
Disallow | /*/include$ |
Disallow | /*/include/* |
Disallow | /*/utils$ |
Disallow | /*/utils/* |
Disallow | /monitor$ |
Disallow | /monitor/* |
Disallow | /*/parsers$ |
Disallow | /*/parsers/* |
Disallow | /*/spiders$ |
Disallow | /*/spiders/* |
Disallow | /*.php |
Disallow | /*.tpl |
Disallow | /*.csv |
Disallow | /*.parser |
Disallow | /*.svn* |
Disallow | /*.svn* |
Disallow | /*?hide_sensitive |
Disallow | /*?show_sensitive |
Disallow | /*2pau |
Disallow | /*2ptt |
Disallow | /*2ptu |
Disallow | /*2prp |
Disallow | /*2pdlst |
Disallow | /*%2C* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://lensa.ro/sitemap.xml |
Comments