lunajets.com
robots.txt
Robots Exclusion Standard data for lunajets.com
Resource Scan
Scan Details
Site Domain | lunajets.com |
Base Domain | lunajets.com |
Scan Status | Ok |
Last Scan | 2024-11-12T22:10:31+00:00 |
Next Scan | 2024-11-26T22:10:31+00:00 |
Last Scan
Scanned | 2024-11-12T22:10:31+00:00 |
URL | https://lunajets.com/robots.txt |
Redirect | https://www.lunajets.com/en/robots.txt |
Redirect Domain | www.lunajets.com |
Redirect Base | lunajets.com |
Domain IPs | 76.76.21.21 |
Redirect IPs | 76.76.21.123, 76.76.21.22 |
Response IP | 76.76.21.164 |
Found | Yes |
Hash | 06c90b830a6cc6b9523eb548dda33e407151228df5db16a28c64bf3a90ac5a1e |
SimHash | cd10f401a3a0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /preview |
Disallow | /sales/* |
Disallow | /user/* |
Disallow | /en/user/* |
Disallow | /de/user/* |
Disallow | /es/user/* |
Disallow | /pl/user/* |
Disallow | /fr/user/* |
Disallow | /it/user/* |
Disallow | /ru/user/* |
Disallow | /hu/user/* |
Disallow | /ru/user/* |
Disallow | /login |
Disallow | /register |
Disallow | /forgot-password |
Disallow | /reset-password |
Disallow | /activate-account |
Disallow | /activate-subscription |
Disallow | /customer-area |
Disallow | /customer-area/* |
Disallow | /de/leerflug/* |
Disallow | /en/empty-leg-flights/* |
Disallow | /es/trayectos-vacios/* |
Disallow | /pl/empty-leg/* |
Disallow | /fr/vols-a-vide/* |
Disallow | /hu/empty-leg-jaratok/* |
Disallow | /it/voli-a-vuoto/* |
Disallow | /ru/empty-leg-flights/* |
Disallow | /en/price-estimator |
Other Records
Field | Value |
---|---|
sitemap | https://www.lunajets.com/sitemap.xml |
sitemap | https://www.lunajets.com/server-sitemap/index.xml |
Warnings
- `host` is not a known field.
Comments