travellink.is
robots.txt
Robots Exclusion Standard data for travellink.is
Resource Scan
Scan Details
| Site Domain | travellink.is |
| Base Domain | travellink.is |
| Scan Status | Ok |
| Last Scan | 2024-06-11T02:23:04+00:00 |
| Next Scan | 2024-06-18T02:23:04+00:00 |
Last Scan
| Scanned | 2024-06-11T02:23:04+00:00 |
| URL | https://travellink.is/robots.txt |
| Redirect | https://www.travellink.is/robots.txt |
| Redirect Domain | www.travellink.is |
| Redirect Base | travellink.is |
| Domain IPs | 35.246.196.126 |
| Redirect IPs | 104.18.34.209, 172.64.153.47 |
| Response IP | 104.18.34.209 |
| Found | Yes |
| Hash | 01c77a7bf68a2a5250e61947ded36ba86229fbdd5864e218fa9dcd2927c16a1a |
| SimHash | 8dd08edbddf0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /flash/ |
| Disallow | /html/ |
| Disallow | /flyg-prefill |
| Disallow | /flyg-hotell-prefill |
| Disallow | /hotell-prefill |
| Disallow | /fly-prefill |
| Disallow | /pakkerejse-prefill |
| Disallow | /hotel-prefill |
| Disallow | /fly-hotell-prefill |
| Disallow | /lennot-prefill |
| Disallow | /lento-hotelli-prefill |
| Disallow | /hotellit-prefill |
| Disallow | /paketerbjudande |
| Disallow | /hotellerbjudande |
| Disallow | /pakketilbud |
| Disallow | /hoteltilbud |
| Disallow | /hotelltilbud |
| Disallow | /pakettitarjous |
| Disallow | /hotellitarjous |
| Disallow | /offers-flight/ |
| Disallow | /offers-airlines/ |
Comments