Log In Sign Up

airtours.se
robots.txt

Robots Exclusion Standard data for airtours.se

Resource Scan

Scan Details

Site Domain airtours.se
Base Domain airtours.se
Scan Status Ok
Last Scan2024-05-12T14:48:12+00:00
Next Scan 2024-06-11T14:48:12+00:00

Last Scan

Scanned2024-05-12T14:48:12+00:00
URL https://airtours.se/robots.txt
Redirect https://www.airtours.se/robots.txt
Redirect Domain www.airtours.se
Redirect Base airtours.se
Domain IPs 147.75.40.150
Redirect IPs 13.215.246.123, 13.215.31.72, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e201::1f4
Response IP 13.215.246.123
Found Yes
Hash a67d43835120e446f24730915d4e8d1f52eb8a33fdedd4445422c7782930545a
SimHash 85505fdcc4f4

Groups

*

Rule Path
Disallow /*/sokresultat?
Disallow *%26Duration*
Disallow *%26Participants*
Disallow *%26ParticipantsDistribution*
Disallow *%26TransportType*
Disallow /sitecore
Disallow /*/bokning/*
Disallow /*/bookingpage/*
Disallow /login?*
Disallow /minresa/
Disallow /dokument/
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_resultat.p
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_resultat
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_resultat*
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_flyg.p
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_flyg
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_kategori.p
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_kategori
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_inmatning.p
Disallow /cgi-bin/wspd_cgi.sh/b_pkt_inmatning
Disallow /cgi-bin/wspd_cgi.sh/b_hot_inmatning.p
Disallow /cgi-bin/wspd_cgi.sh/b_hot_inmatning
Disallow /cgi-bin/wspd_cgi.sh/b_hot_resultat
Disallow /cgi-bin/wspd_cgi.sh/b_hot_resultat.p
Disallow /cgi-bin/wspd_cgi.sh/look*
Disallow /cgi-bin/wspd_cgi.sh/kund*
Disallow /cgi-bin/wspd_cgi.sh/online*
Disallow /cgi-bin/wspd_cgi.sh/agent*
Disallow /cgi-bin/wspd_cgi.sh/b_agent*
Disallow /cgi-bin/wspd_cgi.sh/web_knr*
Disallow /cgi-bin/wspd_cgi.sh/*
Disallow /*?avrort=*

mediapartners-google

Rule Path
Allow /*/sokresultat?

adsbot-google

Rule Path
Allow /*/sokresultat?

grub-client
libwww
zyborg
xenu
larbin
sitecheck.internetseer.com
zealbot
download ninja
msiecrawler
sitesnagger
webstripper
webcopier
offline explorer
fetch
teleport
teleportpro
webzip
linko
httrack
seokicks
seokicks-robot

Rule Path
Disallow /foo/
Back to top

Other Records

Field Value
sitemap https://www.airtours.se/sitemap-index.xml
Back to top

Comments

  • Disallows for all bots
  • bots to exclude
Back to top