bourse-des-vols.com
robots.txt

Robots Exclusion Standard data for bourse-des-vols.com

Resource Scan

Scan Details

Site Domain bourse-des-vols.com
Base Domain bourse-des-vols.com
Scan Status Ok
Last Scan2024-09-22T06:22:51+00:00
Next Scan 2024-09-29T06:22:51+00:00

Last Scan

Scanned2024-09-22T06:22:51+00:00
URL https://bourse-des-vols.com/robots.txt
Redirect https://www.bourse-des-vols.com/robots.txt
Redirect Domain www.bourse-des-vols.com
Redirect Base bourse-des-vols.com
Domain IPs 178.33.108.48
Redirect IPs 178.33.108.48
Response IP 178.33.108.48
Found Yes
Hash 1dbbac3a432066be774274d7ae77466136d8867e264677ce0dee26815183d2c5
SimHash 887959948b93

Groups

*

Rule Path
Disallow /billet-avion_old/
Disallow /reservation/
Allow /commun/images/
Disallow /commun/
Disallow /depart-paris_old/
Disallow /inc/
Disallow /pas-cher_old/
Disallow /pas-chers_old/
Disallow /promotion/
Disallow /promotion_old/
Disallow /racine_old/
Disallow /engine.php
Disallow /multidestination.php
Disallow /airline-tickets.php
Disallow /pas-cher/reserver/
Disallow /pas-chers/reserver/
Disallow */ouvrage-*
Disallow */article-*
Disallow */appareil-*
Disallow */reservation-hotels.php*
Disallow /admin/
Disallow /view/
Disallow /cookie.php
Disallow /guide-voyage/agenda-search.php*
Disallow /model/
Disallow /partial/
Disallow /js/datepicker/initDate.php
Disallow /cookie-warning.php

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /
Disallow /indexTest.php

Other Records

Field Value
sitemap https://www.bourse-des-vols.com/sitemaps/sitemap-index.xml