marseille.aeroport.fr
robots.txt

Robots Exclusion Standard data for marseille.aeroport.fr

Resource Scan

Scan Details

Site Domain marseille.aeroport.fr
Base Domain marseille.aeroport.fr
Scan Status Ok
Last Scan2024-10-28T19:52:47+00:00
Next Scan 2024-11-27T19:52:47+00:00

Last Scan

Scanned2024-10-28T19:52:47+00:00
URL https://marseille.aeroport.fr/robots.txt
Redirect https://www.marseille.aeroport.fr/robots.txt
Redirect Domain www.marseille.aeroport.fr
Redirect Base marseille.aeroport.fr
Domain IPs 137.74.66.33
Redirect IPs 137.74.66.33
Response IP 137.74.66.33
Found Yes
Hash 7ce57bc05a01f5d2130e040de19f60d30989a986bf7acadb947c30836d900f22
SimHash 6b8958d30f91

Groups

*

Rule Path
Allow /
Disallow /fileadmin/templates
Disallow /typo3/
Disallow /t3lib/
Disallow /typo3conf/
Disallow /*/Private/*
Disallow /fileadmin/templates/html/*
Disallow /*/Configuration/*
Disallow /layout/set/quick_guide
Disallow /layout/set/exchange
Disallow /layout/set/e_kiosk
Disallow /media/
Disallow /content/view/full/
Disallow /index.php/
Disallow /rss2/
Disallow /tour-operators
Disallow /aeroports
Disallow /publicites
Disallow /vols-et-destinations/voyage-en-avion/compagnies-aeriennes/*
Disallow /flights/flight-info/airlines-list/*
Disallow /yoast-snippetpreview
Disallow /json
Disallow /data
Disallow /contentjson
Disallow /actualite-rss
Disallow /alerte-rss
Disallow /suggestapi
Disallow /suggest
Disallow /api-vols/scheduleMatching/departure/airport/data
Disallow /en/api/agenda-1481/json?cHash=e0393bad54974cf474bbd7a856894c61
Disallow /api-vols/scheduleMatching/departure/airport/data
Disallow /api/*
Disallow /api-vols/schedule/departure/data
Disallow /api-vols/schedule/arrival/data
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /typo3temp/
Allow /typo3temp/*.css$
Allow /typo3temp/*.css.*.gzip$
Allow /typo3temp/*.js$
Allow /typo3temp/*.js.*.gzip$
Allow /typo3temp/*.jpg$
Allow /typo3temp/*.gif$
Allow /typo3temp/*.png$
Disallow *.sql
Disallow *.sql.gz

googlebot

Rule Path
Disallow /*?tx_indexedsearch

Other Records

Field Value
sitemap https://www.marseille.aeroport.fr/sitemap.xml
sitemap https://www.marseille-airport.com/sitemap.xml

Comments

  • Allow everything by default
  • Add restrictions
  • Only allow URLs generated with RealURL
  • Google specific settings
  • Add sitemap