lille.aujourdhui.fr
robots.txt

Robots Exclusion Standard data for lille.aujourdhui.fr

Resource Scan

Scan Details

Site Domain lille.aujourdhui.fr
Base Domain aujourdhui.fr
Scan Status Ok
Last Scan2024-06-02T01:46:03+00:00
Next Scan 2024-07-02T01:46:03+00:00

Last Scan

Scanned2024-06-02T01:46:03+00:00
URL http://lille.aujourdhui.fr/robots.txt
Domain IPs 151.80.25.159, 2001:41d0:c:109f::
Response IP 51.15.185.98
Found Yes
Hash 66b8a2c66765aa65b8760e2c92a83e22930986e8f232bd6ea1edee8e57c31af0
SimHash 2d034a55cd93

Groups

*
*

Rule Path
Disallow /etudiant/ajout/evenement/
Disallow /etudiant/ajout/evenements/
Disallow /etudiant/ajout/formation/
Disallow /admin/hi-media/appel-numero.js

mediapartners-google

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://etudiant.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://www.parisetudiant.com/etudiant/sitemaps/sitemap_index.php
sitemap http://lyon.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://marseille.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://lille.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://bordeaux.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://toulouse.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://strasbourg.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://rennes.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://orleans.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://nantes.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://montpellier.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php