toulouse.aujourdhui.fr
robots.txt

Robots Exclusion Standard data for toulouse.aujourdhui.fr

Resource Scan

Scan Details

Site Domain toulouse.aujourdhui.fr
Base Domain aujourdhui.fr
Scan Status Ok
Last Scan2024-09-16T12:23:20+00:00
Next Scan 2024-10-16T12:23:20+00:00

Last Scan

Scanned2024-09-16T12:23:20+00:00
URL https://toulouse.aujourdhui.fr/robots.txt
Domain IPs 13.225.4.10, 13.225.4.39, 13.225.4.52, 13.225.4.74
Response IP 13.225.4.74
Found Yes
Hash 66b8a2c66765aa65b8760e2c92a83e22930986e8f232bd6ea1edee8e57c31af0
SimHash 2d034a55cd93

Groups

*
*

Rule Path
Disallow /etudiant/ajout/evenement/
Disallow /etudiant/ajout/evenements/
Disallow /etudiant/ajout/formation/
Disallow /admin/hi-media/appel-numero.js

mediapartners-google

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://etudiant.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://www.parisetudiant.com/etudiant/sitemaps/sitemap_index.php
sitemap http://lyon.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://marseille.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://lille.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://bordeaux.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://toulouse.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://strasbourg.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://rennes.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://orleans.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://nantes.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php
sitemap http://montpellier.aujourdhui.fr/etudiant/sitemaps/sitemap_index.php