isae-supaero.fr
robots.txt

Robots Exclusion Standard data for isae-supaero.fr

Resource Scan

Scan Details

Site Domain isae-supaero.fr
Base Domain isae-supaero.fr
Scan Status Ok
Last Scan2024-10-21T05:37:18+00:00
Next Scan 2024-11-20T05:37:18+00:00

Last Scan

Scanned2024-10-21T05:37:18+00:00
URL https://isae-supaero.fr/robots.txt
Redirect https://www.isae-supaero.fr/robots.txt
Redirect Domain www.isae-supaero.fr
Redirect Base isae-supaero.fr
Domain IPs 192.93.254.122
Redirect IPs 2001:c38:500a::3d13:c1e, 2001:c38:500a::3d13:c1f, 23.192.150.21, 23.192.150.30
Response IP 23.192.150.21
Found Yes
Hash 1c77d6b743218bd3da17c8bcdd036e53b4117ca978e8649ec1f574aa4661bf95
SimHash 6b0e9a3083b1

Groups

*

Rule Path
Allow /local/cache-css/
Allow /local/cache-js/
Disallow /ecrire/
Disallow /lib/
Disallow /prive/
Disallow /spip.php?action=*
Disallow /spip.php?page=login*
Disallow /*.api/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.isae-supaero.fr/sitemap.xml

Comments

  • robots.txt
  • @url: https://www.isae-supaero.fr
  • @template: plugins/supaero/robots.txt.html

Warnings

  • `noindex` is not a known field.