alison.com
robots.txt

Robots Exclusion Standard data for alison.com

Resource Scan

Scan Details

Site Domain alison.com
Base Domain alison.com
Scan Status Ok
Last Scan2024-11-07T19:04:11+00:00
Next Scan 2024-11-14T19:04:11+00:00

Last Scan

Scanned2024-11-07T19:04:11+00:00
URL https://alison.com/robots.txt
Domain IPs 104.18.16.28, 104.18.17.28, 2606:4700::6812:101c, 2606:4700::6812:111c
Response IP 104.18.17.28
Found Yes
Hash 46178d90a0136ae2954671aef70322fcbc80afd79e5e205cf9d8b3c7243f6556
SimHash a8a484784e3c

Groups

*

Rule Path
Disallow
Disallow /courses/*query%3D*
Disallow /courses?query=*
Disallow /es/cursos/*query%3D*
Disallow /es/cursos?query=*
Disallow /pt-BR/cursos/*query%3D*
Disallow /pt-BR/cursos?query=*
Disallow /fr/les-cours/*query%3D*
Disallow /fr/les-cours?query=*
Disallow /it/corsi/*query%3D*
Disallow /it/corsi?query=*
Disallow /topic/*
Disallow /es/tema/*
Disallow /fr/sujet/*
Disallow /it/argomento/*
Disallow /pt-BR/t%C3%83%C2%B3pico/*
Disallow */country-id-to-code/*
Disallow /blog/feed*
Disallow /register/
Disallow */api/*
Disallow */images/publishers/*
Disallow */busca/*
Disallow */mati%C3%83%C2%A8re/*
Disallow */occupations/*
Disallow /*-old$
Disallow /certification/*
Disallow /certificaci%C3%83%C2%B3n/*
Disallow /certificazione/*
Disallow /user/*
Disallow */resources
Disallow /shop/*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://alison.com/sitemap.xml

Comments

  • Adding this to remove all old courses, which are causing issues with our structured data