alison.com
robots.txt
Robots Exclusion Standard data for alison.com
Resource Scan
Scan Details
Site Domain | alison.com |
Base Domain | alison.com |
Scan Status | Ok |
Last Scan | 2024-11-07T19:04:11+00:00 |
Next Scan | 2024-11-14T19:04:11+00:00 |
Last Scan
Scanned | 2024-11-07T19:04:11+00:00 |
URL | https://alison.com/robots.txt |
Domain IPs | 104.18.16.28, 104.18.17.28, 2606:4700::6812:101c, 2606:4700::6812:111c |
Response IP | 104.18.17.28 |
Found | Yes |
Hash | 46178d90a0136ae2954671aef70322fcbc80afd79e5e205cf9d8b3c7243f6556 |
SimHash | a8a484784e3c |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /courses/*query%3D* |
Disallow | /courses?query=* |
Disallow | /es/cursos/*query%3D* |
Disallow | /es/cursos?query=* |
Disallow | /pt-BR/cursos/*query%3D* |
Disallow | /pt-BR/cursos?query=* |
Disallow | /fr/les-cours/*query%3D* |
Disallow | /fr/les-cours?query=* |
Disallow | /it/corsi/*query%3D* |
Disallow | /it/corsi?query=* |
Disallow | /topic/* |
Disallow | /es/tema/* |
Disallow | /fr/sujet/* |
Disallow | /it/argomento/* |
Disallow | /pt-BR/t%C3%83%C2%B3pico/* |
Disallow | */country-id-to-code/* |
Disallow | /blog/feed* |
Disallow | /register/ |
Disallow | */api/* |
Disallow | */images/publishers/* |
Disallow | */busca/* |
Disallow | */mati%C3%83%C2%A8re/* |
Disallow | */occupations/* |
Disallow | /*-old$ |
Disallow | /certification/* |
Disallow | /certificaci%C3%83%C2%B3n/* |
Disallow | /certificazione/* |
Disallow | /user/* |
Disallow | */resources |
Disallow | /shop/* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://alison.com/sitemap.xml |
Comments