crehana.com
robots.txt
Robots Exclusion Standard data for crehana.com
Resource Scan
Scan Details
| Site Domain | crehana.com |
| Base Domain | crehana.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T08:18:05+00:00 |
| Next Scan | 2024-09-27T08:18:05+00:00 |
Last Scan
| Scanned | 2024-09-20T08:18:05+00:00 |
| URL | https://crehana.com/robots.txt |
| Redirect | https://www.crehana.com/robots.txt |
| Redirect Domain | www.crehana.com |
| Redirect Base | crehana.com |
| Domain IPs | 104.26.12.235, 104.26.13.235, 172.67.75.12, 2606:4700:20::681a:ceb, 2606:4700:20::681a:deb, 2606:4700:20::ac43:4b0c |
| Redirect IPs | 104.26.12.235, 104.26.13.235, 172.67.75.12, 2606:4700:20::681a:ceb, 2606:4700:20::681a:deb, 2606:4700:20::ac43:4b0c |
| Response IP | 172.67.75.12 |
| Found | Yes |
| Hash | 13be2d23d47948c2cc9a7b7fcc23cdd1a073b7419a80ec8dfca050bf368c9e91 |
| SimHash | 3529bd606654 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *action/download |
| Disallow | /enrollment/* |
| Disallow | /login/* |
| Disallow | /pt/blog/* |
| Allow | /pt/blog/brasil/ |
| Disallow | /cdn-cgi/ |
| Disallow | /api/v3/* |
| Disallow | /*/cursos-gratis-* |
| Disallow | /cursos-gratis-* |
| Disallow | /*/cursos-nuevos* |
| Disallow | /cursos-nuevos* |
| Disallow | /users/* |
| Disallow | /proyecto/* |
| Disallow | /r/* |
| Disallow | /enrollment/* |
| Disallow | /shopping-cart/* |
| Disallow | /login/twitter/* |
| Disallow | /login/* |
| Disallow | */cursos-ofertas |
| Disallow | /onboarding* |
| Allow | /*/blog/*/cursos-gratis-* |
| Allow | /blog/*/cursos-gratis-* |