openeducation.net
robots.txt

Robots Exclusion Standard data for openeducation.net

Resource Scan

Scan Details

Site Domain openeducation.net
Base Domain openeducation.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-05-07T06:40:00+00:00
Next Scan 2024-07-06T06:40:00+00:00

Last Successful Scan

Scanned2021-09-30T06:49:12+00:00
URL http://openeducation.net/robots.txt
Redirect https://www.openenglish.com/robots.txt
Redirect Domain www.openenglish.com
Redirect Base openenglish.com
Found Yes
Hash 170fed3e4d6087378ad5c60d832313a80248a31446dadc4fc11e450b4868f4de
SimHash 51687648cdfd

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /healthcheck/
Disallow /error/
Disallow /fonts/
Disallow /modals/
Disallow /en/
Disallow /*-old/
Disallow /feed/
Disallow /*utm_source%3D*
Disallow /black-friday/
Disallow /black-week/
Disallow /*-v2/
Disallow /copa-america/
Disallow /*attachment
Disallow /*-experiment*/
Disallow /inicio/
Disallow /mitad-del-ano/

facebookexternalhit

Rule Path
Disallow /blog/es/wp-admin/
Allow /blog/es/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.openenglish.com/sitemap.xml
sitemap https://www.openenglish.com/es-ES/sitemap_index.xml

Comments

  • Directorios anteriores optimizados para eliminar reglas repetidas, el 16 de febrero del 2021
  • Directorios agregados el 16 de febrero del 2021
  • Urls de sitemap actualizadas el 23 de junio del 2021
  • Wordpress Hook
  • Blog