openenglish.com
robots.txt

Robots Exclusion Standard data for openenglish.com

Resource Scan

Scan Details

Site Domain openenglish.com
Base Domain openenglish.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T17:48:47+00:00
Next Scan 2024-08-15T17:48:47+00:00

Last Successful Scan

Scanned2023-12-27T15:56:30+00:00
URL https://openenglish.com/robots.txt
Redirect https://www.openenglish.com:443/robots.txt
Redirect Domain www.openenglish.com
Redirect Base openenglish.com
Domain IPs 18.155.68.125, 18.155.68.24, 18.155.68.66, 18.155.68.77
Redirect IPs 54.192.18.107, 54.192.18.115, 54.192.18.120, 54.192.18.87
Response IP 99.86.159.128
Found Yes
Hash 170fed3e4d6087378ad5c60d832313a80248a31446dadc4fc11e450b4868f4de
SimHash 51687648cdfd

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /healthcheck/
Disallow /error/
Disallow /fonts/
Disallow /modals/
Disallow /en/
Disallow /*-old/
Disallow /feed/
Disallow /*utm_source%3D*
Disallow /black-friday/
Disallow /black-week/
Disallow /*-v2/
Disallow /copa-america/
Disallow /*attachment
Disallow /*-experiment*/
Disallow /inicio/
Disallow /mitad-del-ano/

facebookexternalhit

Rule Path
Disallow /blog/es/wp-admin/
Allow /blog/es/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.openenglish.com/sitemap.xml
sitemap https://www.openenglish.com/es-ES/sitemap_index.xml

Comments

  • Directorios anteriores optimizados para eliminar reglas repetidas, el 16 de febrero del 2021
  • Directorios agregados el 16 de febrero del 2021
  • Urls de sitemap actualizadas el 23 de junio del 2021
  • Wordpress Hook
  • Blog