openeducation.net
robots.txt
Robots Exclusion Standard data for openeducation.net
Resource Scan
Scan Details
Site Domain | openeducation.net |
Base Domain | openeducation.net |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-05-07T06:40:00+00:00 |
Next Scan | 2024-07-06T06:40:00+00:00 |
Last Successful Scan
Scanned | 2021-09-30T06:49:12+00:00 |
URL | http://openeducation.net/robots.txt |
Redirect | https://www.openenglish.com/robots.txt |
Redirect Domain | www.openenglish.com |
Redirect Base | openenglish.com |
Found | Yes |
Hash | 170fed3e4d6087378ad5c60d832313a80248a31446dadc4fc11e450b4868f4de |
SimHash | 51687648cdfd |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /healthcheck/ |
Disallow | /error/ |
Disallow | /fonts/ |
Disallow | /modals/ |
Disallow | /en/ |
Disallow | /*-old/ |
Disallow | /feed/ |
Disallow | /*utm_source%3D* |
Disallow | /black-friday/ |
Disallow | /black-week/ |
Disallow | /*-v2/ |
Disallow | /copa-america/ |
Disallow | /*attachment |
Disallow | /*-experiment*/ |
Disallow | /inicio/ |
Disallow | /mitad-del-ano/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.openenglish.com/sitemap.xml |
sitemap | https://www.openenglish.com/es-ES/sitemap_index.xml |
Comments