education.com
robots.txt
Robots Exclusion Standard data for education.com
Resource Scan
Scan Details
| Site Domain | education.com |
| Base Domain | education.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T09:40:14+00:00 |
| Next Scan | 2024-11-20T09:40:14+00:00 |
Last Scan
| Scanned | 2024-11-13T09:40:14+00:00 |
| URL | https://education.com/robots.txt |
| Redirect | https://www.education.com:443/robots.txt |
| Redirect Domain | www.education.com |
| Redirect Base | education.com |
| Domain IPs | 2600:1f18:21ba:6b00:ddb5:34de:359:9d25, 2600:1f18:21ba:6b01:b209:d91e:796a:b0e5, 2600:1f18:21ba:6b02:2b9c:e45b:b523:8824, 3.94.124.250, 44.218.123.150, 54.85.19.76 |
| Redirect IPs | 104.18.42.23, 172.64.145.233, 2606:4700:4400::6812:2a17, 2606:4700:4400::ac40:91e9 |
| Response IP | 172.64.145.233 |
| Found | Yes |
| Hash | d89fce262db2ae867ac9adce5f78464e189eaf31f5763a9806b7b5e424fc3270 |
| SimHash | 2b9ef151cb11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /results/ |
| Disallow | /print/ |
| Disallow | /toast/ |
| Disallow | /downloading.php |
| Disallow | /*.pdf$ |
| Disallow | /download/ |
| Disallow | /pdf/ |
| Disallow | /profile/ |
| Disallow | /openx/ |
| Disallow | /openads/ |
| Disallow | /schoolfinder/searchresult/ |
| Disallow | /widget/ |
| Disallow | /lesson-related-content/ |
| Disallow | /summer-sale/ |
| Disallow | /*?q= |
| Disallow | /*%26q%3D |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.education.com/sitemapindex.xml |