tes.com
robots.txt
Robots Exclusion Standard data for tes.com
Resource Scan
Scan Details
| Site Domain | tes.com |
| Base Domain | tes.com |
| Scan Status | Ok |
| Last Scan | 2024-05-04T09:45:19+00:00 |
| Next Scan | 2024-05-11T09:45:19+00:00 |
Last Scan
| Scanned | 2024-05-04T09:45:19+00:00 |
| URL | https://tes.com/robots.txt |
| Redirect | https://www.tes.com/robots.txt |
| Redirect Domain | www.tes.com |
| Redirect Base | tes.com |
| Domain IPs | 151.101.0.228, 151.101.128.228, 151.101.192.228, 151.101.64.228, 2a04:4e42:200::228, 2a04:4e42:400::228, 2a04:4e42:600::228, 2a04:4e42::228 |
| Redirect IPs | 151.101.0.228, 151.101.128.228, 151.101.192.228, 151.101.64.228, 2a04:4e42:200::228, 2a04:4e42:400::228, 2a04:4e42:600::228, 2a04:4e42::228 |
| Response IP | 199.232.44.228 |
| Found | Yes |
| Hash | 60a6b6ebf7075550d56c0cad57c227390c74c4e943ff8576ce1c30e1008d8587 |
| SimHash | 380038ccad11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /auth/ |
| Disallow | /authn/ |
| Disallow | /registration/ |
| Disallow | /teaching-resource/download/ |
| Disallow | /uploader/ |
| Disallow | /jobs/Upload/Attachments/ |
| Disallow | /Upload/Attachments/TES/ |
| Disallow | /TESHirewire/Attachments/ |
| Disallow | /2884/ |
| Disallow | /api/career-profile |
| Disallow | /api/job-application |
| Disallow | /api/schools |
| Disallow | /lessons/ |
| Disallow | /blog/ |
| Disallow | /us/ |
| Disallow | /au/ |
| Disallow | /elements-welcome/ |
| Disallow | /content/ |
| Disallow | /author/ |
| Disallow | /articles/ |
| Disallow | /member/ |
| Disallow | /node/ |
| Disallow | /news_blog/ |
| Disallow | /school/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tes.com/sitemap.xml |
| sitemap | https://www.tes.com/sitemaps/sitemap.xml |
| sitemap | https://www.tes.com/aws-sitemap-index-teaching-resources.xml |
| sitemap | https://www.tes.com/aws-sitemap-index-teaching-resources-shops.xml |
| sitemap | https://www.tes.com/aws-sitemap-index-jobs.xml |
| sitemap | https://www.tes.com/aws-sitemap-index-jobs-hubs.xml |
| sitemap | https://www.tes.com/custom-sitemap/orphan-sitemap-index.xml |
| sitemap | https://www.tes.com/googlenews.xml |
| sitemap | https://www.tes.com/institute/sitemap.xml |