egencia.co.uk
robots.txt
Robots Exclusion Standard data for egencia.co.uk
Resource Scan
Scan Details
| Site Domain | egencia.co.uk |
| Base Domain | egencia.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-26T14:15:50+00:00 |
| Next Scan | 2024-10-25T14:15:50+00:00 |
Last Successful Scan
| Scanned | 2024-06-21T14:14:26+00:00 |
| URL | https://egencia.co.uk/robots.txt |
| Redirect | https://www.egencia.co.uk/robots.txt |
| Redirect Domain | www.egencia.co.uk |
| Redirect Base | egencia.co.uk |
| Domain IPs | 13.225.4.108, 13.225.4.112, 13.225.4.34, 13.225.4.59 |
| Redirect IPs | 23.77.23.229 |
| Response IP | 23.77.23.229 |
| Found | Yes |
| Hash | b6be2e6f32fd2960faf4498d5f99741fa68f303a1b3679db051b9ba43db3cdfc |
| SimHash | 0c111045b5f7 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /pub/ | - |
| Disallow | /daily/resource/documents/ | - |
| Disallow | /daily/resource/council/ | - |
| Disallow | /daily/resource/solution/ | - |
| Disallow | /daily/resource/training/ | - |
| Disallow | /daily/resource/images/ | - |
| Disallow | /daily/egts/ | - |
| Disallow | /*/comments/feed/ | - |
| Disallow | /tme/ | - |
| Disallow | /users/ | - |
| Disallow | /auth/ | - |
| Disallow | /login/ | - |
| Disallow | /lp/ | - |
| Disallow | /zh/ | Chinese |
| Disallow | /cz/ | Czech |
| Disallow | /da/ | Danish |
| Disallow | /fr/ | French |
| Disallow | /fi/ | Finnish |
| Disallow | /de/ | German |
| Disallow | /it/ | Italian |
| Disallow | /nb/ | Norwegian |
| Disallow | /nl/ | Dutch |
| Disallow | /pl/ | Polish |
| Disallow | /es/ | Spanish |
| Disallow | /sv/ | Swedish |
| Disallow | /tr/ | Turkish |
| Disallow | /en/search | search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.egencia.co.uk/sitemap.xml |