cxm-dev-we-aps-001-fifacom.azurewebsites.net
robots.txt
Robots Exclusion Standard data for cxm-dev-we-aps-001-fifacom.azurewebsites.net
Resource Scan
Scan Details
| Site Domain | cxm-dev-we-aps-001-fifacom.azurewebsites.net |
| Base Domain | cxm-dev-we-aps-001-fifacom.azurewebsites.net |
| Scan Status | Ok |
| Last Scan | 2024-06-11T17:36:56+00:00 |
| Next Scan | 2024-06-18T17:36:56+00:00 |
Last Scan
| Scanned | 2024-06-11T17:36:56+00:00 |
| URL | https://cxm-dev-we-aps-001-fifacom.azurewebsites.net/robots.txt |
| Domain IPs | 20.50.2.18 |
| Response IP | 20.50.2.18 |
| Found | Yes |
| Hash | e7bd6fabd0260c880ac59462a6ff19927a83844f6a4e7c3bd335cae5acd38b9c |
| SimHash | 2d54cd456c30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?archive%3Ffilters= |
| Disallow | /api/ |
| Disallow | /recap-medical-conference-2024 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.inside.fifa.com/sitemap.xml |
| sitemap | https://www.inside.fifa.com/sitemaps/sitemapindex |
| sitemap | https://cxm-api.fifa.com/fifaplusweb/api/sitemap |
Warnings
- `host` is not a known field.
Comments