esports.xataka.com
robots.txt
Robots Exclusion Standard data for esports.xataka.com
Resource Scan
Scan Details
| Site Domain | esports.xataka.com |
| Base Domain | xataka.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-31T12:31:24+00:00 |
| Next Scan | 2024-11-14T12:31:24+00:00 |
Last Successful Scan
| Scanned | 2024-09-23T12:30:39+00:00 |
| URL | https://esports.xataka.com/robots.txt |
| Domain IPs | 108.156.133.28, 108.156.133.47, 108.156.133.6, 108.156.133.73 |
| Response IP | 108.156.133.28 |
| Found | Yes |
| Hash | bef7446e1a876e094a5eeccc8739b794978c0a988c58363d76b6e81477c644e3 |
| SimHash | e1350448c89a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-content/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wpi/ |
| Disallow | /trackback/ |
| Disallow | /*/*/*/feed.xml |
| Allow | /retro/* |
| Disallow | /retro |
| Disallow | /login.php/ |
| Disallow | /frontend.php/ |
| Disallow | /api/1.0/migration |
| Disallow | /server |
| Disallow | /queue |
| Disallow | /mobile.php/ |
| Disallow | /app.php/ |
| Disallow | /main.php/ |
| Disallow | /redirect |
| Disallow | /approve |
| Disallow | /duplicate |
| Disallow | /1018282 |
| Disallow | /api/ |
| Disallow | /c/ |
| Disallow | /morepostcomments |
| Disallow | /offtopic |
| Disallow | /p/ |
| Disallow | /pda |
| Disallow | /tracker |
| Disallow | /.well-known/amphtml/apikey.pub |
| Disallow | /usuario/* |
| Disallow | /*/*/record/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://esports.xataka.com/sitemap_news.xml |
| sitemap | https://esports.xataka.com/sitemap_index.xml |
Warnings
- `noindex` is not a known field.