xataka.com.co
robots.txt

Robots Exclusion Standard data for xataka.com.co

Resource Scan

Scan Details

Site Domain xataka.com.co
Base Domain xataka.com.co
Scan Status Ok
Last Scan2024-11-14T03:59:54+00:00
Next Scan 2024-11-21T03:59:54+00:00

Last Scan

Scanned2024-11-14T03:59:54+00:00
URL https://xataka.com.co/robots.txt
Redirect https://www.xataka.com.co/robots.txt
Redirect Domain www.xataka.com.co
Redirect Base xataka.com.co
Domain IPs 13.35.210.106, 13.35.210.11, 13.35.210.43, 13.35.210.71
Redirect IPs 13.33.28.30, 13.33.28.66, 13.33.28.69, 13.33.28.70
Response IP 13.33.28.70
Found Yes
Hash 5a12ce24c9d60216863a7700277bc68e032b81dfe3a9bccb61aa44bcbb5b97df
SimHash ebb5044868ba

Groups

*

Rule Path
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wpi/
Disallow /trackback/
Disallow /*/*/*/feed.xml
Allow /retro/*
Disallow /retro
Disallow /login.php/
Disallow /frontend.php/
Disallow /api/1.0/migration
Disallow /server
Disallow /queue
Disallow /mobile.php/
Disallow /app.php/
Disallow /main.php/
Disallow /approve
Disallow /duplicate
Disallow /1018282
Disallow /api/
Disallow /c/
Disallow /morepostcomments
Disallow /offtopic
Disallow /p/
Disallow /pda
Disallow /tracker
Disallow /.well-known/amphtml/apikey.pub
Disallow /preview-main/*

Other Records

Field Value
sitemap https://www.xataka.com.co/sitemap_index.xml

Comments

  • Disallow: /redirect