cargest.com
robots.txt

Robots Exclusion Standard data for cargest.com

Resource Scan

Scan Details

Site Domain cargest.com
Base Domain cargest.com
Scan Status Ok
Last Scan2025-12-23T05:22:25+00:00
Next Scan 2026-01-22T05:22:25+00:00

Last Scan

Scanned2025-12-23T05:22:25+00:00
URL https://cargest.com/robots.txt
Redirect https://www.cargest.com/robots.txt
Redirect Domain www.cargest.com
Redirect Base cargest.com
Domain IPs 2001:8d8:100f:f000::274, 217.160.0.231
Redirect IPs 2001:8d8:100f:f000::274, 217.160.0.231
Response IP 217.160.0.231
Found Yes
Hash ffc134ffe69c188c3f07f36fdbca07b8237ee3a6bd28a019b9e833a94fbc248d
SimHash c950c8530713

Groups

*

Rule Path
Allow /
Disallow /*?
Disallow /nueva
Disallow /wp-content/cache/

Other Records

Field Value
sitemap https://www.cargest.com/sitemap_index.xml