crucerosonline.cl
robots.txt
Robots Exclusion Standard data for crucerosonline.cl
Resource Scan
Scan Details
Site Domain | crucerosonline.cl |
Base Domain | crucerosonline.cl |
Scan Status | Ok |
Last Scan | 2024-08-31T02:21:55+00:00 |
Next Scan | 2024-09-30T02:21:55+00:00 |
Last Scan
Scanned | 2024-08-31T02:21:55+00:00 |
URL | https://crucerosonline.cl/robots.txt |
Redirect | https://www.crucerosonline.cl/robots.txt |
Redirect Domain | www.crucerosonline.cl |
Redirect Base | crucerosonline.cl |
Domain IPs | 13.35.18.114, 13.35.18.120, 13.35.18.61, 13.35.18.73 |
Redirect IPs | 18.155.68.107, 18.155.68.129, 18.155.68.3, 18.155.68.83 |
Response IP | 18.155.68.107 |
Found | Yes |
Hash | d767de54d3092e67f40ce2caf1e312ea98b4bfcc2299a6fb58a7aa6a062f7420 |
SimHash | 7b017a7749a6 |
Groups
*
Rule | Path |
---|---|
Disallow | *package2.html |
Disallow | /ajax/ |
Disallow | /cron/ |
Disallow | /listeV4.php |
Disallow | /liste.php |
Disallow | /liste-produits/ |
Disallow | */tag/* |
Disallow | /fp-* |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | *package2.html |
Disallow | /comp_101/ |
Disallow | /ajax/ |
Disallow | /cron/ |
Disallow | /listeV4.php |
Disallow | /liste.php |
Disallow | /liste-produits/ |
Disallow | */tag/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.crucerosonline.cl/sitemaps/cl/sitemap-index.xml |
Warnings
- 8 invalid lines.
Comments