cxl.com
robots.txt
Robots Exclusion Standard data for cxl.com
Resource Scan
Scan Details
Site Domain | cxl.com |
Base Domain | cxl.com |
Scan Status | Ok |
Last Scan | 2025-08-11T15:13:31+00:00 |
Next Scan | 2025-09-10T15:13:31+00:00 |
Last Scan
Scanned | 2025-08-11T15:13:31+00:00 |
URL | https://cxl.com/robots.txt |
Domain IPs | 172.66.40.102, 172.66.43.154, 2606:4700:3108::ac42:2866, 2606:4700:3108::ac42:2b9a |
Response IP | 172.66.43.154 |
Found | Yes |
Hash | bf8b0425388af76f10f1586ee6989bc1f2822bc5048ec40ad63ec8507004926c |
SimHash | 6008c8c26453 |
Groups
*
Rule | Path |
---|---|
Disallow | /credential/ |
Disallow | /page/*/?p= |
*
Rule | Path |
---|---|
Disallow | /?s= |
Disallow | /page/*/?s= |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
sitemap | https://cxl.com/sitemap_index.xml |
Comments