citizentrader.com
robots.txt
Robots Exclusion Standard data for citizentrader.com
Resource Scan
Scan Details
Site Domain | citizentrader.com |
Base Domain | citizentrader.com |
Scan Status | Ok |
Last Scan | 2024-09-19T11:11:59+00:00 |
Next Scan | 2024-09-26T11:11:59+00:00 |
Last Scan
Scanned | 2024-09-19T11:11:59+00:00 |
URL | https://citizentrader.com/robots.txt |
Domain IPs | 13.33.30.111, 13.33.30.63, 13.33.30.64, 13.33.30.81 |
Response IP | 13.33.30.64 |
Found | Yes |
Hash | 72b17c7ebe5c7d33f463f5d85383b480675745c6ddbe5adfaee2e049e08e83e7 |
SimHash | 4c40fe674711 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /our-privacy-policy |
Disallow | /disclaimer |
Disallow | /our-terms-and-conditions |
Other Records
Field | Value |
---|---|
sitemap | https://citizentrader.com/sitemap-index.xml |
Warnings
- `host` is not a known field.