nansen.ai
robots.txt
Robots Exclusion Standard data for nansen.ai
Resource Scan
Scan Details
Site Domain | nansen.ai |
Base Domain | nansen.ai |
Scan Status | Ok |
Last Scan | 2024-05-01T03:11:22+00:00 |
Next Scan | 2024-05-31T03:11:22+00:00 |
Last Scan
Scanned | 2024-05-01T03:11:22+00:00 |
URL | https://nansen.ai/robots.txt |
Redirect | https://www.nansen.ai/robots.txt |
Redirect Domain | www.nansen.ai |
Redirect Base | nansen.ai |
Domain IPs | 75.2.70.75, 99.83.190.102 |
Redirect IPs | 13.200.123.229, 13.234.100.116, 65.0.79.182 |
Response IP | 54.68.171.176 |
Found | Yes |
Hash | b5cb2e348c964557a24f01244888ac8507221532ded629e1148cd72b1834e707 |
SimHash | 510dd4058fd2 |
Groups
*
Rule | Path |
---|---|
Disallow | /alphapurchase |
Disallow | /zh/research |
Disallow | /zh/blog |
Disallow | /zh/nansen-101 |
Disallow | /zh/reports |
Disallow | /zh/guides |
Disallow | /security-update |
Other Records
Field | Value |
---|---|
sitemap | https://www.nansen.ai/sitemap.xml |