group.nebius.com
robots.txt
Robots Exclusion Standard data for group.nebius.com
Resource Scan
Scan Details
Site Domain | group.nebius.com |
Base Domain | nebius.com |
Scan Status | Ok |
Last Scan | 2025-09-22T01:14:06+00:00 |
Next Scan | 2025-10-06T01:14:06+00:00 |
Last Scan
Scanned | 2025-09-22T01:14:06+00:00 |
URL | https://group.nebius.com/robots.txt |
Redirect | https://nebius.com/robots.txt |
Redirect Domain | nebius.com |
Redirect Base | nebius.com |
Domain IPs | 13.107.253.59, 2620:1ec:29:1::59, 2620:1ec:48:1::59 |
Redirect IPs | 13.107.226.59, 13.107.253.59, 2620:1ec:46::59, 2620:1ec:bdf::59 |
Response IP | 13.107.253.59 |
Found | Yes |
Hash | fdec9cf8f8d16bac1f2f94f718faba2d8d6d65b5299f09368a5b39d25fc12857 |
SimHash | ae40be53e472 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*? |
Disallow | /*%3D |
Disallow | /*index$ |
Disallow | /*_includes |
Disallow | /*_tutorials |
Disallow | /*_qa |
Disallow | /feed.* |
Disallow | /_* |
Other Records
Field | Value |
---|---|
sitemap | https://nebius.com/sitemap.xml |
Warnings
- `host` is not a known field.