universe.roboflow.com
robots.txt
Robots Exclusion Standard data for universe.roboflow.com
Resource Scan
Scan Details
| Site Domain | universe.roboflow.com |
| Base Domain | roboflow.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T06:31:36+00:00 |
| Next Scan | 2024-11-22T06:31:36+00:00 |
Last Scan
| Scanned | 2024-11-08T06:31:36+00:00 |
| URL | https://universe.roboflow.com/robots.txt |
| Domain IPs | 151.101.1.195, 151.101.65.195, 2620:0:890::100 |
| Response IP | 151.101.1.195 |
| Found | Yes |
| Hash | 62846a1cf7ba9adfe093abcf7940dfbae89b19d95a9ed5af1e1ecf9550734d06 |
| SimHash | 4144ce53c911 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/*/images/ |
| Disallow | /*/*/dataset/*/images/ |
| Disallow | /*/*/dataset/*/download/* |
| Disallow | /*/*/model/*/documentation |
| Disallow | /*/*/health |
| Disallow | /*/*/delete |
| Disallow | /*/*/export |
| Disallow | /*/*/edit |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://universe.roboflow.com/sitemap.xml |