roa.ai
robots.txt
Robots Exclusion Standard data for roa.ai
Resource Scan
Scan Details
| Site Domain | roa.ai |
| Base Domain | roa.ai |
| Scan Status | Ok |
| Last Scan | 2024-05-22T09:33:45+00:00 |
| Next Scan | 2024-06-21T09:33:45+00:00 |
Last Scan
| Scanned | 2024-05-22T09:33:45+00:00 |
| URL | https://roa.ai/robots.txt |
| Redirect | https://engine.roa.ai/robots.txt |
| Redirect Domain | engine.roa.ai |
| Redirect Base | roa.ai |
| Domain IPs | 108.157.254.3, 108.157.254.42, 108.157.254.49, 108.157.254.9 |
| Redirect IPs | 13.33.30.104, 13.33.30.36, 13.33.30.66, 13.33.30.91 |
| Response IP | 13.33.30.36 |
| Found | Yes |
| Hash | 767cb29127b26f6864274bcf22a4d0f16dfbd4143a06a4bfe6ed51c6af23fe5d |
| SimHash | 23441660ad80 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /accounts/* |
| Disallow | /menu |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /testing |
Other Records
| Field | Value |
|---|---|
| sitemap | https://engine.roa.ai/sitemap.xml |
Warnings
- `host` is not a known field.
Comments