engine.roa.ai
robots.txt
Robots Exclusion Standard data for engine.roa.ai
Resource Scan
Scan Details
Site Domain | engine.roa.ai |
Base Domain | roa.ai |
Scan Status | Ok |
Last Scan | 2024-10-21T18:33:08+00:00 |
Next Scan | 2024-11-20T18:33:08+00:00 |
Last Scan
Scanned | 2024-10-21T18:33:08+00:00 |
URL | https://engine.roa.ai/robots.txt |
Domain IPs | 13.33.30.104, 13.33.30.36, 13.33.30.66, 13.33.30.91 |
Response IP | 13.33.30.36 |
Found | Yes |
Hash | 767cb29127b26f6864274bcf22a4d0f16dfbd4143a06a4bfe6ed51c6af23fe5d |
SimHash | 23441660ad80 |
Groups
*
Rule | Path |
---|---|
Disallow | /accounts/* |
Disallow | /menu |
Disallow | /404 |
Disallow | /500 |
Disallow | /testing |
Other Records
Field | Value |
---|---|
sitemap | https://engine.roa.ai/sitemap.xml |
Warnings
- `host` is not a known field.
Comments