opentrain.ai
robots.txt
Robots Exclusion Standard data for opentrain.ai
Resource Scan
Scan Details
| Site Domain | opentrain.ai |
| Base Domain | opentrain.ai |
| Scan Status | Ok |
| Last Scan | 2025-08-19T16:28:08+00:00 |
| Next Scan | 2025-09-18T16:28:08+00:00 |
Last Scan
| Scanned | 2025-08-19T16:28:08+00:00 |
| URL | https://opentrain.ai/robots.txt |
| Redirect | https://www.opentrain.ai/robots.txt |
| Redirect Domain | www.opentrain.ai |
| Redirect Base | opentrain.ai |
| Domain IPs | 104.16.36.105, 104.16.42.105, 104.19.240.93, 104.19.241.93 |
| Redirect IPs | 104.16.36.105, 104.16.42.105, 104.19.240.93, 104.19.241.93 |
| Response IP | 104.16.42.105 |
| Found | Yes |
| Hash | 83e8e02fe2954620ebb3d7a040a902fa26184e9b77b39c766e5dd78d2c865583 |
| SimHash | 74a0d9a48c93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /version-test/ |
| Disallow | /admin |
| Disallow | /agency_onboarding |
| Disallow | /employer-dashboard |
| Disallow | /employer-settings |
| Disallow | /find-freelancer |
| Disallow | /find-job |
| Disallow | /job-details |
| Disallow | /job-post |
| Disallow | /labeler-dashboard |
| Disallow | /labeler-settings |
| Disallow | /labeler-onboarding |
| Disallow | /login-confirm |
| Disallow | /storagewmd |
| Disallow | /subscribe-agency |
| Disallow | /test |
| Disallow | /reset-pw |
| Disallow | /api |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.opentrain.ai/sitemap.xml |