weareroku.com
robots.txt
Robots Exclusion Standard data for weareroku.com
Resource Scan
Scan Details
| Site Domain | weareroku.com |
| Base Domain | weareroku.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T13:32:29+00:00 |
| Next Scan | 2024-10-06T13:32:29+00:00 |
Last Scan
| Scanned | 2024-09-22T13:32:29+00:00 |
| URL | https://weareroku.com/robots.txt |
| Redirect | https://www.weareroku.com/robots.txt |
| Redirect Domain | www.weareroku.com |
| Redirect Base | weareroku.com |
| Domain IPs | 52.84.229.43, 52.84.229.59, 52.84.229.79, 52.84.229.83 |
| Redirect IPs | 13.33.88.10, 13.33.88.104, 13.33.88.2, 13.33.88.96, 2600:9000:223b:2200:1e:2b25:60c0:93a1, 2600:9000:223b:2600:1e:2b25:60c0:93a1, 2600:9000:223b:2e00:1e:2b25:60c0:93a1, 2600:9000:223b:7200:1e:2b25:60c0:93a1, 2600:9000:223b:7400:1e:2b25:60c0:93a1, 2600:9000:223b:d400:1e:2b25:60c0:93a1, 2600:9000:223b:d800:1e:2b25:60c0:93a1, 2600:9000:223b:e600:1e:2b25:60c0:93a1 |
| Response IP | 13.33.88.96 |
| Found | Yes |
| Hash | 39029d06103a99ecc29238f5a536443ed5d72c242b403e43b569d5ba80882f9a |
| SimHash | 69ad1e6e41d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /v1/candidate_details |
| Disallow | /me/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.weareroku.com/sitemap.xml |
Comments