careers.toasttab.com
robots.txt
Robots Exclusion Standard data for careers.toasttab.com
Resource Scan
Scan Details
| Site Domain | careers.toasttab.com |
| Base Domain | toasttab.com |
| Scan Status | Ok |
| Last Scan | 2024-05-02T21:58:53+00:00 |
| Next Scan | 2024-05-16T21:58:53+00:00 |
Last Scan
| Scanned | 2024-05-02T21:58:53+00:00 |
| URL | https://careers.toasttab.com/robots.txt |
| Domain IPs | 13.35.18.101, 13.35.18.11, 13.35.18.112, 13.35.18.24, 2600:9000:20c7:2600:17:5799:2280:93a1, 2600:9000:20c7:5400:17:5799:2280:93a1, 2600:9000:20c7:a000:17:5799:2280:93a1, 2600:9000:20c7:d400:17:5799:2280:93a1, 2600:9000:20c7:da00:17:5799:2280:93a1, 2600:9000:20c7:e200:17:5799:2280:93a1, 2600:9000:20c7:e600:17:5799:2280:93a1, 2600:9000:20c7:f600:17:5799:2280:93a1 |
| Response IP | 13.35.18.11 |
| Found | Yes |
| Hash | 5b85c8a6d88bad48aad2d8e2e613be62702dc26fff84b3d2ced2040d30c09c2a |
| SimHash | 252c94ee41f1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /v1/candidate_details |
| Disallow | /me/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://careers.toasttab.com/sitemap.xml |
Comments