careers.msu.edu
robots.txt
Robots Exclusion Standard data for careers.msu.edu
Resource Scan
Scan Details
| Site Domain | careers.msu.edu |
| Base Domain | msu.edu |
| Scan Status | Ok |
| Last Scan | 2025-03-22T01:12:20+00:00 |
| Next Scan | 2025-04-21T01:12:20+00:00 |
Last Scan
| Scanned | 2025-03-22T01:12:20+00:00 |
| URL | https://careers.msu.edu/robots.txt |
| Domain IPs | 18.155.68.104, 18.155.68.15, 18.155.68.44, 18.155.68.71, 2600:9000:23d2:4e00:15:88e6:5140:93a1, 2600:9000:23d2:7200:15:88e6:5140:93a1, 2600:9000:23d2:7c00:15:88e6:5140:93a1, 2600:9000:23d2:8a00:15:88e6:5140:93a1, 2600:9000:23d2:ae00:15:88e6:5140:93a1, 2600:9000:23d2:c200:15:88e6:5140:93a1, 2600:9000:23d2:d600:15:88e6:5140:93a1, 2600:9000:23d2:fc00:15:88e6:5140:93a1 |
| Response IP | 18.155.68.71 |
| Found | Yes |
| Hash | 770486142c3f0fa43a6afba139bfeb5d8a944b1ae908e950508a200b551c4ef8 |
| SimHash | 6daf5e6ec150 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /v1/candidate_details |
| Disallow | /me/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://careers.msu.edu/sitemap.xml |
Comments