jobs.wisc.edu
robots.txt
Robots Exclusion Standard data for jobs.wisc.edu
Resource Scan
Scan Details
Site Domain | jobs.wisc.edu |
Base Domain | wisc.edu |
Scan Status | Ok |
Last Scan | 2025-03-03T10:28:11+00:00 |
Next Scan | 2025-04-02T10:28:11+00:00 |
Last Scan
Scanned | 2025-03-03T10:28:11+00:00 |
URL | https://jobs.wisc.edu/robots.txt |
Domain IPs | 18.155.68.24, 18.155.68.25, 18.155.68.81, 18.155.68.89, 2600:9000:23d2:1a00:17:3c92:bb40:93a1, 2600:9000:23d2:1c00:17:3c92:bb40:93a1, 2600:9000:23d2:2400:17:3c92:bb40:93a1, 2600:9000:23d2:4c00:17:3c92:bb40:93a1, 2600:9000:23d2:7400:17:3c92:bb40:93a1, 2600:9000:23d2:7c00:17:3c92:bb40:93a1, 2600:9000:23d2:ce00:17:3c92:bb40:93a1, 2600:9000:23d2:d800:17:3c92:bb40:93a1 |
Response IP | 18.155.68.81 |
Found | Yes |
Hash | cb86fc47bab9b98fa4fd59f52f141d3ebeedded492795278a756d1fc0abb6a8b |
SimHash | 2da81c6ec1d1 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /v1/candidate_details |
Disallow | /me/ |
Disallow | /api/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://jobs.wisc.edu/sitemap.xml |
Comments