www.jobs.virginia.gov
robots.txt
Robots Exclusion Standard data for www.jobs.virginia.gov
Resource Scan
Scan Details
| Site Domain | www.jobs.virginia.gov |
| Base Domain | virginia.gov |
| Scan Status | Ok |
| Last Scan | 2024-11-03T09:20:27+00:00 |
| Next Scan | 2024-12-03T09:20:27+00:00 |
Last Scan
| Scanned | 2024-11-03T09:20:27+00:00 |
| URL | https://www.jobs.virginia.gov/robots.txt |
| Domain IPs | 108.156.133.12, 108.156.133.22, 108.156.133.4, 108.156.133.40, 2600:9000:2755:1800:8:a21:a300:93a1, 2600:9000:2755:1a00:8:a21:a300:93a1, 2600:9000:2755:7400:8:a21:a300:93a1, 2600:9000:2755:9200:8:a21:a300:93a1, 2600:9000:2755:a800:8:a21:a300:93a1, 2600:9000:2755:ac00:8:a21:a300:93a1, 2600:9000:2755:e200:8:a21:a300:93a1, 2600:9000:2755:f800:8:a21:a300:93a1 |
| Response IP | 108.156.133.22 |
| Found | Yes |
| Hash | ffd3ca9d9a079ee98089025b045ae1b3fe2e79f2d60020e32f17db12682e8746 |
| SimHash | 29a91e6e4151 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /v1/candidate_details |
| Disallow | /me/ |
| Disallow | /api/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.jobs.virginia.gov/sitemap.xml |
Comments