virginia.gov
robots.txt
Robots Exclusion Standard data for virginia.gov
Resource Scan
Scan Details
| Site Domain | virginia.gov |
| Base Domain | virginia.gov |
| Scan Status | Ok |
| Last Scan | 2024-10-16T22:40:19+00:00 |
| Next Scan | 2024-11-15T22:40:19+00:00 |
Last Scan
| Scanned | 2024-10-16T22:40:19+00:00 |
| URL | https://www.virginia.gov/robots.txt |
| Domain IPs | 3.217.170.73, 34.196.103.189, 35.153.47.197, 35.171.46.240 |
| Response IP | 34.196.103.189 |
| Found | Yes |
| Hash | ff5fc53eec1d5d5cbb5ddc3048859482b3f0d17a32efdfe460f54809e827218c |
| SimHash | 2105d271abd0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /site-config |
| Disallow | /_sidebar |
| Disallow | /_accordion |
| Disallow | /testing |
| Disallow | /archive |
| Disallow | /demo |
| Disallow | /trash |
| Disallow | /sidebar |
| Disallow | /accordion |
| Disallow | /modules |
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /404 |
| Disallow | /home-features |
| Disallow | /agencies/*/services |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.virginia.gov/sitemap.xml |