oit.va.gov
robots.txt
Robots Exclusion Standard data for oit.va.gov
Resource Scan
Scan Details
| Site Domain | oit.va.gov |
| Base Domain | va.gov |
| Scan Status | Ok |
| Last Scan | 2025-02-14T12:53:17+00:00 |
| Next Scan | 2025-03-16T12:53:17+00:00 |
Last Scan
| Scanned | 2025-02-14T12:53:17+00:00 |
| URL | https://oit.va.gov/robots.txt |
| Domain IPs | 152.131.96.26, 2600:8000:0:28::28:26 |
| Response IP | 152.130.96.26 |
| Found | Yes |
| Hash | 574b70a4564cf43e240b5829fcb14efd56a3abba14d0f0b13fbfd8e8fb77a769 |
| SimHash | 1842e4806fd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_archive/ |
| Disallow | /_media/ |
| Disallow | /_pods/ |
| Disallow | /_utils/ |
| Disallow | /com/ |
| Disallow | /library/ |
| Disallow | /services/trm/ |
| Disallow | /specialreports/_media/ |
| Disallow | /specialreports/dhp/_media/ |
| Disallow | /analytics/_media/ |
| Disallow | /design-guide/_media/ |
| Disallow | /tech-incubator/handlers/ |
| Disallow | /tech-incubator/views/_pods |
| Disallow | /tech-incubator/views/backoffice |
| Disallow | /tech-incubator/models/ |
| Disallow | /tech-incubator/_media/ |
| Disallow | /reports/year-in-review/2018/handlers/ |
| Disallow | /reports/year-in-review/2018/views/_pods |
| Disallow | /reports/year-in-review/2018/models/ |
| Disallow | /reports/year-in-review/2018/_media/ |
| Disallow | /reports/year-in-review/2019/_pods |
| Disallow | /reports/year-in-review/2019/_media/ |
| Disallow | /reports/year-in-review/2020/_pods |
| Disallow | /reports/year-in-review/2020/_media/ |
| Disallow | /services/cloud-software/ |
| Disallow | /library/ |