state.nj.us
robots.txt
Robots Exclusion Standard data for state.nj.us
Resource Scan
Scan Details
| Site Domain | state.nj.us |
| Base Domain | state.nj.us |
| Scan Status | Ok |
| Last Scan | 2025-11-30T00:12:54+00:00 |
| Next Scan | 2025-12-30T00:12:54+00:00 |
Last Scan
| Scanned | 2025-11-30T00:12:54+00:00 |
| URL | https://state.nj.us/robots.txt |
| Redirect | https://www.nj.gov/robots.txt |
| Redirect Domain | www.nj.gov |
| Redirect Base | nj.gov |
| Domain IPs | 13.248.160.137, 76.223.34.124 |
| Redirect IPs | 45.60.81.108 |
| Response IP | 45.60.81.108 |
| Found | Yes |
| Hash | e84c2a37747aa0ece5fb0cabd789956c7d0b655ce535d3636ad684ecd34a1fc5 |
| SimHash | fc26177bcf73 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /Support/agriculture/ |
| Allow | /Support/agriculture |
| Allow | /Support/nj/ |
| Allow | /Support/nj |
| Disallow | /cgi-bin/homelandsecurity/ |
| Disallow | /cgi-bin/dobi/licenseesearch/ |
| Disallow | /cgi-bin/consumeraffairs/search/ |
| Disallow | /cgi-bin/state/ |
| Disallow | /Support/ |
| Disallow | /treasury/treasdocuments/ |
| Disallow | /highereducation/higheddocs/ |