dpi.nsw.gov.au
robots.txt
Robots Exclusion Standard data for dpi.nsw.gov.au
Resource Scan
Scan Details
| Site Domain | dpi.nsw.gov.au |
| Base Domain | nsw.gov.au |
| Scan Status | Ok |
| Last Scan | 2024-05-30T04:44:46+00:00 |
| Next Scan | 2024-06-29T04:44:46+00:00 |
Last Scan
| Scanned | 2024-05-30T04:44:46+00:00 |
| URL | https://dpi.nsw.gov.au/robots.txt |
| Redirect | https://www.dpi.nsw.gov.au/robots.txt |
| Redirect Domain | www.dpi.nsw.gov.au |
| Redirect Base | nsw.gov.au |
| Domain IPs | 43.245.43.33 |
| Redirect IPs | 202.9.95.188 |
| Response IP | 203.82.24.7 |
| Found | Yes |
| Hash | e2af7b8901754739075a0070c0093b6dcbac97707ba264f0a1f6a1ef522a10c2 |
| SimHash | e1197884c481 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?sq_content_src= |
| Disallow | /*_recache |
| Disallow | /*_edit |
| Disallow | /*_admin |
| Disallow | /*_login |
| Disallow | /*_performance |
| Disallow | /404 |
| Disallow | /*?a=* |
| Disallow | /content/system-resources/* |
| Disallow | /*/_nocache |
| Disallow | /*SQ_PAINT_LAYOUT_NAME%3Dstaff |
| Disallow | /*SQ_DESIGN_NAME%3Dblank |
| Disallow | /_design* |
| Disallow | /_guide* |
| Disallow | /_manage* |
| Disallow | /_pagecomponents* |
| Disallow | /_pageelements* |
| Disallow | /_staff* |
| Disallow | /info |
| Disallow | */Lumpy-Skin-Disease-Information-to-landholders-in-Emegency-Zones.pdf |
| Disallow | */borderbridge/exercise-only/* |
| Disallow | */barlow.pdf |
| Disallow | */_sandbox* |
| Disallow | */sandbox* |
| Disallow | */archive/news-releases/fishing-and-aquaculture/2007/abalone-gut-bait-ban |
| Disallow | */621259/* |
| Disallow | */animals-and-livestock/nlis/pic/administration-of-the-pic-system-for-livestock |
| Disallow | */animals-and-livestock/nlis/pic/pic-survey |
| Disallow | */fishing/recreational/fresh-rec-fish-research |
| Disallow | */dpi-stories-staging |
| Disallow | */biosecurity/weeds/weed-categories/plants-not-to-be-sold |
| Disallow | */templates |
| Disallow | */agriculture/broadacre-crops/guides/publications/nthn-nsw-newsletter-20201 |
| Disallow | */agriculture/broadacre-crops/guides/publications/southern-results-newsletter-2020/southern-results-newsletter-20211 |
| Disallow | */biosecurity/weeds/strategy/nsw-weeds-action-program |
| Disallow | /_regional |
| Disallow | /_regional/* |
| Disallow | /content/research* |
| Disallow | /content/research_old* |