arbv.vic.gov.au
robots.txt

Robots Exclusion Standard data for arbv.vic.gov.au

Resource Scan

Scan Details

Site Domain arbv.vic.gov.au
Base Domain arbv.vic.gov.au
Scan Status Ok
Last Scan2025-04-24T05:10:46+00:00
Next Scan 2025-05-08T05:10:46+00:00

Last Scan

Scanned2025-04-24T05:10:46+00:00
URL https://arbv.vic.gov.au/robots.txt
Redirect https://www.arbv.vic.gov.au/robots.txt
Redirect Domain www.arbv.vic.gov.au
Redirect Base arbv.vic.gov.au
Domain IPs 103.107.226.226
Redirect IPs 103.233.30.103, 103.233.30.112, 103.233.30.141, 103.233.30.144
Response IP 103.233.30.144
Found Yes
Hash 46f77572e9fa568721d323279294ab96df80feb2385587daa54364408b7f29ef
SimHash 900adea26fb2

Groups

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /js
Disallow /img
Disallow /_nuxt/*
Disallow /oauth/*
Disallow /preview/*
Disallow /share-link

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.arbv.vic.gov.au/sitemap.xml