dsvic.org.au
robots.txt

Robots Exclusion Standard data for dsvic.org.au

Resource Scan

Scan Details

Site Domain dsvic.org.au
Base Domain dsvic.org.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-05T14:33:37+00:00
Next Scan 2025-07-04T14:33:37+00:00

Last Successful Scan

Scanned2024-06-10T12:56:24+00:00
URL https://dsvic.org.au/robots.txt
Domain IPs 104.21.44.229, 172.67.204.192, 2606:4700:3031::ac43:ccc0, 2606:4700:3036::6815:2ce5
Response IP 104.21.44.229
Found Yes
Hash da853e9215940d2417ca5e0bc2b87fb35e1b75478074c91d648f5c7c54a0e639
SimHash 6914581063b3

Groups

*

Rule Path
Disallow /pages/

bingbot

Rule Path
Disallow /pages/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dsvic.org.au/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content