dfo.com.au
robots.txt

Robots Exclusion Standard data for dfo.com.au

Resource Scan

Scan Details

Site Domain dfo.com.au
Base Domain dfo.com.au
Scan Status Ok
Last Scan2024-09-25T15:44:53+00:00
Next Scan 2024-10-09T15:44:53+00:00

Last Scan

Scanned2024-09-25T15:44:53+00:00
URL https://dfo.com.au/robots.txt
Redirect https://www.dfo.com.au:443/robots.txt
Redirect Domain www.dfo.com.au
Redirect Base dfo.com.au
Domain IPs 108.157.254.54, 108.157.254.72, 108.157.254.92, 108.157.254.95, 2600:9000:2753:6000:16:9470:b600:93a1, 2600:9000:2753:7a00:16:9470:b600:93a1, 2600:9000:2753:9200:16:9470:b600:93a1, 2600:9000:2753:aa00:16:9470:b600:93a1, 2600:9000:2753:ba00:16:9470:b600:93a1, 2600:9000:2753:be00:16:9470:b600:93a1, 2600:9000:2753:e00:16:9470:b600:93a1, 2600:9000:2753:f200:16:9470:b600:93a1
Redirect IPs 104.18.14.155, 104.18.15.155, 2606:4700::6812:e9b, 2606:4700::6812:f9b
Response IP 104.18.15.155
Found Yes
Hash d2b3865f2d27de8e47618aa8ad9dd0e335ee35e62d5573b4f0860e9516e80b70
SimHash e805145ec992

Groups

*

Rule Path
Disallow /preference-centre
Disallow /channels/
Disallow /*?*

Other Records

Field Value
sitemap https://www.dfo.com.au/sitemap.xml