Log In Sign Up

dfo.com.au
robots.txt

Robots Exclusion Standard data for dfo.com.au

Resource Scan

Scan Details

Site Domain dfo.com.au
Base Domain dfo.com.au
Scan Status Ok
Last Scan2024-11-08T15:45:27+00:00
Next Scan 2024-12-08T15:45:27+00:00

Last Scan

Scanned2024-11-08T15:45:27+00:00
URL https://dfo.com.au/robots.txt
Redirect https://www.dfo.com.au:443/robots.txt
Redirect Domain www.dfo.com.au
Redirect Base dfo.com.au
Domain IPs 108.157.254.54, 108.157.254.72, 108.157.254.92, 108.157.254.95, 2600:9000:2753:2c00:16:9470:b600:93a1, 2600:9000:2753:4c00:16:9470:b600:93a1, 2600:9000:2753:5600:16:9470:b600:93a1, 2600:9000:2753:5a00:16:9470:b600:93a1, 2600:9000:2753:5e00:16:9470:b600:93a1, 2600:9000:2753:6c00:16:9470:b600:93a1, 2600:9000:2753:7000:16:9470:b600:93a1, 2600:9000:2753:9c00:16:9470:b600:93a1
Redirect IPs 104.18.14.155, 104.18.15.155, 2606:4700::6812:e9b, 2606:4700::6812:f9b
Response IP 104.18.14.155
Found Yes
Hash d2b3865f2d27de8e47618aa8ad9dd0e335ee35e62d5573b4f0860e9516e80b70
SimHash e805145ec992

Groups

*

Rule Path
Disallow /preference-centre
Disallow /channels/
Disallow /*?*
Back to top

Other Records

Field Value
sitemap https://www.dfo.com.au/sitemap.xml
Back to top