bluescopesteel.com
robots.txt

Robots Exclusion Standard data for bluescopesteel.com

Resource Scan

Scan Details

Site Domain bluescopesteel.com
Base Domain bluescopesteel.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-04-02T10:22:11+00:00
Next Scan 2025-04-16T10:22:11+00:00

Last Successful Scan

Scanned2025-02-23T10:21:42+00:00
URL http://bluescopesteel.com/robots.txt
Redirect https://www.bluescope.com/robots.txt
Redirect Domain www.bluescope.com
Redirect Base bluescope.com
Domain IPs 3.5.165.224, 3.5.166.229, 3.5.167.209, 52.95.129.215, 52.95.131.127, 52.95.131.163, 52.95.131.59, 52.95.132.65
Redirect IPs 104.18.22.87, 104.18.23.87, 2606:4700::6812:1657, 2606:4700::6812:1757
Response IP 104.18.22.87
Found Yes
Hash ce22a20dcd99ef28469779fda1af59c883213e06496e9f97f5cb4519f3990fdf
SimHash e9071842ef56

Groups

*

Rule Path
Disallow /content/forms/
Disallow /etc/
Disallow /libs/
Disallow /bin/
Disallow /system/
Disallow /crx/
Disallow /crx/de/
Disallow /crx/packmgr/
Disallow /apps/
Disallow /var/
Disallow /tmp/
Disallow /content/geometrixx/
Disallow /content/usergenerated/
Disallow /*filter?*
Disallow /*.html?*
Disallow /*.json
Disallow /*.xml
Disallow /*.js
Disallow /*.css

Other Records

Field Value
sitemap https://www.bluescope.com/sitemap.xml