boc.com.au
robots.txt

Robots Exclusion Standard data for boc.com.au

Resource Scan

Scan Details

Site Domain boc.com.au
Base Domain boc.com.au
Scan Status Ok
Last Scan2024-10-28T02:26:20+00:00
Next Scan 2024-11-27T02:26:20+00:00

Last Scan

Scanned2024-10-28T02:26:20+00:00
URL https://boc.com.au/robots.txt
Redirect https://www.boc.com.au/robots.txt
Redirect Domain www.boc.com.au
Redirect Base boc.com.au
Domain IPs 23.215.7.14, 23.215.7.5
Redirect IPs 23.50.85.201
Response IP 23.50.85.201
Found Yes
Hash bdcb084c12ede3297203b4e38061eb1c42b9ed2974c2738c5056a064582042fe
SimHash ce929d470156

Groups

*

Rule Path
Disallow */LegalHome*
Disallow */ProductListingView*
Disallow */LegalStatements*
Disallow */Logoff*
Disallow */LogonForm*
Disallow */LINGuestCheckoutFormView*
Disallow */SearchDisplay*
Disallow */search/*
Disallow */ProductDisplay*
Disallow */CategoryDisplay*
Disallow */LINRWDMobileStoreFinderView*
Disallow /*/campaign-*
Disallow */HelpSupportView*
Disallow */webapp/wcs/stores/servlet/*
Disallow */shop/webapp/wcs/stores/*
Disallow */at-ig/*
Disallow */at-pr/*
Disallow */au-eg/*
Disallow */au-sg/*
Disallow */be-ig/*
Disallow */ca/*
Disallow */ca-mg/*
Disallow */ch/*
Disallow */ch-ig/*
Disallow */cn/*
Disallow */cz-ig/*
Disallow */de-hc/*
Disallow */de-ig/*
Disallow */de-ub/*
Disallow */dk-hc/*
Disallow */dk-ig/*
Disallow */ee-ig/*
Disallow */es-ig/*
Disallow */fi-hc/*
Disallow */fi-ig/*
Disallow */fr-hc/*
Disallow */fr-ig/*
Disallow */gr-ig/*
Disallow */hk/*
Disallow */hu-ig/*
Disallow */in/*
Disallow */ireland/*
Disallow */it-ig/*
Disallow */is-ig/*
Disallow */lt-ig/*
Disallow */lv-ig/*
Disallow */mx-ig/*
Disallow */mx-mg/*
Disallow */my/*
Disallow */nl-hc/*
Disallow */nl-ig/*
Disallow */no-hc/*
Disallow */no-ig/*
Disallow */nz/*
Disallow */nz-eg/*
Disallow */pl-ig/*
Disallow */pt-ig/*
Disallow */ro-ig/*
Disallow */se-hc/*
Disallow */se-ig/*
Disallow */sg/*
Disallow */sk-ig/*
Disallow */thai/*
Disallow */uk/*
Disallow */uk-mod/*
Disallow */za/*
Disallow */bw/*
Disallow */mw/*
Disallow */na/*
Disallow */mz/*
Disallow */zm/*
Disallow */spw/*
Disallow */pst/*

Comments

  • adding below snippet as part of IM-22-288229
  • IM-22-154560
  • IM-22-128613
  • adding below snippet as part of IM-18-018260
  • adding below snippet as part of IM-18-066698