simplyenergy.com.au
robots.txt

Robots Exclusion Standard data for simplyenergy.com.au

Resource Scan

Scan Details

Site Domain simplyenergy.com.au
Base Domain simplyenergy.com.au
Scan Status Ok
Last Scan2024-05-24T01:56:28+00:00
Next Scan 2024-06-23T01:56:28+00:00

Last Scan

Scanned2024-05-24T01:56:28+00:00
URL https://simplyenergy.com.au/robots.txt
Redirect https://engie.com.au/robots.txt
Redirect Domain engie.com.au
Redirect Base engie.com.au
Domain IPs 104.18.16.222
Redirect IPs 104.18.30.187, 104.18.31.187
Response IP 104.18.31.187
Found Yes
Hash 5623bf679fce13f64985e90bb4416a01fda210298953310f22a8170af3f2abe3
SimHash b514195f8540

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Disallow /core/
Disallow /profiles/
Disallow /README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/
Disallow /residential/electricity-and-gas-plans/plans/staff
Disallow /residential/electricity-and-gas-plans/plans/anz
Disallow /residential/electricity-and-gas-plans/plans/suez
Disallow /residential/electricity-and-gas-plans/plans/nrma-blue
Disallow /residential/electricity-and-gas-plans/plans/sprinfield
Disallow /residential/electricity-and-gas-plans/plans/loreal-staff
Disallow /residential/electricity-and-gas-plans/plans/WAFL-staff
Disallow /residential/electricity-and-gas-plans/plans/afl-staff
Disallow /residential/electricity-and-gas-plans/plans/engie-services
Disallow /residential/electricity-and-gas-plans/plans/village-staff
Disallow /residential/electricity-and-gas-plans/plans/engie-partner
Disallow /residential/electricity-and-gas-plans/plans/the-media-store
Disallow /residential/moving-home/moving-home/before-we-start
Disallow /residential/moving-home/moving-home/your-details
Disallow /residential/moving-home/moving-home/move-out
Disallow /residential/moving-home/moving-home/select-plan
Disallow /residential/moving-home/moving-home/new-address
Disallow /residential/moving-home/moving-home/billing-options
Disallow /residential/moving-home/moving-home/summary
Disallow /residential/moving-home/moving-home/confirm-details
Disallow /residential/moving-home/moving-home/thankyou
Disallow /residential/checkout/step1
Disallow /residential/checkout/step2
Disallow /residential/checkout/step3
Disallow /residential/checkout/step4
Disallow /residential/checkout/step5
Disallow /business/checkout/step1
Disallow /business/checkout/step2
Disallow /business/checkout/step3
Disallow /business/checkout/step4
Disallow /business/checkout/step5
Disallow /soho/checkout/step1
Disallow /soho/checkout/step2
Disallow /soho/checkout/step3
Disallow /soho/checkout/step4
Disallow /soho/checkout/step5
Disallow address_lookup
Disallow /address_details
Disallow /confirm_manual_address
Disallow /mailing_address_details
Disallow /nmi_discovery/nmi
Disallow /mirn_discovery/mirn
Disallow /set_move_in_date
Disallow /set_customer_details
Disallow /change_plan_get_address
Disallow /change_plan_set_address
Disallow /get_payment_response
Disallow /payment_success
Disallow /get_energy_factsheet

Other Records

Field Value
sitemap https://engie.com.au/sitemap.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Paths to non-content pages.