Log In Sign Up

nrg.com
robots.txt

Robots Exclusion Standard data for nrg.com

Resource Scan

Scan Details

Site Domain nrg.com
Base Domain nrg.com
Scan Status Ok
Last Scan2024-08-29T15:47:17+00:00
Next Scan 2024-09-28T15:47:17+00:00

Last Scan

Scanned2024-08-29T15:47:17+00:00
URL https://nrg.com/robots.txt
Domain IPs 107.162.237.7
Response IP 107.162.237.7
Found Yes
Hash e4546e31dd38dd9fe5a59f38eea8f51064dbcef04b363ad02cf0665270649b62
SimHash 0d14c978ea15

Groups

*

Rule Path
Disallow /search
Disallow /contact-us/
Disallow /campaigns/
Disallow /*.html/plans/*
Disallow /search
Disallow /contact-us/
Disallow /contact-us/thank-you.html
Disallow /business/consulting.html/plans/
Disallow /business/solutions.html/plans/
Disallow /business/plans.html/plans/
Disallow /business/optimization.html/plans/
Disallow /business/brokers.html/plans/
Disallow /business/all-products-and-services.html/plans/

baiduspider
baiduspider-video
baiduspider-image
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-news

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nrg.com/sitemap.xml
Back to top

Comments

  • https://www.nrg.com robots.txt
  • Served From Cloudfront
  • nnnn nnnnnnnn rrrrr rrrrrrrrr ggggggggg ggggg
  • n:::nn::::::::nn r::::rrr:::::::::r g:::::::::ggg::::g
  • n::::::::::::::nn r:::::::::::::::::r g:::::::::::::::::g
  • nn:::::::::::::::nrr::::::rrrrr::::::rg::::::ggggg::::::gg
  • n:::::nnnn:::::n r:::::r r:::::rg:::::g g:::::g
  • n::::n n::::n r:::::r rrrrrrrg:::::g g:::::g
  • n::::n n::::n r:::::r g:::::g g:::::g
  • n::::n n::::n r:::::r g::::::g g:::::g
  • n::::n n::::n r:::::r g:::::::ggggg:::::g
  • n::::n n::::n r:::::r g::::::::::::::::g
  • n::::n n::::n r:::::r gg::::::::::::::g
  • nnnnnn nnnnnn rrrrrrr gggggggg::::::g
  • g:::::g
  • gggggg g:::::g
  • g:::::gg gg:::::g
  • g::::::ggg:::::::g
  • gg:::::::::::::g
  • ggg::::::ggg
  • gggggg
Back to top