Log In Sign Up

energia.rp.pl
robots.txt

Robots Exclusion Standard data for energia.rp.pl

Resource Scan

Scan Details

Site Domain energia.rp.pl
Base Domain rp.pl
Scan Status Ok
Last Scan2024-11-15T14:43:21+00:00
Next Scan 2024-11-29T14:43:21+00:00

Last Scan

Scanned2024-11-15T14:43:21+00:00
URL https://energia.rp.pl/robots.txt
Domain IPs 104.22.68.85, 104.22.69.85, 172.67.6.239, 2606:4700:10::6816:4455, 2606:4700:10::6816:4555, 2606:4700:10::ac43:6ef
Response IP 172.67.6.239
Found Yes
Hash ccabe64f280a2c233d5a48df7d3ffb7675503ec4e08f860c01868f372b654afe
SimHash 2f548259c782

Groups

*

Rule Path
Allow /
Disallow /*template%3Dprintart*
Disallow /*template%3Dartzen*
Disallow /*template%3Dloadcomments*
Disallow /*template%3Dartstatus*
Disallow /*template%3Dtestontheart*
Disallow /*template%3Dslider*
Disallow /szukaj/*
Disallow /section/advanced-search*
Disallow /GBC*
Disallow /*template%3Dinfinityscroll*
Disallow /*template%3DgetParagraphToLiveMamut*
Disallow /*template%3DgetParagraph*
Disallow /*name%3D*.php5*
Disallow /*name%3D*.js*
Disallow /*/JavaScript%3A*
Disallow /content/preview/*
Disallow /brak_autora
Disallow /*lpurl%3D*
Disallow /*lopenr%3D*
Disallow /cdn-cgi/*
Disallow /ht_biznes/*
Disallow /404
Disallow /przemysl-spozywczy/art39005721-*
Back to top

Other Records

Field Value
sitemap https://energia.rp.pl/sitemaps/sitemap.xml
sitemap https://energia.rp.pl/sitemaps/news-sitemap.xml
Back to top

Comments

  • Dead requests found in Google Search Console
  • We don't want to index our scripts
  • We don't want to index preview pages
  • We don't want to index pages without meaningfull content
  • We don't want to index advert preview pages
  • We don't want to index technical url's
Back to top