Log In Sign Up

igen-nem.hu
robots.txt

Robots Exclusion Standard data for igen-nem.hu

Resource Scan

Scan Details

Site Domain igen-nem.hu
Base Domain igen-nem.hu
Scan Status Ok
Last Scan2026-03-09T19:43:18+00:00
Next Scan 2026-03-16T19:43:18+00:00

Last Scan

Scanned2026-03-09T19:43:18+00:00
URL https://igen-nem.hu/robots.txt
Domain IPs 195.200.232.75
Response IP 195.200.232.75
Found Yes
Hash 19e6b9484978218b758ca889d7358447ae6ebdb10444e91b2392df1259f68a60
SimHash bc14bd1ac745

Groups

*

Rule Path
Disallow /statistic/
Disallow /phpmyadmin/
Disallow /.svn/
Disallow /_doc/
Disallow /error503.php
Disallow /errorUnexpected.php
Disallow /404-hiba
Disallow /hiba-404-hiba
Disallow /admin/

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow
Back to top

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/wc/robots.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • Directories
  • Files
  • Paths (clean URLs)
  • Admin
Back to top