Log In Sign Up

hel.fi
robots.txt

Robots Exclusion Standard data for hel.fi

Resource Scan

Scan Details

Site Domain hel.fi
Base Domain hel.fi
Scan Status Ok
Last Scan2025-10-07T17:28:42+00:00
Next Scan 2025-11-06T17:28:42+00:00

Last Scan

Scanned2025-10-07T17:28:42+00:00
URL https://hel.fi/robots.txt
Redirect https://www.hel.fi/robots.txt
Redirect Domain www.hel.fi
Redirect Base hel.fi
Domain IPs 20.50.166.83
Redirect IPs 20.50.166.83
Response IP 20.50.166.83
Found Yes
Hash 9489228fa026f7f26fda3b93b6d5c7429054eaa7ca6056a2c3359831c088a316
SimHash 2f10771bc564

Groups

*

Rule Path
Allow */core/*.css$
Allow */core/*.css?
Allow */core/*.js$
Allow */core/*.js?
Allow */core/*.gif
Allow */core/*.jpg
Allow */core/*.jpeg
Allow */core/*.png
Allow */core/*.svg
Allow */profiles/*.css$
Allow */profiles/*.css?
Allow */profiles/*.js$
Allow */profiles/*.js?
Allow */profiles/*.gif
Allow */profiles/*.jpg
Allow */profiles/*.jpeg
Allow */profiles/*.png
Allow */profiles/*.svg
Disallow */core/
Disallow */profiles/
Disallow */admin/
Disallow */comment/reply/
Disallow */filter/tips
Disallow */node/add/
Disallow */search/
Disallow */user/register
Disallow */user/password
Disallow */user/login
Disallow */user/logout
Disallow /*?*groups
Disallow /*?*neighbourhoods
Disallow /*?*employment=*
Disallow /*?*keyword=*
Disallow /*?*continuous=*
Disallow /*?*internship=*
Disallow /fi/avoimet-tyopaikat/*?*language=*
Disallow /sv/lediga-jobb/*?*language=*
Disallow /en/open-jobs/*?*language=*
Disallow /wps/portal/%21ut/p/
Disallow /wps/wcmjspv2/
Disallow /wps/portal/home/
Disallow /wps/wcm/connect/*urile
Disallow /wps/portal/HelsinginSeutu
Disallow /palvelukartta/maps/
Disallow /static/mirror/
Disallow /static/mirror-v2/
Disallow /static/mirror-seutu/
Disallow /ArchiveTool/
Disallow /hki/Helsinki/fi/Uutiset/Uutisarkisto
Disallow /hki/sosv/fi/Ajankohtaista/Uutiset/Uutisarkisto
Disallow /hki/hkr/fi/Ajankohtaista/Uutisarkisto
Disallow /hki/ksv/fi/Uutiset/Uutisarkisto
Disallow /hki/kv/fi/Maa-%2Bja%2Bkallioper_/Uutisarkisto
Disallow /hki/rakpa/fi/Ajankohtaista/Uutisarkisto
Disallow /hki/helsinki/fi/
Disallow /hki/helsinki/sv/
Disallow /hki/helsinki/en/
Disallow /hki/Rakpa/fi/
Disallow /hki/Arbis/
Disallow /wps/portal/Palmia/Helsinginmatkapalvelu
Disallow /wps/portal/palmia/Helsinginmatkapalvelu
Disallow /wps/portal/Palmia_sv/Helsingforsresetjanst
Disallow /wps/portal/palmia_sv/Helsingforsresetjanst
Disallow /hki/oiva/
Disallow /hki/Oiva/
Disallow /www/ptemplate/
Disallow /wps/portal/Oiva
Disallow /wps/portal/HelsinkiV2/%21ut/p/
Disallow /wps/portal/Home/
Disallow /hki/HS/Helsingfors%2BRegion/
Disallow /hki/HS/Helsingin%2BSeutu/
Disallow /hki/HS/The%2BRegion%2Bof%2BHelsinki/
Disallow /wps/portal/HelsinkiV2/

wex/ibmtest

Rule Path
Allow /static/mirror-v2/
Back to top

Other Records

Field Value
sitemap https://www.hel.fi/sitemap.xml
Back to top

Comments

  • Robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images
  • Directories
  • Paths (clean URLs)
  • Etusivu news-search page query parameters, topic and page allowed
  • Rekry job-search page query parameters, task_areas and page are allowed.
  • Language query parameter is used in css & js files.
  • Old robots
  • http://www.hel.fi/robots.txt
  • Created 2008-01-23,
  • Updated 2008-02-22,
  • - added dynamic content section
  • Updated 2008-04-11,
  • - static copy moved under /mirror
  • Updated 2008-10-03,
  • - added /tprtesti/
  • Updated 2009-03-12,
  • - added /helsi, /palvelukartta/maps/
  • - removed mirror
  • Updated 2009-04-03,
  • - removed /helsi, /tprtesti
  • Updated 2009-09-01,
  • - reintroduced /static/mirror/
  • Updated 2012-01-05,
  • - added /ArchiveTool/
  • Updated 2012-10-02,
  • - added 9 archive pages
  • Updated 2012-11-05,
  • - changed "dynamic" to properly exclude version 7 dynamic content
  • Updated 2013-03-15,
  • - added www.hel2.fi/robots.txt content
  • Updated 2014-05-06, AK
  • - Removed disallow new concept, added disallow helsinki-library
  • Updated 2017-05-15,
  • - Added wcmjspv2, mirror-seutu
  • Updated 2017-06-02, excluding "urile" paths
  • - Added Disallow: /wps/wcm/connect/*urile
  • 2017-09-20 added allow for WEX/IBMtest based on request
  • CGI-bins
  • Disallow: /cgi-bin
  • Disallow: /cgi-bin/
  • Images
  • Disallow: /images/
  • Dynamic content
  • Seutu should be accessed at
  • http://www.helsinginseutu.fi/
  • requested by PP
  • Static copy not to be indexed
  • News archive not to be indexed
  • requested by PP
  • Old pages to be excluded from search engine indexes
  • www.hel2.fi/robots.txt additions
  • Disallow: /hel2/graafisetohjeet/
  • Disallow: /hel2/Haku/
  • Disallow: /hel2/onebsr
  • Rakpa moved to new theme, exclude old ones
  • Old Arbis
  • Old Matkapalvelu
Back to top

Warnings

  • 4 invalid lines.
Back to top