gemius.hu
robots.txt

Robots Exclusion Standard data for gemius.hu

Resource Scan

Scan Details

Site Domain gemius.hu
Base Domain gemius.hu
Scan Status Ok
Last Scan2024-11-14T03:37:54+00:00
Next Scan 2024-11-21T03:37:54+00:00

Last Scan

Scanned2024-11-14T03:37:54+00:00
URL https://gemius.hu/robots.txt
Domain IPs 91.221.127.108
Response IP 91.221.127.108
Found Yes
Hash 763e68267e1701295905e255cf91a07b413b17d674b75c91e5350aae18434bd9
SimHash e9604030773b

Groups

*

Rule Path
Disallow /check/
Disallow /contao/
Disallow /system/
Disallow /templates/
Disallow /share/index.php
Disallow /flash.php
Disallow /README.md
Disallow /share/?p=
Allow /assets/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.gemius.com/share/sitemap.xml
sitemap https://www.gemius.com/share/sitemapbg.xml
sitemap https://www.gemius.com/share/sitemapcz.xml
sitemap https://www.gemius.com/share/sitemapee.xml
sitemap https://www.gemius.com/share/sitemaphu.xml
sitemap https://www.gemius.com/share/sitemaplt.xml
sitemap https://www.gemius.com/share/sitemaplv.xml
sitemap https://www.gemius.com/share/sitemappl.xml
sitemap https://www.gemius.com/share/sitemapro.xml
sitemap https://www.gemius.com/share/sitemap-ru.xml
sitemap https://www.gemius.com/share/sitemapsi.xml
sitemap https://www.gemius.com/share/sitemap-tr.xml
sitemap https://www.gemius.com/share/sitemap-ua.xml