hostpapa.eu
robots.txt

Robots Exclusion Standard data for hostpapa.eu

Resource Scan

Scan Details

Site Domain hostpapa.eu
Base Domain hostpapa.eu
Scan Status Ok
Last Scan2024-05-11T13:18:01+00:00
Next Scan 2024-06-10T13:18:01+00:00

Last Scan

Scanned2024-05-11T13:18:01+00:00
URL https://hostpapa.eu/robots.txt
Redirect https://www.hostpapa.eu/robots.txt
Redirect Domain www.hostpapa.eu
Redirect Base hostpapa.eu
Domain IPs 104.18.18.58, 104.18.19.58, 2606:4700::6812:123a, 2606:4700::6812:133a
Redirect IPs 104.18.18.58, 104.18.19.58, 2606:4700::6812:123a, 2606:4700::6812:133a
Response IP 104.18.19.58
Found Yes
Hash 80727e9d5c4fa897fa64de25b638196523c06e8f73c37142a6fbaf8855c474ad
SimHash fc3466e25e99

Groups

libwww

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

yandexsomething/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

googlebot-image

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

adsbot-google

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

googlebot-mobile

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

semrushbot

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

semrushbot-sa

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

*

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

Warnings

  • 4 invalid lines.