hostpapa.ca
robots.txt

Robots Exclusion Standard data for hostpapa.ca

Resource Scan

Scan Details

Site Domain hostpapa.ca
Base Domain hostpapa.ca
Scan Status Ok
Last Scan2025-10-17T18:30:10+00:00
Next Scan 2025-11-16T18:30:10+00:00

Last Scan

Scanned2025-10-17T18:30:10+00:00
URL https://hostpapa.ca/robots.txt
Redirect https://www.hostpapa.ca/robots.txt
Redirect Domain www.hostpapa.ca
Redirect Base hostpapa.ca
Domain IPs 104.18.18.159, 104.18.19.159, 2606:4700::6812:129f, 2606:4700::6812:139f
Redirect IPs 104.18.18.159, 104.18.19.159, 2606:4700::6812:129f, 2606:4700::6812:139f
Response IP 104.18.19.159
Found Yes
Hash da566b64e854b10f237fc1df9639b8e3787d79a863150e3e1eef90cd45d70b1c
SimHash fc3466e25e99

Groups

libwww

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

yandexsomething/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

googlebot-image

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

adsbot-google

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

googlebot-mobile

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

semrushbot

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

semrushbot-sa

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

*

Rule Path
Disallow /?s=
Disallow /ads/
Disallow /scripts/
Disallow /root/
Disallow /root-es/
Disallow /root-en/
Disallow /root-de/
Disallow /root-fr/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /silverstripe-cache/
Disallow /adm/
Disallow /logs/
Disallow /res/
Disallow /framework/
Disallow /Opie_Process/
Disallow /hybridauth/
Disallow /__BACKUP/
Disallow /SortableGridField/
Disallow /Opie_Framework/
Disallow /widgets/
Disallow /vendor/
Disallow /translatable/
Disallow /restfulserver/
Disallow /queuedjobs/
Disallow /Opie_Orders/
Disallow /Opie_Intranet/
Disallow /Opie_Dashboard/
Disallow /Opie_Commons/
Disallow /Opie_ClientSection/
Disallow /hostpapa/
Disallow /GridFieldRelationHandler/
Disallow /googlesitemaps/
Disallow /comments/
Disallow /cms/
Disallow /auth_external/
Disallow /__UPGRADE/
Disallow /hostpapa-app/
Disallow /admin/
Disallow /intranet/
Disallow /static/
Disallow /form_res/
Disallow /cdn-cgi/
Disallow /letpapain
Disallow /blog/letpapain
Disallow /knowledgebase/letpapain
Disallow /home/hybridauth/
Disallow /orders
Disallow /commandes
Disallow /formulario
Disallow /bestellungen
Disallow /ajax
Disallow /loading
Disallow /blog/page

Other Records

Field Value
crawl-delay 12

Warnings

  • 4 invalid lines.