bernard.be
robots.txt

Robots Exclusion Standard data for bernard.be

Resource Scan

Scan Details

Site Domain bernard.be
Base Domain bernard.be
Scan Status Ok
Last Scan2024-10-26T07:10:35+00:00
Next Scan 2024-11-25T07:10:35+00:00

Last Scan

Scanned2024-10-26T07:10:35+00:00
URL https://bernard.be/robots.txt
Redirect https://www.bernard.be/robots.txt
Redirect Domain www.bernard.be
Redirect Base bernard.be
Domain IPs 85.233.214.114
Redirect IPs 108.157.254.105, 108.157.254.112, 108.157.254.80, 108.157.254.9, 2600:9000:2753:1600:11:8bc5:a180:93a1, 2600:9000:2753:2c00:11:8bc5:a180:93a1, 2600:9000:2753:3800:11:8bc5:a180:93a1, 2600:9000:2753:3c00:11:8bc5:a180:93a1, 2600:9000:2753:6600:11:8bc5:a180:93a1, 2600:9000:2753:7400:11:8bc5:a180:93a1, 2600:9000:2753:ba00:11:8bc5:a180:93a1, 2600:9000:2753:c00:11:8bc5:a180:93a1
Response IP 108.157.254.80
Found Yes
Hash 8e990f370d71b2f7b2e37612c114d4c474d3bd8c527cfb411ab441f6bfad3423
SimHash 05707281c630

Groups

*

Rule Path
Disallow */encrypt/encrypt.js
Disallow */seo/seoService.min.js
Disallow *pgid%3D*
Disallow *SearchCat%3D*
Disallow *SearchDim%3D*
Disallow *SearchQuery%3D*
Disallow *PageableID%3D*
Disallow *EffortCode%3DWW*
Disallow *effort_code%3D*
Disallow *Effort_Code%3D*
Disallow *T_From%3D*
Disallow *SignIn%3D*
Disallow *AccountCreation%3D*
Disallow /account*
Disallow /Account*
Disallow *cshtml
Disallow */cb*/
Disallow */itr/
Disallow *AlreadySignIn%3D*
Disallow /INTERSHOP/web/
Disallow /SG_AP*
Disallow /SG_BOS*
Disallow /rb_bf57020vgf*
Disallow /*HubAttribute%3D*

mediapartners-google
adsbot-google-mobile
adsbot-google
googlebot-image
googlebot-video
bingbot
msnbot-media
adidxbot
screaming frog seo spider

Rule Path
Disallow

ia_archiver
scoutjet
facebot
searchmetricsbot
wget
turnitinbot
httrack
baiduspider
yandex
bubing

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bernard.be/fr_BE/sitemap/BE_FR_SITEMAP_HTTPS
sitemap https://www.bernard.be/nl_BE/sitemap/BE_NL_SITEMAP_HTTPS

Comments

  • Alexa Archive
  • crawler ibm watson
  • bot facebook
  • outil Search Metrics
  • Linux
  • Base de donnée étudiante
  • Aspirateur Web