spuntinigroup.be
robots.txt

Robots Exclusion Standard data for spuntinigroup.be

Resource Scan

Scan Details

Site Domain spuntinigroup.be
Base Domain spuntinigroup.be
Scan Status Ok
Last Scan2024-09-26T00:01:36+00:00
Next Scan 2024-10-26T00:01:36+00:00

Last Scan

Scanned2024-09-26T00:01:36+00:00
URL https://spuntinigroup.be/robots.txt
Redirect https://www.spuntini.be/robots.txt
Redirect Domain www.spuntini.be
Redirect Base spuntini.be
Domain IPs 217.19.237.54
Redirect IPs 76.76.21.22, 76.76.21.98
Response IP 76.76.21.9
Found Yes
Hash 714a4ee21bb2f9acf1ac0a44b2813e195f2498cf3ffb3d540a7559dc35980e19
SimHash cf5ec440dcb4

Groups

*

Rule Path
Disallow
Disallow /legal/*
Disallow /nl-be/legal/*
Disallow /fr-be/legal/*

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Disallow /nl-be/
Disallow /fr-be/

Other Records

Field Value
sitemap https://www.spuntini.be/sitemap_index.xml

Comments

  • START nuxt-simple-robots (indexable)
  • Block bots that don't benefit us.
  • END nuxt-simple-robots