swisssense.be
robots.txt

Robots Exclusion Standard data for swisssense.be

Resource Scan

Scan Details

Site Domain swisssense.be
Base Domain swisssense.be
Scan Status Ok
Last Scan2025-04-20T13:17:05+00:00
Next Scan 2025-05-04T13:17:05+00:00

Last Scan

Scanned2025-04-20T13:17:05+00:00
URL https://swisssense.be/robots.txt
Redirect https://www.swisssense.be/robots.txt
Redirect Domain www.swisssense.be
Redirect Base swisssense.be
Domain IPs 104.21.91.252, 172.67.183.108, 2606:4700:3031::ac43:b76c, 2606:4700:3032::6815:5bfc
Redirect IPs 104.21.91.252, 172.67.183.108, 2606:4700:3031::ac43:b76c, 2606:4700:3032::6815:5bfc
Response IP 172.67.183.108
Found Yes
Hash 7bb2626e53e1344a061d25fb09fef9c7b9a37b41c3d112d7728b648bcce80f0e
SimHash 2871425ddeaf

Groups

*

Rule Path
Disallow /search
Disallow *%2B*%2B*
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /cart
Disallow /livepreview
Disallow /app/
Disallow /lib/
Disallow /pub/
Disallow /checkout/
Disallow /cgi-bin/
Disallow /package.json
Disallow /package-lock.json
Disallow /yarn.lock
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /api/
Disallow /advieswijzers
Disallow /online-ratgeber
Disallow /matraswijzer
Disallow /topmatraswijzer
Disallow /topperfinder
Disallow /kussenwijzer
Disallow /kopfkissenfinder
Disallow /dekbedwijzer
Disallow /bettdeckenfinder
Disallow /generic-lead-form
Disallow /configurator
Disallow /contact-met-swiss-sense-iframe
Disallow /retour-iframe
Disallow /bodyscan-matratzen-iframe
Disallow /default-category/*

screaming frog seo spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.swisssense.be/sitemap-index.xml
sitemap https://www.swisssense.be/sitemaps/category.xml
sitemap https://www.swisssense.be/sitemaps/filtered_category.xml
sitemap https://www.swisssense.be/sitemaps/page.xml
sitemap https://www.swisssense.be/sitemaps/product.xml
sitemap https://www.swisssense.be/sitemaps/storelocator.xml

Comments

  • Bot traffic bloat update
  • New files related
  • Added 06-03
  • LivePreview
  • Directories
  • Paths (clean URLs)
  • Do not index the general technical directories and files on a server
  • Files
  • CVS, SVN directory and dump files
  • alokai
  • advisors etc
  • bots blocked entirely
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.