indigoneo.be
robots.txt

Robots Exclusion Standard data for indigoneo.be

Resource Scan

Scan Details

Site Domain indigoneo.be
Base Domain indigoneo.be
Scan Status Ok
Last Scan2024-09-24T06:46:35+00:00
Next Scan 2024-10-08T06:46:35+00:00

Last Scan

Scanned2024-09-24T06:46:35+00:00
URL https://www.indigoneo.be/robots.txt
Domain IPs 13.35.238.123, 13.35.238.32, 13.35.238.5, 13.35.238.94, 2600:9000:21d1:2800:18:d87c:cb80:93a1, 2600:9000:21d1:3000:18:d87c:cb80:93a1, 2600:9000:21d1:3c00:18:d87c:cb80:93a1, 2600:9000:21d1:6e00:18:d87c:cb80:93a1, 2600:9000:21d1:7600:18:d87c:cb80:93a1, 2600:9000:21d1:9200:18:d87c:cb80:93a1, 2600:9000:21d1:a000:18:d87c:cb80:93a1, 2600:9000:21d1:c000:18:d87c:cb80:93a1
Response IP 13.35.238.5
Found Yes
Hash d777aec14ebc51eeb836bc181bf23dc81fe6d3719cd650cb01a2ec575d7bb668
SimHash fcdc286046b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /widget/
Disallow /fr/widget/
Disallow /en/widget/
Disallow /es/widget/
Disallow /nl/widget/
Disallow /fr/events/
Disallow /en/events/
Disallow /es/events/
Disallow /nl/events/
Disallow /fr/legal-notices
Disallow /en/legal-notices
Disallow /es/legal-notices
Disallow /nl/legal-notices
Disallow /?service=booking
Disallow /?service=subscription
Disallow /?signup*
Disallow /fr/account/*
Disallow /en/account/*
Disallow /nl/account/*
Disallow /es/account/*
Disallow /fr/customer-service/new-request
Disallow /en/customer-service/new-request
Disallow /es/customer-service/new-request
Disallow /nl/customer-service/new-request
Disallow /fr/page/contact
Disallow /en/page/contact
Disallow /es/page/contact
Disallow /nl/page/contact
Disallow /fr/page/about-us
Disallow /en/page/about-us
Disallow /es/page/about-us
Disallow /nl/page/about-us
Disallow /fr/terms-and-conditions
Disallow /en/terms-and-conditions
Disallow /es/terms-and-conditions
Disallow /nl/terms-and-conditions
Disallow /fr/cgv-list
Disallow /en/cgv-list
Disallow /es/cgv-list
Disallow /nl/cgv-list
Disallow /fr/accepted-payment-methods
Disallow /en/accepted-payment-methods
Disallow /es/accepted-payment-methods
Disallow /nl/accepted-payment-methods
Disallow /fr/privacy-policy
Disallow /en/privacy-policy
Disallow /es/privacy-policy
Disallow /nl/privacy-policy
Disallow /fr/purchase
Disallow /en/purchase
Disallow /es/purchase
Disallow /nl/purchase
Disallow /sign-redirect
Disallow *data%3A*$
Disallow *base64*$

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.indigoneo.be/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow all search engine
  • Define max crawling delay of search engine (in seconds)
  • Define sitemap file location
  • Prevent path from crawling by search engine
  • Prevent files from crawling by search engine