indigoneo.lu
robots.txt

Robots Exclusion Standard data for indigoneo.lu

Resource Scan

Scan Details

Site Domain indigoneo.lu
Base Domain indigoneo.lu
Scan Status Ok
Last Scan2024-06-15T12:21:56+00:00
Next Scan 2024-06-29T12:21:56+00:00

Last Scan

Scanned2024-06-15T12:21:56+00:00
URL https://www.indigoneo.lu/robots.txt
Domain IPs 18.155.68.100, 18.155.68.105, 18.155.68.54, 18.155.68.73, 2600:9000:23d2:1c00:18:c172:6940:93a1, 2600:9000:23d2:4600:18:c172:6940:93a1, 2600:9000:23d2:4c00:18:c172:6940:93a1, 2600:9000:23d2:600:18:c172:6940:93a1, 2600:9000:23d2:7a00:18:c172:6940:93a1, 2600:9000:23d2:8800:18:c172:6940:93a1, 2600:9000:23d2:9200:18:c172:6940:93a1, 2600:9000:23d2:f400:18:c172:6940:93a1
Response IP 18.155.68.100
Found Yes
Hash 3b40571613e9a0a565255d20b51825d82c8c18a563ee760e3cce0b9eee6664ed
SimHash fcdc386046b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /widget/
Disallow /fr/widget/
Disallow /en/widget/
Disallow /es/widget/
Disallow /nl/widget/
Disallow /fr/events/
Disallow /en/events/
Disallow /es/events/
Disallow /nl/events/
Disallow /fr/legal-notices
Disallow /en/legal-notices
Disallow /es/legal-notices
Disallow /nl/legal-notices
Disallow /?service=booking
Disallow /?service=subscription
Disallow /?signup*
Disallow /fr/account/*
Disallow /en/account/*
Disallow /nl/account/*
Disallow /es/account/*
Disallow /fr/customer-service/new-request
Disallow /en/customer-service/new-request
Disallow /es/customer-service/new-request
Disallow /nl/customer-service/new-request
Disallow /fr/page/contact
Disallow /en/page/contact
Disallow /es/page/contact
Disallow /nl/page/contact
Disallow /fr/page/about-us
Disallow /en/page/about-us
Disallow /es/page/about-us
Disallow /nl/page/about-us
Disallow /fr/terms-and-conditions
Disallow /en/terms-and-conditions
Disallow /es/terms-and-conditions
Disallow /nl/terms-and-conditions
Disallow /fr/cgv-list
Disallow /en/cgv-list
Disallow /es/cgv-list
Disallow /nl/cgv-list
Disallow /fr/accepted-payment-methods
Disallow /en/accepted-payment-methods
Disallow /es/accepted-payment-methods
Disallow /nl/accepted-payment-methods
Disallow /fr/privacy-policy
Disallow /en/privacy-policy
Disallow /es/privacy-policy
Disallow /nl/privacy-policy
Disallow /fr/purchase
Disallow /en/purchase
Disallow /es/purchase
Disallow /nl/purchase
Disallow /sign-redirect
Disallow *data%3A*$
Disallow *base64*$

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.indigoneo.lu/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow all search engine
  • Define max crawling delay of search engine (in seconds)
  • Define sitemap file location
  • Prevent path from crawling by search engine
  • Prevent files from crawling by search engine