indigoneo.es
robots.txt

Robots Exclusion Standard data for indigoneo.es

Resource Scan

Scan Details

Site Domain indigoneo.es
Base Domain indigoneo.es
Scan Status Ok
Last Scan2024-10-05T14:19:12+00:00
Next Scan 2024-10-19T14:19:12+00:00

Last Scan

Scanned2024-10-05T14:19:12+00:00
URL https://www.indigoneo.es/robots.txt
Domain IPs 13.33.88.106, 13.33.88.28, 13.33.88.58, 13.33.88.86, 2600:9000:223b:1c00:9:6d6a:fc40:93a1, 2600:9000:223b:1e00:9:6d6a:fc40:93a1, 2600:9000:223b:2600:9:6d6a:fc40:93a1, 2600:9000:223b:3a00:9:6d6a:fc40:93a1, 2600:9000:223b:5000:9:6d6a:fc40:93a1, 2600:9000:223b:5600:9:6d6a:fc40:93a1, 2600:9000:223b:b400:9:6d6a:fc40:93a1, 2600:9000:223b:ec00:9:6d6a:fc40:93a1
Response IP 13.33.88.86
Found Yes
Hash a2ae795556a40d4d448689386f6168b9a2d4152fd5b5f6fc2881a0cba541926a
SimHash fcdc386046b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /widget/
Disallow /fr/widget/
Disallow /en/widget/
Disallow /es/widget/
Disallow /nl/widget/
Disallow /fr/events/
Disallow /en/events/
Disallow /es/events/
Disallow /nl/events/
Disallow /fr/legal-notices
Disallow /en/legal-notices
Disallow /es/legal-notices
Disallow /nl/legal-notices
Disallow /?service=booking
Disallow /?service=subscription
Disallow /?signup*
Disallow /fr/account/*
Disallow /en/account/*
Disallow /nl/account/*
Disallow /es/account/*
Disallow /fr/customer-service/new-request
Disallow /en/customer-service/new-request
Disallow /es/customer-service/new-request
Disallow /nl/customer-service/new-request
Disallow /fr/page/contact
Disallow /en/page/contact
Disallow /es/page/contact
Disallow /nl/page/contact
Disallow /fr/page/about-us
Disallow /en/page/about-us
Disallow /es/page/about-us
Disallow /nl/page/about-us
Disallow /fr/terms-and-conditions
Disallow /en/terms-and-conditions
Disallow /es/terms-and-conditions
Disallow /nl/terms-and-conditions
Disallow /fr/cgv-list
Disallow /en/cgv-list
Disallow /es/cgv-list
Disallow /nl/cgv-list
Disallow /fr/accepted-payment-methods
Disallow /en/accepted-payment-methods
Disallow /es/accepted-payment-methods
Disallow /nl/accepted-payment-methods
Disallow /fr/privacy-policy
Disallow /en/privacy-policy
Disallow /es/privacy-policy
Disallow /nl/privacy-policy
Disallow /fr/purchase
Disallow /en/purchase
Disallow /es/purchase
Disallow /nl/purchase
Disallow /sign-redirect
Disallow *data%3A*$
Disallow *base64*$

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.indigoneo.es/sitemap.xml

Comments

  • www.robotstxt.org/
  • Allow all search engine
  • Define max crawling delay of search engine (in seconds)
  • Define sitemap file location
  • Prevent path from crawling by search engine
  • Prevent files from crawling by search engine