Log In Sign Up

itinfra.datwyler.com
robots.txt

Robots Exclusion Standard data for itinfra.datwyler.com

Resource Scan

Scan Details

Site Domain itinfra.datwyler.com
Base Domain datwyler.com
Scan Status Ok
Last Scan2024-06-06T06:25:36+00:00
Next Scan 2024-06-20T06:25:36+00:00

Last Scan

Scanned2024-06-06T06:25:36+00:00
URL https://itinfra.datwyler.com/robots.txt
Domain IPs 104.22.74.194, 104.22.75.194, 172.67.30.135, 2606:4700:10::6816:4ac2, 2606:4700:10::6816:4bc2, 2606:4700:10::ac43:1e87
Response IP 104.22.74.194
Found Yes
Hash 051283e809faa650ee40890244b1970c75eb85dcf01ddffd35a63e68a9c5b6af
SimHash 43200966473e

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Allow /*/htmx.min.js
Allow /*/css/fields/phone-country.css
Allow /*/fields/phone-country.js
Allow /*/css/formie-theme.css
Allow /*/css/formie-base.css
Allow /*/js/formie.js
Allow /*/js/captchas/recaptcha-v3.js
Allow /*/fields/date-picker.js
Allow /*/fields/repeater.js
Allow /*/js/fields/conditions.js

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://itinfra.datwyler.com/de_de/sitemaps-3-sitemap.xml
sitemap https://itinfra.datwyler.com/de_ch/sitemaps-3-sitemap.xml
sitemap https://itinfra.datwyler.com/de_at/sitemaps-3-sitemap.xml
sitemap https://itinfra.datwyler.com/en/sitemaps-2-sitemap.xml
sitemap https://itinfra.datwyler.com/en_us/sitemaps-2-sitemap.xml
sitemap https://itinfra.datwyler.com/en_mea/sitemaps-2-sitemap.xml
sitemap https://itinfra.datwyler.com/en_apac/sitemaps-2-sitemap.xml
sitemap https://itinfra.datwyler.com/es/sitemaps-6-sitemap.xml
sitemap https://itinfra.datwyler.com/es_us/sitemaps-6-sitemap.xml
sitemap https://itinfra.datwyler.com/es_es/sitemaps-6-sitemap.xml
sitemap https://itinfra.datwyler.com/fr/sitemaps-7-sitemap.xml
sitemap https://itinfra.datwyler.com/fr_fr/sitemaps-7-sitemap.xml
sitemap https://itinfra.datwyler.com/fr_ch/sitemaps-7-sitemap.xml
sitemap https://itinfra.datwyler.com/fr_be/sitemaps-7-sitemap.xml
sitemap https://itinfra.datwyler.com/it_it/sitemaps-1-sitemap.xml
sitemap https://itinfra.datwyler.com/nl_nl/sitemaps-5-sitemap.xml
sitemap https://itinfra.datwyler.com/nl_be/sitemaps-5-sitemap.xml
sitemap https://itinfra.datwyler.com/zh-hans_ch/sitemaps-4-sitemap.xml
Back to top

Comments

  • robots.txt for https://itinfra.datwyler.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/
  • Disallow ChatGPT bot, as there's no benefit to allowing it to index your site
Back to top