Log In Sign Up

minetttour.lu
robots.txt

Robots Exclusion Standard data for minetttour.lu

Resource Scan

Scan Details

Site Domain minetttour.lu
Base Domain minetttour.lu
Scan Status Ok
Last Scan2025-12-04T11:18:51+00:00
Next Scan 2025-12-18T11:18:51+00:00

Last Scan

Scanned2025-12-04T11:18:51+00:00
URL https://minetttour.lu/robots.txt
Redirect https://www.minetttour.lu/robots.txt
Redirect Domain www.minetttour.lu
Redirect Base minetttour.lu
Domain IPs 2a01:4f8:c011:469::1, 49.12.23.185
Redirect IPs 2a01:4f8:c011:469::1, 49.12.23.185
Response IP 49.12.23.185
Found Yes
Hash eccc1085a9f983dc7207b41e3e1b395e2312514421371c3fecf0e76181f77547
SimHash 7d19ef01ece1

Groups

gptbot

Rule Path
Disallow

chatgpt-user/2.0

Rule Path
Disallow

claudebot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

perplexity-user/1.0

Rule Path
Disallow

google-extended

Rule Path
Disallow

amazonbot

Rule Path
Disallow

duckassistbot

Rule Path
Disallow

mistralai-user/1.0

Rule Path
Disallow

youbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

facebot

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*/Private/*
Disallow /*/Configuration/*
Disallow /typo3temp/var/*
Disallow /typo3/
Disallow *.sql
Disallow *.sql.gz
Disallow /*?*eventDateId=
Disallow *.ics
Disallow /*cHash%3D
Disallow /*map?ident=
Disallow /*IMXTOOLS_ADDRESSBASE
Disallow /*%26theme%3D
Disallow /*.gpx
Back to top

Other Records

Field Value
sitemap https://www.minetttour.lu/sitemap.xml
sitemap https://www.minetttour.lu/fr/sitemap.xml
sitemap https://www.minetttour.lu/de/sitemap.xml
Back to top

Comments

  • We do not distinguish between the browsers.
  • Only allow URLs generated with frontend routing
  • L=0 is the default language
  • Should always be protected, but you know...
  • Disallow all files in /typo3temp/var/
  • Disallow all files in /typo3/
  • Disallow all kind of sql files
  • Disallow calendar files
Back to top