Log In Sign Up

minetttrail.lu
robots.txt

Robots Exclusion Standard data for minetttrail.lu

Resource Scan

Scan Details

Site Domain minetttrail.lu
Base Domain minetttrail.lu
Scan Status Ok
Last Scan2025-12-06T00:49:25+00:00
Next Scan 2025-12-20T00:49:25+00:00

Last Scan

Scanned2025-12-06T00:49:25+00:00
URL https://minetttrail.lu/robots.txt
Redirect https://www.minetttrail.lu/robots.txt
Redirect Domain www.minetttrail.lu
Redirect Base minetttrail.lu
Domain IPs 49.12.23.185
Redirect IPs 49.12.23.185
Response IP 49.12.23.185
Found Yes
Hash bf5fd695db303451c0e7cb8e172e1cfe41213ae6b9523de1d70b62f7113d250b
SimHash 7d59ef41ece1

Groups

gptbot

Rule Path
Disallow

chatgpt-user/2.0

Rule Path
Disallow

claudebot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

perplexity-user/1.0

Rule Path
Disallow

google-extended

Rule Path
Disallow

amazonbot

Rule Path
Disallow

duckassistbot

Rule Path
Disallow

mistralai-user/1.0

Rule Path
Disallow

youbot

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

facebot

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /*?id=*
Disallow /*%26id%3D*
Disallow /*?L=0*
Disallow /*%26L%3D0*
Disallow /*/Private/*
Disallow /*/Configuration/*
Disallow /typo3temp/var/*
Disallow /typo3/
Disallow *.sql
Disallow *.sql.gz
Disallow /*?*eventDateId=
Disallow *.ics
Disallow /*cHash%3D
Disallow /*map?ident=
Disallow /*IMXTOOLS_ADDRESSBASE
Disallow /*%26theme%3D
Disallow /*.gpx
Back to top

Other Records

Field Value
sitemap https://www.minetttrail.lu/sitemap.xml
sitemap https://www.minetttrail.lu/fr/sitemap.xml
sitemap https://www.minetttrail.lu/de/sitemap.xml
sitemap https://www.minetttrail.lu/nl/sitemap.xml
Back to top

Comments

  • We do not distinguish between the browsers.
  • Only allow URLs generated with frontend routing
  • L=0 is the default language
  • Should always be protected, but you know...
  • Disallow all files in /typo3temp/var/
  • Disallow all files in /typo3/
  • Disallow all kind of sql files
  • Disallow calendar files
Back to top