tmstunisia.com
robots.txt

Robots Exclusion Standard data for tmstunisia.com

Resource Scan

Scan Details

Site Domain tmstunisia.com
Base Domain tmstunisia.com
Scan Status Ok
Last Scan2025-02-20T16:53:33+00:00
Next Scan 2025-03-22T16:53:33+00:00

Last Scan

Scanned2025-02-20T16:53:33+00:00
URL https://tmstunisia.com/robots.txt
Redirect https://www.tmstunisia.com/robots.txt
Redirect Domain www.tmstunisia.com
Redirect Base tmstunisia.com
Domain IPs 162.19.106.61
Redirect IPs 162.19.106.61
Response IP 162.19.106.61
Found Yes
Hash 083494879ceb2f90e41e63231851de196ab3177526b711c769358ed5a6372e63
SimHash 6911df50d281

Groups

badbot

Rule Path
Disallow /

evilscraper

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /config/
Disallow /logs/
Disallow /temp/
Disallow /backup/
Disallow /cgi-bin/
Disallow /scripts/
Disallow /db_connect.wdd
Disallow /config.ini
Disallow /settings.json
Disallow /debug.log
Disallow /*?*
Disallow /*%26*
Allow /*.css$
Allow /*.js$
Allow /*.png$
Allow /*.jpg$
Allow /*.gif$

Other Records

Field Value
sitemap https://www.tmstunisia.com/FR/sitemap.xml

Comments

  • Bloquer tous les robots malveillants
  • Règles générales pour tous les robots
  • Bloquer les répertoires sensibles ou administratifs
  • Bloquer les fichiers sensibles
  • Empêcher l'indexation des pages dynamiques avec des paramètres
  • Autoriser les fichiers essentiels (CSS, JS, images)
  • Fournir le chemin du sitemap