Log In Sign Up

mafyouit.tech
robots.txt

Robots Exclusion Standard data for mafyouit.tech

Resource Scan

Scan Details

Site Domain mafyouit.tech
Base Domain mafyouit.tech
Scan Status Ok
Last Scan2025-10-23T10:16:49+00:00
Next Scan 2025-11-22T10:16:49+00:00

Last Scan

Scanned2025-10-23T10:16:49+00:00
URL https://mafyouit.tech/robots.txt
Domain IPs 51.124.12.35
Response IP 51.124.12.35
Found Yes
Hash 0c9fed195a0937ef5af3ba50273645d9c4f34d6219502b0483f1325e83e444f0
SimHash 020e5413cf46

Groups

*

Rule Path
Allow /
Allow /Portfolio/
Allow /TechForAll/
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.ico
Allow /*.webmanifest
Allow /*.json
Disallow /bin/
Disallow /obj/
Disallow /_framework/
Disallow /Properties/
Disallow /.vs/
Disallow /.git/
Disallow /packages/
Disallow /wwwroot/lib/
Disallow /investor/
Disallow /Investor/
Allow /images/
Allow /icons/
Allow /favicon*
Allow /icon-*
Allow /apple-touch-icon*

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://mafyouit.tech/sitemap.xml
Back to top

Comments

  • Mafyou IT - Robots.txt
  • Site: https://mafyouit.tech
  • Développement d'applications mobiles Android et solutions informatiques accessibles
  • Optimisation pour les moteurs de recherche
  • Interdire l'accès aux fichiers système et sensibles
  • Interdire l'espace investisseurs (privé)
  • Permettre l'accès aux images importantes
  • Sitemap
  • Crawl-delay pour éviter la surcharge
  • Instructions spécifiques pour les principaux moteurs de recherche
Back to top