digicivi.com
robots.txt

Robots Exclusion Standard data for digicivi.com

Resource Scan

Scan Details

Site Domain digicivi.com
Base Domain digicivi.com
Scan Status Ok
Last Scan2025-10-30T15:18:53+00:00
Next Scan 2025-11-29T15:18:53+00:00

Last Scan

Scanned2025-10-30T15:18:53+00:00
URL https://digicivi.com/robots.txt
Domain IPs 104.21.60.44, 172.67.191.118, 2606:4700:3032::ac43:bf76, 2606:4700:3037::6815:3c2c
Response IP 104.21.60.44
Found Yes
Hash 40c57c38a3a2cd2b3f9fb1a83d3a11ec51ec194556ac6a0051b22a8772bf4f28
SimHash 8488db723600

Groups

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

*

Rule Path
Allow /en/occupation/*
Allow /es/occupation/*
Allow /de/occupation/*
Allow /fr/occupation/*
Allow /it/occupation/*
Allow /pt/occupation/*
Allow /pl/occupation/*
Allow /cs/occupation/*
Allow /sk/occupation/*
Allow /hu/occupation/*
Allow /ro/occupation/*
Allow /sl/occupation/*
Allow /bg/occupation/*
Allow /da/occupation/*
Allow /nl/occupation/*
Allow /sv/occupation/*
Allow /no/occupation/*
Allow /fi/occupation/*
Allow /et/occupation/*
Allow /lv/occupation/*
Allow /lt/occupation/*
Allow /hr/occupation/*
Allow /el/occupation/*
Allow /ua/occupation/*
Allow /en/index
Allow /en/index/*
Allow /es/index/*
Allow /de/index/*
Allow /fr/index/*
Allow /it/index/*
Allow /pt/index/*
Allow /pl/index/*
Allow /cs/index/*
Allow /sk/index/*
Allow /hu/index/*
Allow /ro/index/*
Allow /sl/index/*
Allow /bg/index/*
Allow /da/index/*
Allow /nl/index/*
Allow /sv/index/*
Allow /no/index/*
Allow /fi/index/*
Allow /et/index/*
Allow /lv/index/*
Allow /lt/index/*
Allow /hr/index/*
Allow /el/index/*
Allow /ua/index/*
Allow /en/jobs/*
Allow /es/jobs/*
Allow /de/jobs/*
Allow /fr/jobs/*
Allow /it/jobs/*
Allow /pt/jobs/*
Allow /pl/jobs/*
Allow /cs/jobs/*
Allow /sk/jobs/*
Allow /hu/jobs/*
Allow /ro/jobs/*
Allow /sl/jobs/*
Allow /bg/jobs/*
Allow /da/jobs/*
Allow /nl/jobs/*
Allow /sv/jobs/*
Allow /no/jobs/*
Allow /fi/jobs/*
Allow /et/jobs/*
Allow /lv/jobs/*
Allow /lt/jobs/*
Allow /hr/jobs/*
Allow /el/jobs/*
Allow /ua/jobs/*
Allow /en/jobs
Allow /es/jobs
Allow /de/jobs
Allow /fr/jobs
Allow /it/jobs
Allow /pt/jobs
Allow /pl/jobs
Allow /cs/jobs
Allow /sk/jobs
Allow /hu/jobs
Allow /ro/jobs
Allow /sl/jobs
Allow /bg/jobs
Allow /da/jobs
Allow /nl/jobs
Allow /sv/jobs
Allow /no/jobs
Allow /fi/jobs
Allow /et/jobs
Allow /lv/jobs
Allow /lt/jobs
Allow /hr/jobs
Allow /el/jobs
Allow /ua/jobs
Disallow /partner
Disallow /partner/
Disallow /*/partner
Disallow /*/partner/*
Disallow /resume
Disallow /resume/
Disallow /*/resume
Disallow /*/resume/*
Disallow /job/
Disallow /*/job/
Disallow /*/job/*
Disallow /common
Disallow /common/
Disallow /*/common
Disallow /*/common/*
Disallow /education
Disallow /education/
Disallow /*/education
Disallow /*/education/*
Disallow /experience
Disallow /experience/
Disallow /*/experience
Disallow /*/experience/*
Disallow /view
Disallow /view/
Disallow /*/view
Disallow /*/view/*
Disallow /payment
Disallow /payment/
Disallow /*/payment
Disallow /*/payment/*
Disallow /download
Disallow /download/
Disallow /*/download
Disallow /*/download/*
Disallow /employer
Disallow /employer/
Disallow /*/employer
Disallow /*/employer/*
Disallow /themes/
Disallow /*.php

Comments

  • robots.txt