cenit.com
robots.txt

Robots Exclusion Standard data for cenit.com

Resource Scan

Scan Details

Site Domain cenit.com
Base Domain cenit.com
Scan Status Ok
Last Scan2026-02-20T03:58:23+00:00
Next Scan 2026-03-06T03:58:23+00:00

Last Scan

Scanned2026-02-20T03:58:23+00:00
URL https://cenit.com/robots.txt
Redirect https://www.cenit.com/robots.txt
Redirect Domain www.cenit.com
Redirect Base cenit.com
Domain IPs 2a05:d014:14f:aa0e:d712:8a94:9a07:1137, 35.158.169.233
Redirect IPs 2a05:d014:14f:aa0e:d712:8a94:9a07:1137, 35.158.169.233
Response IP 35.158.169.233
Found Yes
Hash 51a344763db06145c6a475195dcd66a5b967319c66eebe77c210a3e77afb5233
SimHash 211852c41e62

Groups

rogerbot
ezooms
dotbot

Rule Path
Disallow /

*

Rule Path Comment
Allow / -
Disallow /search* -
Disallow /de/suche* -
Disallow /fr/chercher* -
Disallow /ro/cautare* -
Disallow /*?id=* non speaking URLs
Disallow /*cHash no cHash
Disallow /*dtopunkte*$ -
Disallow /*technicalM*$ -
Disallow /*thema_kontakt*$ -
Disallow /*tx_kesearch_pi1*$ -
Disallow /*overwriteDemand*$ -
Allow /*pages%26cHash* -
Allow /*cenitM%26cHash* -
Allow /*news%26cHash* -
Allow /*webinars%26cHash* -
Allow /*newsIR%26cHash* -
Allow /*pressP%26cHash* -
Disallow */cenitwebguide* -
Disallow */fileadmin/dam* -
Disallow /fileadmin/Media/cenit/noindex/ -
Disallow /fileadmin/Media/cenit/_NoIndexFiles/ -
Disallow /typo3/ -
Disallow /typo3conf/ -
Disallow /*/Private/* -
Disallow /fileadmin/templates/html/* -
Disallow /*/Configuration/* -
Disallow /typo3temp/* -
Allow /typo3conf/ext/ -
Allow /typo3temp/*.css -
Allow /typo3temp/*.css.*.gzip -
Allow /typo3temp/*.js -
Allow /typo3temp/*.js.*.gzip -
Allow /typo3temp/*.jpg -
Allow /typo3temp/*.gif -
Allow /typo3temp/*.png -
Disallow *.sql -
Disallow *.sql.gz -

Other Records

Field Value
sitemap https://www.cenit.com/sitemap.xml
sitemap https://www.cenit.com/de/sitemap.xml
sitemap https://www.cenit.com/fr/sitemap.xml
sitemap https://www.cenit.com/ro/sitemap.xml

Comments

  • disallow search pages
  • disallow parameter
  • disallow folders
  • sitemaps